00010000:00010000:3.0:1762167001.080421:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d07f77 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.080441:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d07f77 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.080448:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381d96c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.080454:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d07f77 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.080464:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d07f77 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.080475:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167001.080479:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167001.080483:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d07f77 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.080489:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d07f77 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167001.080837:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451560192 00000100:00100000:3.0:1762167001.080844:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451560192 00000100:00100000:3.0:1762167001.080927:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16101 00000100:00100000:3.0:1762167001.080938:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56156:x1847765451560192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.080952:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.080971:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d07f7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2962 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167001.080995:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x812:0x0] initial LVB size: 165787, mtime: 0x690888d9, atime: 0x690888d7, ctime: 0x690888d9, blocks: 0x203 00010000:00010000:3.0:1762167001.081016:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.081018:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.081027:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d07f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2962 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.081042:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d07f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2962 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.081054:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381d97c00, rc 0) 00000100:00100000:3.0:1762167001.081092:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56156:x1847765451560192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 158us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.081099:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16101 00000100:00100000:3.0:1762167001.082326:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451560448 00000100:00100000:3.0:1762167001.082337:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451560448 00002000:00010000:3.0:1762167001.082382:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2069 (0->18446744073709551615) 00002000:00100000:3.0:1762167001.082388:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce8000 with x1847765451560448 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167001.082401:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242ce8000. 00000100:00100000:3.0:1762167001.082449:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2470 00000100:00100000:3.0:1762167001.082465:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451560448:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167001.082802:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.082806:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167000 -> 1762167001 00002000:00010000:3.0:1762167001.082808:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:3.0:1762167001.082811:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167000 -> 1762167001 00002000:00010000:3.0:1762167001.082813:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:3.0:1762167001.082879:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451560448:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 417us (605us total) trans 17179875448 rc 0/0 00000100:00100000:3.0:1762167001.082890:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2470 00002000:00010000:3.0:1762167001.082895:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2069 (0->18446744073709551615) 00002000:00100000:3.0:1762167001.082897:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce8000 with x1847765451560448 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167001.082902:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242ce8000. 00000100:00100000:3.0:1762167001.084093:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451560576 00000100:00100000:3.0:1762167001.084099:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451560576 00000100:00100000:3.0:1762167001.084145:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19293 00000100:00100000:3.0:1762167001.084154:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56156:x1847765451560576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.084173:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.084191:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d07f85 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2969 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.084279:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d07f8c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.084294:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d07f8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.084304:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d07f8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167001.084329:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 137054 00000004:00200000:3.0:1762167001.084333:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167001.084347:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d07f8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.084387:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d07f85 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2969 expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.084403:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d07f8c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2969 expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.084411:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167001.084414:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167001.084418:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30cc00, rc 0) 00000100:00100000:3.0:1762167001.084474:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56156:x1847765451560576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 320us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.084481:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19293 00000100:00100000:3.0:1762167001.085933:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451560832 00000100:00100000:3.0:1762167001.085940:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451560832 00000100:00100000:3.0:1762167001.085986:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19294 00000100:00100000:3.0:1762167001.085994:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56156:x1847765451560832:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167001.086029:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167001.086047:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d07f8c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2969 expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.086058:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167001.086061:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167001.086217:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d07f93 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.086228:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d07f93 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.086236:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d07f93 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762167001.086285:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952328 00000004:00010000:3.0:1762167001.086310:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f6fb928a reply state 000000001fcf12ee transno 8589952329 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d07f93 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167001.086318:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167001.086392:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56156:x1847765451560832:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 398us (542us total) trans 8589952329 rc 0/0 00000100:00100000:3.0:1762167001.086399:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19294 00000020:00080000:3.0:1762167001.086405:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762167001.087513:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451560960 00000100:00100000:3.0:1762167001.087518:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451560960 00000100:00100000:3.0:1762167001.087555:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16102 00000100:00100000:3.0:1762167001.087563:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56156:x1847765451560960:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.087575:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.087593:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d07f9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2970 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167001.087615:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x816:0x0] initial LVB size: 165787, mtime: 0x690888d9, atime: 0x690888d8, ctime: 0x690888d9, blocks: 0x203 00010000:00010000:3.0:1762167001.087630:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.087633:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.087639:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d07f9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2970 expref: 29 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.087653:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d07f9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2970 expref: 29 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.087663:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36f35e800, rc 0) 00000100:00100000:3.0:1762167001.087743:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56156:x1847765451560960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 180us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.087749:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16102 00000100:00100000:3.0:1762167001.088985:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451561216 00000100:00100000:3.0:1762167001.088991:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451561216 00002000:00010000:3.0:1762167001.089044:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2067 (0->18446744073709551615) 00002000:00100000:3.0:1762167001.089047:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4f100 with x1847765451561216 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167001.089053:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4f100. 00000100:00100000:3.0:1762167001.089078:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2473 00000100:00100000:3.0:1762167001.089088:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451561216:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167001.089228:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x813:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.089233:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x813:0x0] updating lvb mtime from disk: 1762167000 -> 1762167001 00002000:00010000:3.0:1762167001.089238:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x813:0x0] updating lvb atime from disk: 1762167000 -> 1762167000 00002000:00010000:3.0:1762167001.089240:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x813:0x0] updating lvb ctime from disk: 1762167000 -> 1762167001 00002000:00010000:3.0:1762167001.089242:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x813:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.089270:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451561216:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 184us (319us total) trans 21474842915 rc 0/0 00000100:00100000:3.0:1762167001.089278:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2473 00002000:00010000:3.0:1762167001.089282:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2067 (0->18446744073709551615) 00002000:00100000:3.0:1762167001.089285:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4f100 with x1847765451561216 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167001.089296:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4f100. 00000100:00100000:3.0:1762167001.090388:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451561472 00000100:00100000:3.0:1762167001.090394:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451561472 00000100:00100000:3.0:1762167001.090447:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19295 00000100:00100000:3.0:1762167001.090456:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56156:x1847765451561472:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167001.090535:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.090551:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.090562:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:3.0:1762167001.090669:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000089e83495 reply state 0000000075b8b60c transno 8589952330 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167001.090682:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167001.090788:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56156:x1847765451561472:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 301us (406us total) trans 8589952330 rc 0/0 00000100:00100000:3.0:1762167001.090798:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19295 00010000:00010000:3.0:1762167001.091512:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.091523:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.091530:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.091535:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36f35f800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.091544:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.091552:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.091566:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167001.091569:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167001.091573:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.091578:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07fa1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167001.092089:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451561856 00000100:00100000:3.0:1762167001.092095:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451561856 00000100:00100000:3.0:1762167001.092144:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16105 00000100:00100000:3.0:1762167001.092158:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451561856:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762167001.092387:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.092392:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.092397:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167000 -> 1762167001 00002000:00010000:3.0:1762167001.092402:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.092407:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.092455:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451561856:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 299us (473us total) trans 21474842917 rc 0/0 00000100:00100000:3.0:1762167001.092469:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16105 00000001:00080000:3.0:1762167001.106195:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952331 is committed 00000004:00080000:3.0:1762167001.106205:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3357 committed 00000004:00080000:3.0:1762167001.106224:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3370 committed 00000004:00080000:3.0:1762167001.106237:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3369 committed 00000004:00080000:3.0:1762167001.106242:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3356 committed 00000004:00080000:3.0:1762167001.106248:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3355 committed 00000004:00080000:3.0:1762167001.106254:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3368 committed 00000004:00080000:3.0:1762167001.106258:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3367 committed 00000004:00080000:3.0:1762167001.106261:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3354 committed 00000004:00080000:3.0:1762167001.106264:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3353 committed 00000004:00080000:3.0:1762167001.106267:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3366 committed 00000004:00080000:3.0:1762167001.106270:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3352 committed 00000004:00080000:3.0:1762167001.106273:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3365 committed 00000004:00080000:3.0:1762167001.106281:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3351 committed 00000004:00080000:3.0:1762167001.106284:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3364 committed 00000004:00080000:3.0:1762167001.106289:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3363 committed 00000004:00080000:3.0:1762167001.106293:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3350 committed 00000100:00100000:3.0:1762167001.106628:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454318592 00000100:00100000:3.0:1762167001.106638:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454318592 00000100:00100000:3.0:1762167001.106685:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454318848 00000100:00100000:3.0:1762167001.106692:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454318848 00000100:00100000:3.0:1762167001.106721:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454318464 00000100:00100000:3.0:1762167001.106726:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454318464 00000100:00100000:3.0:1762167001.106787:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16108 00000100:00100000:3.0:1762167001.106799:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765454318976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167001.107132:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.107137:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.107140:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:3.0:1762167001.107146:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.107151:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.107190:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454318976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 393us (553us total) trans 21474842918 rc 0/0 00000100:00100000:3.0:1762167001.107206:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16108 00000100:00100000:3.0:1762167001.107225:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16112 00000100:00100000:3.0:1762167001.107235:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454320128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167001.107370:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.107374:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.107379:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:3.0:1762167001.107386:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.107394:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.107455:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454320128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 222us (538us total) trans 17179875454 rc 0/0 00000100:00100000:3.0:1762167001.107468:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16112 00000100:00100000:3.0:1762167001.107492:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16114 00000100:00100000:3.0:1762167001.107504:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454319232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167001.107674:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.107677:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.107680:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167001.107682:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.107683:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.107717:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454319232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (369us total) trans 21474842921 rc 0/0 00000100:00100000:3.0:1762167001.107726:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16114 00000100:00100000:3.0:1762167001.107886:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.107922:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451562368 00000100:00100000:3.0:1762167001.107926:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451562368 00000100:00100000:3.0:1762167001.108004:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19296 00000100:00100000:3.0:1762167001.108021:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56156:x1847765451562368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.108041:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.108065:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07faf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2977 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.108121:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07faf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2977 expref: 890 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.108148:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d07faf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2977 expref: 890 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.108180:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8a00) 00010000:00010000:3.0:1762167001.108186:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167001.108192:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36f35f800, rc 0) 00000100:00100000:3.0:1762167001.108239:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56156:x1847765451562368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 222us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.108253:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19296 00000004:00080000:3.0:1762167001.108812:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f400a80/2, rc 0, transno 21474842924 00000100:00100000:3.0:1762167001.108821:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454319488:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167001.108847:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f402680/2, rc 0, transno 21474842925 00000100:00100000:3.0:1762167001.108855:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454320000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167001.109980:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.121130:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.123653:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.125639:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.151915:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.161560:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.163257:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.166667:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.172862:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.174932:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.177005:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2478 00000100:00100000:3.0:1762167001.179407:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.179511:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451564544 00000100:00100000:1.0:1762167001.179525:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451564544 00000100:00100000:1.0:1762167001.179615:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2479 00000100:00100000:1.0:1762167001.179625:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451564544:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167001.179662:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.179682:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d07f7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2962 expref: 25 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.179691:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167001.179693:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167001.179697:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.179737:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d07f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2962 expref: 25 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.179750:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d07f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2962 expref: 25 pid: 6532 timeout: 721 lvb_type: 0 00000100:00100000:1.0:1762167001.179795:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454321024:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167001.179895:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167001.181591:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24786bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454321024:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.181622:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.181961:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.181973:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.183680:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.183693:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.183699:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.183704:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167001.183707:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.183713:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.183726:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.183732:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0801f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.183831:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451564544:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4204us (4439us total) trans 0 rc 137054/137054 00000100:00100000:1.0:1762167001.183840:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2479 00000100:00100000:1.0:1762167001.186240:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451564800 00000100:00100000:1.0:1762167001.186252:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451564800 00000100:00100000:1.0:1762167001.186334:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2480 00000100:00100000:1.0:1762167001.186357:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451564800:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167001.186403:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.186452:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d07f9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2970 expref: 28 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.186461:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167001.186464:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167001.186467:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.186502:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d07f9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2970 expref: 28 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.186515:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d07f9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2970 expref: 28 pid: 6532 timeout: 721 lvb_type: 0 00000100:00100000:1.0:1762167001.186528:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454321152:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167001.186640:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167001.187993:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.188069:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167001.188467:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.188481:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.189871:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.189884:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.189892:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.189899:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ac00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167001.189904:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.189912:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.189927:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.189934:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08026 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->139263] (req 0->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.190012:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451564800:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3657us (3827us total) trans 0 rc 137054/137054 00000100:00100000:1.0:1762167001.190022:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2480 00000100:00100000:3.0:1762167001.197398:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.198719:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451565440 00000100:00100000:1.0:1762167001.198725:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451565440 00000100:00100000:1.0:1762167001.198791:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7163 00000100:00100000:1.0:1762167001.198803:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56157:x1847765451565440:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167001.199037:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56157:x1847765451565440:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 237us (368us total) trans 8589952335 rc 0/0 00000100:00100000:1.0:1762167001.199045:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7163 00000100:00100000:3.0:1762167001.201122:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.202898:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167001.203168:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08034 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.203175:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08034 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167001.203190:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 137054 00010000:00010000:3.0:1762167001.203340:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0802d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2993 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.203395:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08034 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2993 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.203404:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8a00) 00010000:00010000:3.0:1762167001.203407:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167001.203410:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:3.0:1762167001.203456:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451565696:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2202us (2339us total) trans 8589952336 rc 0/0 00000100:00100000:3.0:1762167001.203464:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19300 00000100:00100000:3.0:1762167001.204669:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.206279:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.209546:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.211555:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.214644:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.216463:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000001:00080000:3.0:1762167001.233593:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952340 is committed 00000004:00080000:3.0:1762167001.233604:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3365 committed 00000004:00080000:3.0:1762167001.233624:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3378 committed 00000004:00080000:3.0:1762167001.233643:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3377 committed 00000004:00080000:3.0:1762167001.233649:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3364 committed 00000004:00080000:3.0:1762167001.233652:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3363 committed 00000004:00080000:3.0:1762167001.233655:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3376 committed 00000004:00080000:3.0:1762167001.233659:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3375 committed 00000004:00080000:3.0:1762167001.233664:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3362 committed 00000004:00080000:3.0:1762167001.233668:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3361 committed 00000004:00080000:3.0:1762167001.233672:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3374 committed 00000004:00080000:3.0:1762167001.233676:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3360 committed 00000004:00080000:3.0:1762167001.233678:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3373 committed 00000004:00080000:3.0:1762167001.233680:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3359 committed 00000004:00080000:3.0:1762167001.233682:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3372 committed 00000004:00080000:3.0:1762167001.233684:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3371 committed 00000004:00080000:3.0:1762167001.233686:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3358 committed 00000100:00100000:3.0:1762167001.234108:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454321536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.234155:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.234191:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454322048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.234222:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.234312:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454322560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.234349:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.234377:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454323072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.234410:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.234462:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454322560 00000100:00100000:3.0:1762167001.234469:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454322560 00000100:00100000:3.0:1762167001.234496:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454323072 00000100:00100000:3.0:1762167001.234501:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454323072 00000100:00100000:3.0:1762167001.234524:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454323456 00000100:00100000:3.0:1762167001.234529:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454323456 00000100:00100000:3.0:1762167001.234570:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16125 00000100:00100000:3.0:1762167001.234582:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3296:x1847765454322176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167001.234830:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.234836:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.234839:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:3.0:1762167001.234842:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.234845:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.234890:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454322176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 308us (689us total) trans 21474842927 rc 0/0 00000100:00100000:3.0:1762167001.235525:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16125 00000100:00100000:1.0:1762167001.235531:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16127 00000100:00100000:1.0:1762167001.235545:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454321920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167001.235560:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16129 00000100:00100000:3.0:1762167001.235572:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454322432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167001.235666:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.235670:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.235673:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.235675:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.235677:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167001.235687:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.235690:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.235692:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167001.235694:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.235697:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167001.235721:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454321920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (1401us total) trans 21474842928 rc 0/0 00000100:00100000:3.0:1762167001.235727:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454322432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (1344us total) trans 21474842929 rc 0/0 00000100:00100000:1.0:1762167001.235728:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16127 00000100:00100000:3.0:1762167001.235734:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16129 00000100:00100000:1.0:1762167001.235750:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16131 00000100:00100000:3.0:1762167001.235760:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16132 00000100:00100000:1.0:1762167001.235785:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454322944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167001.235790:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454323456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167001.235890:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x813:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.235890:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.235895:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.235896:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x813:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.235902:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x813:0x0] updating lvb atime from disk: 1762167000 -> 1762167000 00002000:00010000:1.0:1762167001.235902:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167001.235906:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x813:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.235906:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.235908:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x813:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167001.235909:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.235943:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454323456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (1434us total) trans 21474842930 rc 0/0 00000100:00100000:1.0:1762167001.235943:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454322944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 182us (1483us total) trans 21474842931 rc 0/0 00000100:00100000:3.0:1762167001.235954:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16132 00000100:00100000:1.0:1762167001.235959:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16131 00000100:00100000:3.0:1762167001.236003:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.236055:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454322304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.236084:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.236132:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454322816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167001.236141:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16133 00000100:00100000:1.0:1762167001.236155:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454321792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.236181:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.236210:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454323328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.236238:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.236271:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454322816 00000100:00100000:3.0:1762167001.236275:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454322816 00002000:00010000:1.0:1762167001.236285:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.236290:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.236292:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.236294:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.236297:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.236304:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454323328 00000100:00100000:3.0:1762167001.236308:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454323328 00000100:00100000:1.0:1762167001.236350:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454321792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (346us total) trans 17179875463 rc 0/0 00000100:00100000:1.0:1762167001.236359:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16133 00000100:00100000:3.0:1762167001.236638:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16136 00000100:00100000:3.0:1762167001.236646:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3293:x1847765454323328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.236745:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454323328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (504us total) trans 17179875466 rc 0/0 00000100:00100000:1.0:1762167001.236745:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451567104 00000100:00100000:1.0:1762167001.236752:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451567104 00000100:00100000:3.0:1762167001.236756:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16136 00000100:00100000:1.0:1762167001.236833:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454322688 00000100:00100000:1.0:1762167001.236839:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454322688 00000100:00100000:3.0:1762167001.236843:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16137 00000100:00100000:3.0:1762167001.236854:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56065:x1847765451567104:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.236863:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167001.236874:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16138 00010000:00010000:3.0:1762167001.236878:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0806c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb29af expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.236889:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454322688:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167001.236904:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d07ec1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2915 expref: 25 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.236913:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.236915:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.236919:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0806c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29af expref: 25 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.236950:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d07ec1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2915 expref: 25 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.236966:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d07ec1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2915 expref: 25 pid: 6533 timeout: 722 lvb_type: 1 00000100:00100000:3.0:1762167001.236978:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454323584:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167001.237038:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167001.237064:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454322688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (242us total) trans 21474842932 rc 0/0 00000100:00100000:1.0:1762167001.237073:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16138 00000004:00080000:3.0:1762167001.237132:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff80000/2, rc 0, transno 17179875463 00000100:00100000:3.0:1762167001.237139:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454321792:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167001.237157:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff83100/2, rc 0, transno 17179875464 00000100:00100000:3.0:1762167001.237162:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454322304:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167001.237217:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24732df80/2, rc 0, transno 17179875465 00000100:00100000:3.0:1762167001.237220:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454322816:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167001.237226:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346a2d500/2, rc 0, transno 17179875466 00000100:00100000:3.0:1762167001.237229:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454323328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.238094:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454323584:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.238117:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0806c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29af expref: 25 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.238133:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228400, rc 0) 00000100:00100000:3.0:1762167001.238175:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56065:x1847765451567104:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1323us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.238182:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16137 00000100:00100000:3.0:1762167001.240584:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451567360 00000100:00100000:3.0:1762167001.240590:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451567360 00000100:00100000:3.0:1762167001.240640:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16140 00000100:00100000:3.0:1762167001.240649:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56065:x1847765451567360:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.240674:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.240691:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d08073 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb29b6 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.240725:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36dd58800/0xf915a5bdf3d07ecf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb291c expref: 29 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.240734:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.240736:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.240741:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d08073 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29b6 expref: 29 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.240793:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36dd58800/0xf915a5bdf3d07ecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb291c expref: 29 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.240810:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36dd58800/0xf915a5bdf3d07ecf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb291c expref: 29 pid: 6532 timeout: 722 lvb_type: 1 00000100:00100000:3.0:1762167001.240823:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454323840:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167001.240885:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.242196:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454323840:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.242224:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d08073 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29b6 expref: 29 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.242242:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381d97c00, rc 0) 00000100:00100000:3.0:1762167001.242606:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56065:x1847765451567360:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1956us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.242615:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16140 00000100:00100000:3.0:1762167001.244883:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451567616 00000100:00100000:3.0:1762167001.244891:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451567616 00000100:00100000:3.0:1762167001.244995:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16141 00000100:00100000:1.0:1762167001.246927:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.248914:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765454324224:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167001.248934:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167001.249070:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451567744:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2003us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.249080:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7190 00000100:00100000:1.0:1762167001.249118:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.249513:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2483 00000100:00100000:3.0:1762167001.249529:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451568128:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167001.249937:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.249943:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.249948:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.249954:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.249960:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.250016:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451568128:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 491us (677us total) trans 21474842934 rc 0/0 00000100:00100000:3.0:1762167001.250032:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2483 00002000:00010000:3.0:1762167001.250038:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167001.250044:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce8700 with x1847765451568128 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167001.250051:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ce8700. 00000100:00100000:3.0:1762167001.251659:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451568256 00000100:00100000:3.0:1762167001.251669:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451568256 00000100:00100000:3.0:1762167001.251732:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19304 00000100:00100000:3.0:1762167001.251742:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451568256:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.251793:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.251816:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d08081 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb29c4 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.251900:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d08088 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.251913:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d08088 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.251923:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d08088 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167001.251948:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 137054 00000004:00200000:3.0:1762167001.251952:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167001.251968:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d08088 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.251991:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d08081 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29c4 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.252007:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d08088 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29c4 expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.252015:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8e00) 00010000:00010000:3.0:1762167001.252018:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167001.252020:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36f35f800, rc 0) 00000100:00100000:3.0:1762167001.252079:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451568256:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 339us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.252086:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19304 00000100:00100000:1.0:1762167001.256002:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.263858:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.274050:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.274159:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451568896 00000100:00100000:3.0:1762167001.274169:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451568896 00000100:00100000:3.0:1762167001.274284:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19305 00000100:00100000:3.0:1762167001.274295:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56158:x1847765451568896:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.274316:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.274335:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0808f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb29cb expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.274407:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f000/0xf915a5bdf3d08096 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274420:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f000/0xf915a5bdf3d08096 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274443:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f000/0xf915a5bdf3d08096 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274460:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0809d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274467:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0809d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274474:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0809d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274604:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d080a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274613:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d080a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274620:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d080a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167001.274631:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 137054 00010000:00010000:3.0:1762167001.274729:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f000/0xf915a5bdf3d08096 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274737:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f000/0xf915a5bdf3d08096 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274744:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f000/0xf915a5bdf3d08096 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274750:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36f35f000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.274754:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f000/0xf915a5bdf3d08096 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274877:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f000/0xf915a5bdf3d08096 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274895:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167001.274898:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167001.274903:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f000/0xf915a5bdf3d08096 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274909:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f000/0xf915a5bdf3d08096 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274922:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0809d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274928:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0809d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274933:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0809d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274938:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36f35fe00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.274941:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0809d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274951:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0809d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274958:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee36dcc8500) 00010000:00010000:3.0:1762167001.274960:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167001.274963:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0809d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.274969:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0809d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167001.277856:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.277896:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.278006:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451569024 00000100:00100000:3.0:1762167001.278016:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451569024 00000100:00100000:3.0:1762167001.278101:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 600 00000100:00100000:3.0:1762167001.278116:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765451569024:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167001.278132:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167001.278154:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d080a4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29cb expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.278172:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8e00) 00010000:00010000:3.0:1762167001.278177:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167001.278237:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765451569024:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 125us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.278245:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 600 00000100:00100000:1.0:1762167001.280510:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.285724:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451569920 00000100:00100000:1.0:1762167001.285734:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451569920 00010000:00010000:1.0:1762167001.285821:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d08088 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29c4 expref: 898 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.285863:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7191 00000100:00100000:1.0:1762167001.285875:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765451569920:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.285892:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.285899:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d08088 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29c4 expref: 898 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.285912:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d08088 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29c4 expref: 898 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.285937:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d08088 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29c4 expref: 898 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.285956:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8e00) 00010000:00010000:1.0:1762167001.285961:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d080ce lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.285970:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d080ce lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.285980:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d080ce lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.286011:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.286075:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451569920:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 201us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.286087:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7191 00000100:00100000:1.0:1762167001.288995:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.295061:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451570944 00000100:00100000:1.0:1762167001.295071:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451570944 00010000:00010000:1.0:1762167001.295110:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08065 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29a8 expref: 899 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.295154:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7192 00000100:00100000:1.0:1762167001.295164:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2361:x1847765451570944:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.295179:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.295186:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08065 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29a8 expref: 899 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.295198:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08065 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29a8 expref: 899 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.295219:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08065 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29a8 expref: 899 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.295234:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8e00) 00010000:00010000:1.0:1762167001.295239:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d080f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.295247:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d080f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.295255:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d080f1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.295286:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.295338:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451570944:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.295351:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7192 00000100:00100000:1.0:1762167001.299745:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.315532:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451571968 00000100:00100000:1.0:1762167001.315540:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451571968 00010000:00010000:1.0:1762167001.315576:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d080f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29e7 expref: 903 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.315612:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7193 00000100:00100000:1.0:1762167001.315622:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2361:x1847765451571968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.315637:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.315644:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d080f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29e7 expref: 903 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.315655:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d080f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29e7 expref: 903 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.315677:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d080f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29e7 expref: 903 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.315697:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:1.0:1762167001.315702:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08129 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.315712:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08129 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.315720:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08129 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.315750:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.315822:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2361:x1847765451571968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 201us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.315830:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7193 00000100:00100000:1.0:1762167001.320048:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451572096 00000100:00100000:1.0:1762167001.320056:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451572096 00010000:00010000:1.0:1762167001.320089:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d08106 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x63b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29ee expref: 902 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.320122:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7194 00000100:00100000:1.0:1762167001.320131:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2360:x1847765451572096:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.320145:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.320151:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d08106 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x63b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29ee expref: 902 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.320163:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d08106 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29ee expref: 902 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.320189:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d08106 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x63b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29ee expref: 902 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.320202:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63b:0x0].0x0 (ffff9ee2429d0900) 00010000:00010000:1.0:1762167001.320208:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08130 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.320217:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08130 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.320224:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08130 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x63b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.320262:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.320317:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:2360:x1847765451572096:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 186us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.320325:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7194 00000100:00100000:3.0:1762167001.321148:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454324864 00000100:00100000:3.0:1762167001.321154:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454324864 00000100:00100000:3.0:1762167001.321196:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1762167001.321204:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454324864:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.321272:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454324864:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.321280:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1762167001.321459:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454324992 00000100:00100000:3.0:1762167001.321464:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454324992 00000100:00100000:3.0:1762167001.321499:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1762167001.321506:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454324992:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.321576:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454324992:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.321583:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1762167001.321782:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454325120 00000100:00100000:3.0:1762167001.321787:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454325120 00000100:00100000:3.0:1762167001.321813:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1762167001.321820:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325120:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.321869:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325120:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.321876:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1762167001.322082:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454325248 00000100:00100000:1.0:1762167001.322087:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454325248 00000100:00100000:1.0:1762167001.322115:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1762167001.322123:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325248:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167001.322180:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325248:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.322188:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1762167001.322399:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454325376 00000100:00100000:1.0:1762167001.322403:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454325376 00000100:00100000:1.0:1762167001.322443:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1762167001.322449:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325376:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167001.322502:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325376:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.322508:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1762167001.322845:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454325504 00000100:00100000:3.0:1762167001.322850:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454325504 00000100:00100000:3.0:1762167001.322875:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1762167001.322885:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325504:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.322955:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325504:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 64us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.322962:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1762167001.322987:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454325504:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167001.323030:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc59c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454325632:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167001.323057:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167001.323084:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.323165:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454325632 00000100:00100000:3.0:1762167001.323171:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454325632 00000100:00100000:3.0:1762167001.323203:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1762167001.323209:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325632:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.323278:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325632:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 68us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.323284:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1762167001.323470:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454325760 00000100:00100000:3.0:1762167001.323474:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454325760 00000100:00100000:3.0:1762167001.323504:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1762167001.323511:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325760:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.323583:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325760:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.323590:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1762167001.323715:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454325888 00000100:00100000:3.0:1762167001.323719:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454325888 00000100:00100000:3.0:1762167001.323748:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1762167001.323754:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325888:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.323823:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454325888:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 69us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.323832:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1762167001.323903:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326016:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.323924:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.323943:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.324478:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326016:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.324517:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326144:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.324540:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.324622:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.324901:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326144:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.325325:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326272:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.325366:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326400:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.325403:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.325438:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167001.325456:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454326400 00000100:00100000:1.0:1762167001.325461:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454326400 00000100:00100000:1.0:1762167001.325483:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1762167001.325489:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454326400:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167001.325544:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:33886:x1847765454326400:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 55us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.325550:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1762167001.325582:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326400:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.325619:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326528:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.325641:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.325659:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.325914:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326528:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:3.0:1762167001.326205:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].35, 728 off51344 00000001:00080000:3.0:1762167001.326218:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952351 00000100:00100000:3.0:1762167001.326278:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326656:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.326308:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.326332:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.326987:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326656:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.327010:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326784:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.327074:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.327571:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.328026:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454326784:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762167001.328113:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952352 00010000:00010000:3.0:1762167001.328142:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08130 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328156:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08130 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x63b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328163:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08130 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x63b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328168:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.328173:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08130 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x63b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328179:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08130 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x63b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328196:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63b:0x0].0x0 (ffff9ee2429d0900) 00010000:00010000:3.0:1762167001.328199:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762167001.328203:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08130 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x63b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328208:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08130 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x63b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328229:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08129 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328235:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08129 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328240:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08129 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328244:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.328247:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08129 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328255:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08129 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328262:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:3.0:1762167001.328264:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762167001.328266:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08129 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328271:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08129 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.328281:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:3.0:1762167001.328284:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167001.328290:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0811b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29f5 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.328380:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56158:x1847765451571840:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 18979us (19112us total) trans 8589952353 rc 0/0 00000100:00100000:3.0:1762167001.328388:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7170 00000020:00080000:3.0:1762167001.328392:0:33886:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762167001.330227:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451572224 00000100:00100000:3.0:1762167001.330234:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451572224 00000100:00100000:3.0:1762167001.330830:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19312 00000100:00100000:3.0:1762167001.330841:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56158:x1847765451572224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.330861:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.330879:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d08137 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb29fc expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.330937:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d08137 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29fc expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.330949:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d08137 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29fc expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.330965:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8500) 00010000:00010000:3.0:1762167001.330968:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167001.330971:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381d96c00, rc 0) 00000100:00100000:3.0:1762167001.331105:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56158:x1847765451572224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 265us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.331112:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19312 00000100:00100000:1.0:1762167001.333052:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.340296:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.340508:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451572608 00000100:00100000:3.0:1762167001.340520:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451572608 00000100:00100000:3.0:1762167001.340588:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7171 00000100:00100000:3.0:1762167001.340600:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56158:x1847765451572608:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:3.0:1762167001.341128:0:33886:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x63b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762167001.341234:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5253, 64 off422784 00000004:00080000:3.0:1762167001.341241:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622133478158ns, next at 623133476195ns, rc = 0 00000040:00080000:3.0:1762167001.341285:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5261, 64 off423880 00000004:00080000:3.0:1762167001.341290:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622133527158ns, next at 623133525901ns, rc = 0 00000001:00080000:3.0:1762167001.341296:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952354 00010000:00010000:3.0:1762167001.341344:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0813e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x63b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.341359:0:33886:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0813e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.341371:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0813e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.341383:0:33886:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0813e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x63b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.341389:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0813e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x63b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.341404:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0813e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.342093:0:33886:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1762167001.342897:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56158:x1847765451572608:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2295us (2606us total) trans 8589952355 rc 0/0 00000100:00100000:3.0:1762167001.342909:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7171 00000020:00080000:3.0:1762167001.342915:0:33886:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762167001.344995:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.345704:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451572864 00000100:00100000:3.0:1762167001.345720:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451572864 00000100:00100000:3.0:1762167001.345834:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7172 00000100:00100000:3.0:1762167001.345846:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f4edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56158:x1847765451572864:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167001.346174:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f4edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56158:x1847765451572864:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 330us (1185us total) trans 8589952356 rc 0/0 00000100:00100000:3.0:1762167001.346184:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7172 00000100:00100000:1.0:1762167001.364145:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.366597:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.370810:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451573632 00000100:00100000:1.0:1762167001.370820:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451573632 00000100:00100000:1.0:1762167001.370890:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 601 00000100:00100000:1.0:1762167001.370899:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56159:x1847765451573632:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167001.370917:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.370940:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0817d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a11 expref: 911 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.370957:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8500) 00010000:00010000:1.0:1762167001.370962:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.371609:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:56159:x1847765451573632:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 708us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.371619:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 601 00000100:00100000:1.0:1762167001.373195:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.373300:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451573888 00000100:00100000:3.0:1762167001.373319:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451573888 00000100:00100000:3.0:1762167001.373379:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7173 00000100:00100000:3.0:1762167001.373390:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:56159:x1847765451573888:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167001.373637:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56159:x1847765451573888:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 248us (446us total) trans 8589952359 rc 0/0 00000100:00100000:3.0:1762167001.373649:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7173 00000100:00100000:3.0:1762167001.376845:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.379347:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.380110:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451574272 00000100:00100000:1.0:1762167001.380118:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451574272 00010000:00010000:1.0:1762167001.380153:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0815a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a03 expref: 913 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.380197:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7195 00000100:00100000:1.0:1762167001.380207:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:2360:x1847765451574272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.380222:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.380229:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0815a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a03 expref: 913 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.380240:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0815a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a03 expref: 913 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.380261:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0815a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a03 expref: 913 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.380277:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8500) 00010000:00010000:1.0:1762167001.380282:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08192 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.380290:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08192 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.380297:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08192 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.380325:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.380385:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:2360:x1847765451574272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 177us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.380395:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7195 00000100:00100000:3.0:1762167001.382151:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.385207:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451574528 00000100:00100000:3.0:1762167001.385215:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451574528 00010000:00010000:3.0:1762167001.385246:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08192 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a18 expref: 914 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.385286:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7196 00000100:00100000:3.0:1762167001.385297:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:2360:x1847765451574528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167001.385312:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167001.385318:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08192 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a18 expref: 914 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:3.0:1762167001.385329:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08192 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a18 expref: 914 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:3.0:1762167001.385349:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08192 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a18 expref: 914 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:3.0:1762167001.385364:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8500) 00010000:00010000:3.0:1762167001.385369:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d081a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.385377:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d081a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.385389:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d081a7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.385420:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167001.385480:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:2360:x1847765451574528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 183us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.385489:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7196 00000100:00100000:3.0:1762167001.391595:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451575168 00000100:00100000:3.0:1762167001.391603:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451575168 00000100:00100000:1.0:1762167001.391622:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2486 00002000:00010000:3.0:1762167001.391627:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167001.391637:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047f480 with x1847765451575168 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167001.391637:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451574912:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167001.391649:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047f480. 00000100:00100000:3.0:1762167001.391681:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2488 00000100:00100000:3.0:1762167001.391695:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451575168:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167001.391947:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.391952:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.391952:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 3502 -> 115275 00002000:00010000:1.0:1762167001.391959:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.391960:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.391967:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.391968:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.391975:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167001.391975:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.391982:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 63 -> 63 00000100:00100000:3.0:1762167001.392018:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451575168:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 325us (545us total) trans 21474842939 rc 0/0 00000100:00100000:1.0:1762167001.392021:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451574912:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 386us (597us total) trans 21474842938 rc 0/0 00000100:00100000:3.0:1762167001.392033:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2488 00002000:00010000:3.0:1762167001.392038:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:1.0:1762167001.392047:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2486 00002000:00010000:1.0:1762167001.392053:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (115275->18446744073709551615) 00002000:00100000:1.0:1762167001.392056:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047c000 with x1847765451574912 ext(115275->18446744073709551615) 00002000:00010000:1.0:1762167001.392061:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047c000. 00002000:00100000:3.0:1762167001.392409:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047f480 with x1847765451575168 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167001.392415:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047f480. 00000100:00100000:3.0:1762167001.395151:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451575296 00000100:00100000:3.0:1762167001.395162:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451575296 00002000:00100000:3.0:1762167001.395205:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (90112->94207) req@ffff9ee37fcb5180 x1847765451575296/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/0 e 0 to 0 dl 1762167012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167001.395215:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb5180 with x1847765451575296 ext(90112->94207) 00002000:00010000:3.0:1762167001.395220:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb5180 00000100:00100000:3.0:1762167001.395259:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2489 00000100:00100000:3.0:1762167001.395268:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451575296:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167001.395510:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451575296:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 242us (439us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762167001.395518:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2489 00002000:00100000:3.0:1762167001.395526:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (90112->94207) req@ffff9ee37fcb5180 x1847765451575296/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/4536 e 0 to 0 dl 1762167012 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167001.395534:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb5180 with x1847765451575296 ext(90112->94207) 00002000:00010000:3.0:1762167001.395550:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb5180 00000100:00100000:3.0:1762167001.398382:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451575424 00000100:00100000:3.0:1762167001.398392:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451575424 00002000:00100000:3.0:1762167001.398449:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (94208->98303) req@ffff9ee37fcb5880 x1847765451575424/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/0 e 0 to 0 dl 1762167012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167001.398459:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb5880 with x1847765451575424 ext(94208->98303) 00002000:00010000:3.0:1762167001.398465:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb5880 00000100:00100000:3.0:1762167001.398498:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2490 00000100:00100000:3.0:1762167001.398508:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451575424:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167001.398730:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451575424:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 222us (449us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762167001.398741:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2490 00002000:00100000:3.0:1762167001.398749:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (94208->98303) req@ffff9ee37fcb5880 x1847765451575424/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/4536 e 0 to 0 dl 1762167012 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167001.398757:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb5880 with x1847765451575424 ext(94208->98303) 00002000:00010000:3.0:1762167001.398792:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb5880 00000100:00100000:3.0:1762167001.401403:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451575552 00000100:00100000:3.0:1762167001.401412:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451575552 00002000:00100000:3.0:1762167001.401472:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->118783) req@ffff9ee36e447100 x1847765451575552/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 504/0 e 0 to 0 dl 1762167012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167001.401483:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e447100 with x1847765451575552 ext(69632->118783) 00002000:00010000:3.0:1762167001.401488:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e447100 00000100:00100000:3.0:1762167001.401520:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2491 00000100:00100000:3.0:1762167001.401529:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451575552:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167001.402996:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451575552:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1462us (1648us total) trans 0 rc 40960/40960 00000100:00100000:3.0:1762167001.403009:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2491 00002000:00100000:3.0:1762167001.403019:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->118783) req@ffff9ee36e447100 x1847765451575552/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 504/440 e 0 to 0 dl 1762167012 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167001.403030:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e447100 with x1847765451575552 ext(69632->118783) 00002000:00010000:3.0:1762167001.403036:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e447100 00000100:00100000:3.0:1762167001.405858:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451575680 00000100:00100000:3.0:1762167001.405868:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451575680 00002000:00100000:3.0:1762167001.405914:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (90112->115274) req@ffff9ee36e444700 x1847765451575680/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/0 e 0 to 0 dl 1762167012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167001.405933:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e444700 with x1847765451575680 ext(90112->115274) 00002000:00010000:3.0:1762167001.405939:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e444700 00000100:00100000:3.0:1762167001.405968:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2492 00000100:00100000:3.0:1762167001.405980:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451575680:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:3.0:1762167001.421587:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451575808:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 12421us (12564us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.421597:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16142 00000100:00100000:1.0:1762167001.426856:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.426959:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451576192 00000100:00100000:3.0:1762167001.426968:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451576192 00000100:00100000:3.0:1762167001.427057:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7174 00000100:00100000:3.0:1762167001.427068:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56065:x1847765451576192:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:3.0:1762167001.427359:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56065:x1847765451576192:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 292us (511us total) trans 8589952363 rc 0/0 00000100:00100000:3.0:1762167001.427367:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7174 00000100:00100000:3.0:1762167001.440332:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451576704 00000100:00100000:3.0:1762167001.440340:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451576704 00000100:00100000:3.0:1762167001.440388:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7175 00000100:00100000:3.0:1762167001.440400:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:56160:x1847765451576704:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167001.440611:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56160:x1847765451576704:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 214us (349us total) trans 8589952365 rc 0/0 00000100:00100000:3.0:1762167001.440620:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7175 00000100:00100000:3.0:1762167001.448224:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451577344 00000100:00100000:3.0:1762167001.448233:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451577344 00000100:00100000:3.0:1762167001.448282:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7176 00000100:00100000:3.0:1762167001.448290:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56160:x1847765451577344:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:3.0:1762167001.448437:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56160:x1847765451577344:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 146us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.448446:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7176 00000100:00100000:3.0:1762167001.449366:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451577600 00000100:00100000:3.0:1762167001.449372:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451577600 00000100:00100000:3.0:1762167001.449407:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7177 00000100:00100000:3.0:1762167001.449415:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56160:x1847765451577600:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167001.449588:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:56160:x1847765451577600:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 174us (262us total) trans 8589952367 rc 0/0 00000100:00100000:3.0:1762167001.449596:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7177 00000100:00100000:1.0:1762167001.451379:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.453525:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451578112 00000100:00100000:3.0:1762167001.453533:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451578112 00000100:00100000:3.0:1762167001.453581:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7178 00000100:00100000:3.0:1762167001.453591:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f4ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:56160:x1847765451578112:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762167001.453644:0:33886:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08202 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a3b expref: 919 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.453673:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.453685:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d08137 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29fc expref: 919 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.453693:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.453728:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d08137 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29fc expref: 919 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.453741:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381d96c00/0xf915a5bdf3d08137 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29fc expref: 919 pid: 30817 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.453756:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454327296:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167001.453855:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.455476:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454327296:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.455502:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.455801:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.455811:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.456150:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.456159:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.456166:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.456172:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.456176:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.456188:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.456198:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8500) 00010000:00010000:3.0:1762167001.456201:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762167001.456205:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.456211:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d08210 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.456221:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8500) 00010000:00010000:3.0:1762167001.456223:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167001.456228:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08202 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a3b expref: 918 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.456400:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f4ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56160:x1847765451578112:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2810us (2937us total) trans 8589952369 rc -22/-22 00000100:00100000:3.0:1762167001.456408:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7178 00000100:00100000:1.0:1762167001.461653:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.463618:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.463698:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451579136 00000100:00100000:3.0:1762167001.463706:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451579136 00000100:00100000:3.0:1762167001.463756:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7179 00000100:00100000:3.0:1762167001.463786:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:56160:x1847765451579136:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762167001.463849:0:33886:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0823a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a50 expref: 923 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.463880:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d08248 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.463895:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d08217 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a42 expref: 923 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.463903:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d08248 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.463934:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d08217 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a42 expref: 923 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.463946:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d08217 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a42 expref: 923 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.463960:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454327424:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167001.464033:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.465310:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454327424:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.465333:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d08248 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167001.466079:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167001.466459:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d08248 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.466467:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d08248 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.466483:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0824f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.466492:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d08225 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x63c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a49 expref: 922 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.466509:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0824f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x63c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.466536:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d08225 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a49 expref: 922 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.466548:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d08225 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x63c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a49 expref: 922 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.466562:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454327552:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167001.466668:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.467625:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454327552:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.467640:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0824f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167001.467881:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167001.468153:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0824f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167001.468168:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0824f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167001.468833:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454327680:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.468876:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.468909:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.469107:0:33886:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842936 gen 2 00000004:00080000:3.0:1762167001.469113:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e472d80, transno 21474842918 00000004:00080000:3.0:1762167001.469133:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e470a80, transno 21474842919 00000004:00080000:3.0:1762167001.469136:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e472300, transno 21474842920 00000004:00080000:3.0:1762167001.469139:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f401500, transno 21474842921 00000004:00080000:3.0:1762167001.469142:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f402300, transno 21474842922 00000004:00080000:3.0:1762167001.469144:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f400000, transno 21474842923 00000004:00080000:3.0:1762167001.469146:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f400a80, transno 21474842924 00000004:00080000:3.0:1762167001.469149:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f402680, transno 21474842925 00000004:00080000:3.0:1762167001.469152:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d1f80, transno 21474842926 00000004:00080000:3.0:1762167001.469154:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d0a80, transno 21474842927 00000004:00080000:3.0:1762167001.469157:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d3100, transno 21474842928 00000004:00080000:3.0:1762167001.469160:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f795880, transno 21474842929 00000004:00080000:3.0:1762167001.469163:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354ce00, transno 21474842930 00000004:00080000:3.0:1762167001.469166:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354dc00, transno 21474842931 00000004:00080000:3.0:1762167001.469170:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354ed80, transno 21474842932 00000004:00080000:3.0:1762167001.469174:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354d500, transno 21474842933 00000004:00080000:3.0:1762167001.469179:0:33886:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474842936 committed transno 21474842936 00000100:00100000:3.0:1762167001.469197:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454327680:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.469240:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454327808:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.469268:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.469297:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.469493:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454327808:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.469544:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454327936:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.469568:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.469593:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.469750:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454327936:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.469840:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454328064:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.469869:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.469891:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3471576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.470027:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454328064:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.470075:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454328192:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.470101:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.470123:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.470215:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454328192:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.470247:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454328320:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.470269:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.470290:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34821d780 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.470408:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454328320:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.470454:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454328448:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.470475:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.470492:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.470603:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454328448:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.470631:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454328576:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.470651:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167001.470680:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34821d780 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.470806:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454328576:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.471168:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454328832 00000100:00100000:3.0:1762167001.471182:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454328832 00000100:00100000:3.0:1762167001.471253:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1762167001.471265:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454328832:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.471374:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454328832:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 113us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.471384:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1762167001.471510:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454328960 00000100:00100000:3.0:1762167001.471517:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454328960 00000100:00100000:3.0:1762167001.471550:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1762167001.471557:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454328960:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.471626:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454328960:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 71us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.471631:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1762167001.471818:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454329088 00000100:00100000:3.0:1762167001.471825:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454329088 00000100:00100000:3.0:1762167001.471869:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1762167001.471877:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:33886:x1847765454329088:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167001.471958:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:33886:x1847765454329088:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.471965:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1762167001.472536:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454329216 00000100:00100000:3.0:1762167001.472541:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454329216 00000100:00100000:3.0:1762167001.472570:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1762167001.472577:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454329216:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167001.475218:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.477187:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167001.478058:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167001.478066:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0825d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.478079:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167001.478084:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0825d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.478092:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0825d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.478106:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63c:0x0].0x0 (ffff9ee2446b8500) 00010000:00010000:1.0:1762167001.478110:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762167001.478114:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0825d lrc: 1/0,0 mode: --/PW res: [0x200000404:0x63c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.478120:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0825d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x63c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167001.478138:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167001.478142:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167001.478147:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167001.499822:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451581056 00000100:00100000:1.0:1762167001.499828:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451581056 00000100:00100000:1.0:1762167001.499880:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7182 00000100:00100000:1.0:1762167001.499889:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:56161:x1847765451581056:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167001.500058:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+932:56161:x1847765451581056:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 171us (339us total) trans 8589952380 rc 0/0 00000100:00100000:1.0:1762167001.500063:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7182 00010000:00010000:1.0:1762167001.512042:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167001.514650:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.516961:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.520649:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.523552:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451582336 00000100:00100000:3.0:1762167001.523560:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451582336 00000100:00100000:3.0:1762167001.523609:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16143 00000100:00100000:3.0:1762167001.523618:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451582336:12345-192.168.203.35@tcp:16:fsx.0 00000100:00100000:1.0:1762167001.538496:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.540906:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.540943:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.540981:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.541139:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2499 00000100:00100000:3.0:1762167001.541149:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451582976:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167001.541417:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.541434:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.541438:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.541443:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.541450:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.541486:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451582976:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 337us (502us total) trans 21474842944 rc 0/0 00000100:00100000:3.0:1762167001.541504:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2499 00002000:00010000:3.0:1762167001.541510:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167001.541515:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24550c700 with x1847765451582976 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167001.541524:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24550c700. 00000100:00100000:1.0:1762167001.542847:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.546237:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.548001:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.548046:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.548182:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2500 00000100:00100000:3.0:1762167001.548204:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451583488:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167001.548206:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:3.0:1762167001.548514:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 206885 -> 119862 00002000:00010000:3.0:1762167001.548519:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.548527:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.548535:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.548549:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 219 -> 219 00000100:00100000:3.0:1762167001.548591:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451583488:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 394us (589us total) trans 21474842946 rc 0/0 00000100:00100000:3.0:1762167001.548601:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2500 00002000:00010000:3.0:1762167001.548605:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (119862->18446744073709551615) 00002000:00100000:3.0:1762167001.548608:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee245189180 with x1847765451583488 ext(119862->18446744073709551615) 00002000:00010000:3.0:1762167001.548615:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee245189180. 00000100:00100000:1.0:1762167001.549710:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.552602:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.552707:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451584000 00000100:00100000:3.0:1762167001.552714:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451584000 00002000:00100000:3.0:1762167001.552752:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (0->40959) req@ffff9ee24518b480 x1847765451584000/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/0 e 0 to 0 dl 1762167012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167001.552793:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24518b480 with x1847765451584000 ext(0->40959) 00002000:00010000:3.0:1762167001.552807:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24518b480 00000100:00100000:3.0:1762167001.552834:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2503 00000100:00100000:3.0:1762167001.552843:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451584000:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167001.554102:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451584000:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1255us (1502us total) trans 0 rc 40960/40960 00000100:00100000:1.0:1762167001.554113:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2503 00002000:00100000:1.0:1762167001.554123:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (0->40959) req@ffff9ee24518b480 x1847765451584000/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/440 e 0 to 0 dl 1762167012 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167001.554134:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24518b480 with x1847765451584000 ext(0->40959) 00002000:00010000:1.0:1762167001.554139:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24518b480 00000100:00100000:1.0:1762167001.560368:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.560443:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451584128 00000100:00100000:3.0:1762167001.560454:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451584128 00002000:00100000:3.0:1762167001.560505:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (155648->221183) req@ffff9ee24518aa00 x1847765451584128/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/0 e 0 to 0 dl 1762167012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167001.560516:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24518aa00 with x1847765451584128 ext(155648->221183) 00002000:00010000:3.0:1762167001.560523:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24518aa00 00000100:00100000:3.0:1762167001.560560:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2504 00000100:00100000:3.0:1762167001.560569:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451584128:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167001.562467:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451584128:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1889us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.562487:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2504 00002000:00100000:3.0:1762167001.562502:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (155648->221183) req@ffff9ee24518aa00 x1847765451584128/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/440 e 0 to 0 dl 1762167012 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167001.562512:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24518aa00 with x1847765451584128 ext(155648->221183) 00002000:00010000:3.0:1762167001.562518:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24518aa00 00000100:00100000:1.0:1762167001.564788:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.567010:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.567043:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.567079:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.567105:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451584512 00000100:00100000:3.0:1762167001.567115:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451584512 00002000:00010000:3.0:1762167001.567154:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (252265->18446744073709551615) 00002000:00100000:3.0:1762167001.567161:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee245189c00 with x1847765451584512 ext(252265->18446744073709551615) 00002000:00010000:3.0:1762167001.567171:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee245189c00. 00000100:00100000:3.0:1762167001.567219:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2506 00000100:00100000:3.0:1762167001.567231:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451584512:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167001.567274:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2507 00000100:00100000:1.0:1762167001.567285:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451584768:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167001.567506:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.567507:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 119862 -> 252265 00002000:00010000:1.0:1762167001.567514:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.567515:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.567521:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.567524:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.567526:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.567532:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.567532:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167001.567539:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 219 -> 219 00000100:00100000:1.0:1762167001.567592:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451584768:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 307us (510us total) trans 21474842947 rc 0/0 00000100:00100000:3.0:1762167001.567593:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451584512:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 361us (583us total) trans 21474842948 rc 0/0 00000100:00100000:1.0:1762167001.567613:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2507 00002000:00010000:1.0:1762167001.567618:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167001.567621:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24518ad80 with x1847765451584768 ext(0->18446744073709551615) 00000100:00100000:3.0:1762167001.567626:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2506 00002000:00010000:1.0:1762167001.567627:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24518ad80. 00002000:00010000:3.0:1762167001.567631:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (252265->18446744073709551615) 00002000:00100000:3.0:1762167001.567637:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee245189c00 with x1847765451584512 ext(252265->18446744073709551615) 00002000:00010000:3.0:1762167001.567645:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee245189c00. 00000100:00100000:1.0:1762167001.569129:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.574332:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451585152 00000100:00100000:1.0:1762167001.574341:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451585152 00000100:00100000:1.0:1762167001.574398:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7183 00000100:00100000:1.0:1762167001.574408:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f4ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+939:56065:x1847765451585152:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167001.574749:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f4ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+940:56065:x1847765451585152:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 342us (488us total) trans 8589952388 rc 0/0 00000100:00100000:1.0:1762167001.574756:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7183 00000100:00100000:1.0:1762167001.584988:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.588671:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451585792 00000100:00100000:1.0:1762167001.588676:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451585792 00000100:00100000:1.0:1762167001.588725:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19339 00000100:00100000:1.0:1762167001.588735:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+941:56162:x1847765451585792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167001.588758:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.588810:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0832f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2a9d expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.589318:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08336 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.589329:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08336 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.589335:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08336 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167001.589343:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x63d:0x0]: returning size 0 00010000:00010000:1.0:1762167001.589374:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0832f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a9d expref: 944 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.589385:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08336 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a9d expref: 943 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.589392:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63d:0x0].0x0 (ffff9ee36dc25500) 00010000:00010000:1.0:1762167001.589395:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167001.589398:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b600, rc 0) 00000100:00100000:1.0:1762167001.589457:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+943:56162:x1847765451585792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 724us (1244us total) trans 8589952390 rc 0/0 00000100:00100000:1.0:1762167001.589464:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19339 00000100:00100000:1.0:1762167001.591994:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451586048 00000100:00100000:1.0:1762167001.592004:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451586048 00000100:00100000:1.0:1762167001.592057:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19340 00000100:00100000:1.0:1762167001.592066:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+943:56162:x1847765451586048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167001.592084:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.592098:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08344 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2aa4 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.592170:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.592180:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08336 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a9d expref: 944 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.592188:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.592220:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08336 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a9d expref: 944 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.592234:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08336 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a9d expref: 944 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.592248:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454329728:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167001.592319:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167001.594162:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454329728:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.594199:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.594354:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.594365:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167001.594391:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x63d:0x0]: returning size 0 00000004:00080000:1.0:1762167001.594827:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x814:0x0], index 0: 0 00000004:00080000:1.0:1762167001.594841:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x817:0x0], index 1: 0 00010000:00010000:1.0:1762167001.595059:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.595069:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.595076:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.595082:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167001.595087:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.595097:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.595113:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63d:0x0].0x0 (ffff9ee36dc25500) 00010000:00010000:1.0:1762167001.595116:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167001.595121:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.595126:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0834b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.595202:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08344 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aa4 expref: 944 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.595212:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:1.0:1762167001.595215:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762167001.595219:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08344 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aa4 expref: 944 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.595236:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a600, rc 0) 00000100:00100000:1.0:1762167001.595313:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+943:56162:x1847765451586048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3247us (3381us total) trans 8589952391 rc 301/301 00000100:00100000:1.0:1762167001.595323:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19340 00000100:00100000:1.0:1762167001.597745:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451586432 00000100:00100000:1.0:1762167001.597797:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451586432 00000100:00100000:1.0:1762167001.597853:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7184 00000100:00100000:1.0:1762167001.597870:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+943:56162:x1847765451586432:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167001.598225:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+944:56162:x1847765451586432:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 362us (564us total) trans 8589952392 rc 0/0 00000100:00100000:1.0:1762167001.598245:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7184 00000100:00100000:3.0:1762167001.600332:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.600442:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451586560 00000100:00100000:1.0:1762167001.600462:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451586560 00000100:00100000:1.0:1762167001.600557:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19341 00000100:00100000:1.0:1762167001.600569:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+944:56162:x1847765451586560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167001.600599:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.600630:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08359 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x63d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2aab expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.600725:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08360 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.600749:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08360 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.600800:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08360 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167001.600864:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x63d:0x0]: returning size 0 00000004:00200000:1.0:1762167001.600871:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167001.600894:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08360 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.600924:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08359 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x63d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aab expref: 946 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.600947:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08360 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aab expref: 945 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.600957:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63d:0x0].0x0 (ffff9ee36dc25900) 00010000:00010000:1.0:1762167001.600960:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762167001.600963:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b200, rc 0) 00000100:00100000:1.0:1762167001.601050:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+945:56162:x1847765451586560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 484us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.601059:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19341 00000100:00100000:3.0:1762167001.603065:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.604635:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.604727:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451587072 00000100:00100000:1.0:1762167001.604733:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451587072 00000100:00100000:1.0:1762167001.604812:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19342 00000100:00100000:1.0:1762167001.604822:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+945:56162:x1847765451587072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167001.604839:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.604866:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08375 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ac0 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.604982:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0837c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.605001:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0837c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167001.605014:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0837c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167001.605028:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 252265 00010000:00010000:1.0:1762167001.605154:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08375 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ac0 expref: 948 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.605172:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0837c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ac0 expref: 947 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.605180:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8b00) 00010000:00010000:1.0:1762167001.605183:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167001.605187:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7be00, rc 0) 00000100:00100000:1.0:1762167001.605238:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+947:56162:x1847765451587072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 418us (608us total) trans 8589952393 rc 0/0 00000100:00100000:1.0:1762167001.605245:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19342 00000100:00100000:1.0:1762167001.607652:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451587328 00000100:00100000:1.0:1762167001.607659:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451587328 00000100:00100000:3.0:1762167001.607690:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16146 00000100:00100000:3.0:1762167001.607794:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451587200:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167001.607801:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16148 00000100:00100000:1.0:1762167001.607820:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451587328:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167001.607839:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0838a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.607846:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08398 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.607859:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0806c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29af expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.607871:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d08073 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29b6 expref: 34 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.607872:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167001.607877:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167001.607881:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0838a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.607907:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167001.607911:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167001.607916:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08398 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.607937:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0806c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29af expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.607948:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d08073 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29b6 expref: 34 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.607954:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0806c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29af expref: 24 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.607964:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d08073 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29b6 expref: 34 pid: 12402 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.607980:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454329856:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167001.607989:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454329984:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167001.608071:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.608093:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.609654:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454329856:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.609680:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0838a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.609734:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454329984:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.609753:0:33892:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08398 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.609941:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451587584 00000100:00100000:3.0:1762167001.609947:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451587584 00000100:00100000:1.0:1762167001.609957:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451587840 00000100:00100000:1.0:1762167001.609968:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451587840 00010000:00010000:3.0:1762167001.609977:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d08073 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29b6 expref: 35 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.609994:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0807a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29bd expref: 26 pid: 12402 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.610013:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7204 00000100:00100000:3.0:1762167001.610023:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765451587584:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762167001.610028:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7205 00010000:00010000:3.0:1762167001.610038:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762167001.610044:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451587840:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167001.610061:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d08073 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29b6 expref: 35 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.610063:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167001.610075:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d08073 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29b6 expref: 35 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.610082:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0807a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29bd expref: 26 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.610100:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0807a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29bd expref: 26 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:3.0:1762167001.610102:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381d97c00/0xf915a5bdf3d08073 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29b6 expref: 35 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:3.0:1762167001.610131:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.610133:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.610139:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08398 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.610149:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08398 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.610149:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0807a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29bd expref: 26 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.610176:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.610180:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.610185:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.610194:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.610196:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167001.610222:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167001.610251:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765451587584:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 230us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.610253:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451587840:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 213us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.610268:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7204 00000100:00100000:1.0:1762167001.610279:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7205 00010000:00010000:3.0:1762167001.610412:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.610432:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.610504:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.610512:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.610519:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.610525:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167001.610529:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.610548:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.610560:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.610567:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08391 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.610603:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765451587456:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2811us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.610611:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16147 00000100:00100000:1.0:1762167001.615831:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451587968 00000100:00100000:1.0:1762167001.615839:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451587968 00010000:00010000:1.0:1762167001.615878:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0806c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29af expref: 25 pid: 12402 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.615917:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7206 00000100:00100000:1.0:1762167001.615927:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451587968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.615943:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.615961:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0806c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29af expref: 25 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.615974:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0806c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29af expref: 25 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.615998:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0806c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29af expref: 25 pid: 12402 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.616013:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.616015:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.616020:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0838a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.616030:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0838a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.616065:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.616117:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451587968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 190us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.616125:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7206 00000100:00100000:3.0:1762167001.617951:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451588096 00000100:00100000:3.0:1762167001.617958:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451588096 00000100:00100000:3.0:1762167001.618003:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451588352 00000100:00100000:3.0:1762167001.618007:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451588352 00000100:00100000:3.0:1762167001.618037:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16149 00000100:00100000:3.0:1762167001.618048:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451588096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.618065:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.618082:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0839f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ac7 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.618104:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16151 00002000:00010000:3.0:1762167001.618110:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 252265, mtime: 0x690888d9, atime: 0x690888d9, ctime: 0x690888d9, blocks: 0xdb 00000100:00100000:1.0:1762167001.618119:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2358:x1847765451588224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.618130:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.618134:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.618134:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.618145:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0839f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ac7 expref: 25 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167001.618153:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d083ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ace expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.618164:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0839f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ac7 expref: 26 pid: 26444 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1762167001.618178:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888d9, atime: 0x690888d9, ctime: 0x690888d9, blocks: 0x3 00010000:00010000:3.0:1762167001.618191:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30cc00, rc 0) 00010000:00010000:1.0:1762167001.618196:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.618200:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.618209:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d083ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ace expref: 34 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167001.618227:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d083ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ace expref: 34 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167001.618238:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a600, rc 0) 00000100:00100000:3.0:1762167001.618239:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451588096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 192us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.618255:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16149 00000100:00100000:1.0:1762167001.618269:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451588224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.618278:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16151 00000100:00100000:1.0:1762167001.649501:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.652647:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.652691:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451588736 00000100:00100000:3.0:1762167001.652698:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451588736 00010000:00010000:3.0:1762167001.652817:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d08367 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ab2 expref: 26 pid: 12402 timeout: 722 lvb_type: 1 00000100:00100000:3.0:1762167001.652857:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7207 00000100:00100000:3.0:1762167001.652867:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451588736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167001.652882:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167001.652907:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d08367 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ab2 expref: 26 pid: 12402 timeout: 722 lvb_type: 1 00010000:00010000:3.0:1762167001.652920:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d08367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ab2 expref: 26 pid: 12402 timeout: 722 lvb_type: 1 00010000:00010000:3.0:1762167001.652942:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d08367 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ab2 expref: 26 pid: 12402 timeout: 722 lvb_type: 1 00010000:00010000:3.0:1762167001.652956:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.652958:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.652962:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d083bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.652971:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d083bb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.652999:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167001.653050:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451588736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 179us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.653067:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7207 00000001:00080000:3.0:1762167001.670504:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842950 is committed 00002000:00010000:1.0:1762167001.670542:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 0 -> 252265 00002000:00010000:1.0:1762167001.670548:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 0 -> 1762167001 00002000:00010000:1.0:1762167001.670551:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 0 -> 1762167001 00002000:00010000:1.0:1762167001.670553:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 1 -> 515 00010000:00010000:1.0:1762167001.670567:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d083bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.670578:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d083bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.670584:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d083bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.670590:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167001.670593:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d083bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.670600:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d083bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.670617:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d083bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.670624:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d083bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.670724:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451588608:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 20448us (21223us total) trans 21474842950 rc 0/0 00000100:00100000:1.0:1762167001.670734:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2509 00000100:00100000:1.0:1762167001.672866:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451588864 00000100:00100000:1.0:1762167001.672877:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451588864 00000100:00100000:1.0:1762167001.672938:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19343 00000100:00100000:1.0:1762167001.672948:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+947:56162:x1847765451588864:12345-192.168.203.35@tcp:44:lfs.0 00000100:00100000:3.0:1762167001.689130:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56162:x1847765451588864:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 16177us (16385us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.689146:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19343 00000100:00100000:3.0:1762167001.689320:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454330368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.689633:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167001.689867:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454330368 00000100:00100000:1.0:1762167001.689877:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454330368 00000100:00100000:1.0:1762167001.689944:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16152 00000100:00100000:1.0:1762167001.689957:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454330368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1762167001.689986:0:12402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2067 count 1 00010000:00010000:1.0:1762167001.690012:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d083c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.690035:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d06bdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2231 expref: 33 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.690048:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167001.690052:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167001.690056:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d083c2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.690095:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d06bdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2231 expref: 33 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.690125:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d06bdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2231 expref: 33 pid: 6535 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.690140:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454330624:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167001.690198:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.691294:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842941 gen 2 00000004:00080000:3.0:1762167001.691304:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474842941 committed transno 21474842941 00000100:00100000:3.0:1762167001.691331:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36de00a80 x1847765454330496/t21474842951(21474842951) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762167017 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762167001.691343:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de00a80/2, rc 0, transno 21474842951 00000100:00100000:3.0:1762167001.691367:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454330496:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762167001.691539:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451588992 00000100:00100000:1.0:1762167001.691546:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451588992 00000100:00100000:1.0:1762167001.691586:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16154 00000100:00100000:1.0:1762167001.691596:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451588992:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762167001.691674:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451588992:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.691681:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16154 00000100:00100000:1.0:1762167001.691885:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454330624:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.691901:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d083c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.693206:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451589248 00000100:00100000:3.0:1762167001.693213:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451589248 00010000:00010000:3.0:1762167001.693244:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d06bdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2231 expref: 34 pid: 6535 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.693283:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7208 00000100:00100000:3.0:1762167001.693293:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451589248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167001.693307:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167001.693313:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d06bdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2231 expref: 34 pid: 6535 timeout: 722 lvb_type: 0 00010000:00010000:3.0:1762167001.693326:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d06bdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2231 expref: 34 pid: 6535 timeout: 722 lvb_type: 0 00010000:00010000:3.0:1762167001.693347:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d06bdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2231 expref: 34 pid: 6535 timeout: 722 lvb_type: 0 00010000:00010000:3.0:1762167001.693362:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.693365:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.693369:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d083c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.693396:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d083c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.693451:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167001.693505:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451589248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 211us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.693519:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7208 00010000:00010000:3.0:1762167001.693560:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167001.693568:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d083c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.693576:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167001.693581:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d083c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.693591:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d083c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.693605:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d083c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.693613:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d083c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.693633:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167001.693635:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167001.693638:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167001.700263:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451589504 00000100:00100000:3.0:1762167001.700346:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451589504 00000100:00100000:3.0:1762167001.700398:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16157 00000100:00100000:3.0:1762167001.700411:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451589504:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167001.700453:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d083d0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700476:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.700482:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.700491:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d083d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700522:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d083d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700569:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d083d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700586:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d083d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700601:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d083d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700616:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167001.700622:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d083d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700649:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d083d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700720:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d083d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700728:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d083d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.700799:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451589504:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 389us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.700808:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16157 00000100:00100000:3.0:1762167001.700836:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16158 00000100:00100000:3.0:1762167001.700845:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451589632:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167001.700873:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d083de lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700881:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.700883:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.700887:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d083de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700897:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d083de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700912:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d083de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700920:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d083de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700932:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d083de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700939:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167001.700942:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d083de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700949:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d083de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700959:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d083de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.700967:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d083de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.701053:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451589632:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 208us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.701060:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16158 00000100:00100000:3.0:1762167001.703440:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451589888 00000100:00100000:3.0:1762167001.703447:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451589888 00000100:00100000:3.0:1762167001.703489:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19344 00000100:00100000:3.0:1762167001.703497:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56162:x1847765451589888:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167001.703547:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167001.703571:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08360 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x63d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aab expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.703589:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63d:0x0].0x0 (ffff9ee36dc25900) 00010000:00010000:3.0:1762167001.703598:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167001.703654:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d083e5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.703666:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d083e5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.703674:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d083e5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:3.0:1762167001.703874:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000484fbd64 reply state 000000003dc85ce0 transno 8589952394 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d083e5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167001.703884:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167001.703985:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56162:x1847765451589888:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 488us (668us total) trans 8589952394 rc 0/0 00000100:00100000:3.0:1762167001.703994:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19344 00000100:00100000:3.0:1762167001.705227:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451590016 00000100:00100000:3.0:1762167001.705234:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451590016 00000100:00100000:3.0:1762167001.705315:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19345 00000100:00100000:3.0:1762167001.705324:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56162:x1847765451590016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.705342:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.705356:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d083ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x63d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2adc expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.705404:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d083ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2adc expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.705416:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d083ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2adc expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.705444:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63d:0x0].0x0 (ffff9ee36dcc8a00) 00010000:00010000:3.0:1762167001.705446:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167001.705449:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c200, rc 0) 00000100:00100000:3.0:1762167001.705491:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56162:x1847765451590016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 167us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.705498:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19345 00000100:00100000:1.0:1762167001.706831:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16159 00000100:00100000:1.0:1762167001.706858:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451590144:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167001.707327:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451590144:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 479us (707us total) trans 21474842952 rc 0/0 00000100:00100000:1.0:1762167001.707352:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16159 00000100:00100000:3.0:1762167001.708884:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451590528 00000100:00100000:3.0:1762167001.708893:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451590528 00000100:00100000:3.0:1762167001.708943:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19346 00000100:00100000:3.0:1762167001.708953:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56162:x1847765451590528:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:3.0:1762167001.709018:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d083f3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.709034:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d083f3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.709046:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d083f3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.709075:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d083f3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.709082:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d083f3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.709089:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d083f3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.709095:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.709100:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d083f3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.709107:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d083f3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.709118:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63d:0x0].0x0 (ffff9ee36dcc8a00) 00010000:00010000:3.0:1762167001.709122:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1762167001.709125:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d083f3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.709131:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d083f3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167001.709198:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56162:x1847765451590528:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 246us (502us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762167001.709206:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19346 00000100:00100000:3.0:1762167001.711299:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451590784 00000100:00100000:3.0:1762167001.711312:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451590784 00000100:00100000:3.0:1762167001.711370:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19347 00000100:00100000:3.0:1762167001.711381:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56162:x1847765451590784:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167001.711440:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167001.711464:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08305 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a8f expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.711482:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8b00) 00010000:00010000:3.0:1762167001.711487:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167001.711527:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d083fa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.711539:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d083fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.711546:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d083fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:3.0:1762167001.711673:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dcd69a69 reply state 00000000cc1b4937 transno 8589952395 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d083fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167001.711682:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167001.711807:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56162:x1847765451590784:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 426us (619us total) trans 8589952395 rc 0/0 00000100:00100000:3.0:1762167001.711815:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19347 00000100:00100000:1.0:1762167001.713261:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451590912 00000100:00100000:1.0:1762167001.713277:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451590912 00000100:00100000:1.0:1762167001.713372:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451591168 00000100:00100000:1.0:1762167001.713378:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451591168 00000100:00100000:1.0:1762167001.713435:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16162 00000100:00100000:3.0:1762167001.713454:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16163 00000100:00100000:1.0:1762167001.713464:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451591040:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167001.713483:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451591168:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167001.713825:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.713830:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.713832:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.713844:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.713845:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.713859:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.713867:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.713874:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167001.713875:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.713890:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167001.713965:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2358:x1847765451591040:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 513us (781us total) trans 17179875476 rc 0/0 00000100:00100000:3.0:1762167001.713979:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451591168:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 498us (640us total) trans 21474842953 rc 0/0 00000100:00100000:1.0:1762167001.713991:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16162 00000100:00100000:3.0:1762167001.714021:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16163 00000100:00100000:1.0:1762167001.715473:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451591424 00000100:00100000:1.0:1762167001.715481:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451591424 00000100:00100000:1.0:1762167001.715525:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7185 00000100:00100000:1.0:1762167001.715536:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56162:x1847765451591424:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762167001.715610:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0837c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ac0 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.715643:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08401 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.715655:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08256 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a57 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.715663:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08287 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a65 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.715670:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08401 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.715699:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08287 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a65 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.715711:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08287 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a65 expref: 895 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.715724:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454330752:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.715849:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08256 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a57 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.715859:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08256 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a57 expref: 895 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.715869:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454330880:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167001.715892:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167001.717309:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454330752:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167001.717323:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454330880:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.717345:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08401 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167001.718008:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451591808 00000100:00100000:1.0:1762167001.718019:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451591808 00010000:00010000:1.0:1762167001.718063:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08256 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a57 expref: 897 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.718116:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7209 00000100:00100000:1.0:1762167001.718128:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451591808:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.718146:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.718154:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08256 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a57 expref: 897 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.718166:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08256 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a57 expref: 897 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.718191:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08256 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a57 expref: 897 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.718212:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8b00) 00010000:00010000:1.0:1762167001.718218:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08401 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.718227:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08401 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.718238:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.718293:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765451591808:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 167us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.718301:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7209 00000100:00100000:1.0:1762167001.719233:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451591936 00000100:00100000:1.0:1762167001.719240:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451591936 00010000:00010000:1.0:1762167001.719268:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08287 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a65 expref: 896 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.719306:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7210 00000100:00100000:1.0:1762167001.719314:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765451591936:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.719326:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.719333:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08287 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a65 expref: 896 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.719344:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08287 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a65 expref: 896 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.719362:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08287 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2a65 expref: 896 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.719377:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8b00) 00010000:00010000:1.0:1762167001.719382:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08401 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.719391:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08401 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.719401:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08401 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.719440:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.719484:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765451591936:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 168us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.719494:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7210 00000100:00100000:1.0:1762167001.720916:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454331008:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.720944:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08408 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167001.721397:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.721461:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451592064 00000100:00100000:1.0:1762167001.721468:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451592064 00010000:00010000:1.0:1762167001.721495:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d083ec lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2adc expref: 895 pid: 32138 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.721532:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7211 00000100:00100000:1.0:1762167001.721542:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451592064:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.721553:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.721559:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d083ec lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2adc expref: 895 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.721571:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d083ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2adc expref: 895 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.721588:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d083ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x63d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2adc expref: 895 pid: 32138 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.721607:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63d:0x0].0x0 (ffff9ee36dcc8a00) 00010000:00010000:1.0:1762167001.721612:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08408 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.721620:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08408 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.721627:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08408 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x63d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.721654:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.721696:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451592064:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 155us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.721705:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7211 00000100:00100000:3.0:1762167001.728693:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.728806:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451592192 00000100:00100000:1.0:1762167001.728814:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451592192 00000100:00100000:1.0:1762167001.728852:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19348 00000100:00100000:1.0:1762167001.728860:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56162:x1847765451592192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167001.728880:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.728901:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0840f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ae3 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.728957:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0840f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ae3 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.728971:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0840f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ae3 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.728993:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:1.0:1762167001.728996:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167001.728999:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b800, rc 0) 00000100:00100000:1.0:1762167001.729053:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56162:x1847765451592192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 193us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.729060:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19348 00000100:00100000:1.0:1762167001.733587:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451592704 00000100:00100000:1.0:1762167001.733599:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451592704 00000100:00100000:1.0:1762167001.733642:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7188 00000100:00100000:1.0:1762167001.733652:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f4ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56162:x1847765451592704:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762167001.733932:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x63d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762167001.734034:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.734050:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.734060:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.734065:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.734069:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.734072:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167001.734091:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762167001.734124:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167001.734133:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167001.734146:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ba00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167001.734150:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167001.734160:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167001.734174:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63d:0x0].0x0 (ffff9ee345a77000) 00010000:00010000:3.0:1762167001.734177:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762167001.734181:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167001.734187:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08416 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x63d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167001.734190:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f4ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56162:x1847765451592704:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 537us (667us total) trans 8589952401 rc 0/0 00000100:00100000:1.0:1762167001.734203:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7188 00010000:00010000:3.0:1762167001.734215:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167001.734219:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167001.734223:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167001.744385:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.747894:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451593088 00000100:00100000:3.0:1762167001.747905:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451593088 00000100:00100000:3.0:1762167001.747975:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19350 00000100:00100000:3.0:1762167001.747986:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56163:x1847765451593088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.748007:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.748028:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08439 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2af1 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.748130:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d08440 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.748146:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d08440 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.748157:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d08440 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167001.748169:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 252265 00010000:00010000:3.0:1762167001.748310:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08439 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2af1 expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.748326:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d08440 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2af1 expref: 901 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.748335:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:3.0:1762167001.748338:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167001.748342:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:3.0:1762167001.748402:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56163:x1847765451593088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 417us (678us total) trans 8589952402 rc 0/0 00000100:00100000:3.0:1762167001.748409:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19350 00000100:00100000:3.0:1762167001.750340:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451593344 00000100:00100000:3.0:1762167001.750349:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451593344 00000100:00100000:3.0:1762167001.750406:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19351 00000100:00100000:3.0:1762167001.750416:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56163:x1847765451593344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.750446:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.750461:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0844e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2af8 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.750546:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d08455 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.750560:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d08455 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.750570:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d08455 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167001.750581:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 252265 00010000:00010000:3.0:1762167001.750678:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0844e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2af8 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.750690:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d08455 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2af8 expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.750697:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:3.0:1762167001.750699:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167001.750701:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c400, rc 0) 00000100:00100000:3.0:1762167001.750744:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56163:x1847765451593344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 330us (457us total) trans 8589952403 rc 0/0 00000100:00100000:3.0:1762167001.750750:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19351 00000100:00100000:1.0:1762167001.776614:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451593472 00000100:00100000:1.0:1762167001.776623:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451593472 00000100:00100000:1.0:1762167001.776685:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2510 00000100:00100000:1.0:1762167001.776694:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451593472:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167001.776726:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08463 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.776740:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.776742:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.776747:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08463 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.776795:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08463 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.778935:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08463 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.778949:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08463 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.778955:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08463 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.778959:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ba00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167001.778963:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08463 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.778969:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08463 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.778982:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08463 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.778986:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08463 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.779047:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451593472:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2351us (2585us total) trans 0 rc 252265/252265 00000100:00100000:1.0:1762167001.779058:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2510 00000100:00100000:1.0:1762167001.781743:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451593600 00000100:00100000:1.0:1762167001.781754:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451593600 00000100:00100000:1.0:1762167001.781849:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2511 00000100:00100000:1.0:1762167001.781858:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451593600:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167001.781907:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 252265, mtime: 0x690888d9, atime: 0x690888d9, ctime: 0x690888d9, blocks: 0x203 00010000:00010000:1.0:1762167001.781916:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0846a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.781929:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.781931:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.781937:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0846a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.781949:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0846a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.783552:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0846a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.783570:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0846a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.783578:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0846a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.783585:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167001.783589:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0846a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.783598:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0846a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.783614:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0846a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.783620:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0846a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.783709:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451593600:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1848us (2049us total) trans 0 rc 252265/252265 00000100:00100000:1.0:1762167001.783719:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2511 00000100:00100000:1.0:1762167001.791807:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451593728 00000100:00100000:1.0:1762167001.791817:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451593728 00000100:00100000:1.0:1762167001.791888:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 605 00000100:00100000:1.0:1762167001.791900:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56163:x1847765451593728:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167001.791917:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.791946:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d08455 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2af8 expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.791965:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:1.0:1762167001.791970:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.792032:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56163:x1847765451593728:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 134us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.792040:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 605 00000100:00100000:1.0:1762167001.793234:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451593984 00000100:00100000:1.0:1762167001.793241:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451593984 00000100:00100000:1.0:1762167001.793279:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7189 00000100:00100000:1.0:1762167001.793289:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56163:x1847765451593984:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167001.793521:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56163:x1847765451593984:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 234us (339us total) trans 8589952404 rc 0/0 00000100:00100000:1.0:1762167001.793530:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7189 00000100:00100000:3.0:1762167001.796343:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451594240 00000100:00100000:3.0:1762167001.796354:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451594240 00000100:00100000:3.0:1762167001.796417:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19352 00000100:00100000:3.0:1762167001.796435:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451594240:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.796461:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.796482:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d08471 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2aff expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.796599:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.796614:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d08432 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aea expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.796623:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.796657:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d08432 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aea expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.796670:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d08432 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aea expref: 904 pid: 30817 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.796684:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454333184:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167001.796791:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2eef00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.798306:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454333184:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.798330:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167001.799536:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451594368 00000100:00100000:1.0:1762167001.799544:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451594368 00010000:00010000:1.0:1762167001.799581:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d08432 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aea expref: 905 pid: 30817 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.799635:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7212 00000100:00100000:1.0:1762167001.799645:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2361:x1847765451594368:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.799660:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.799668:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d08432 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aea expref: 905 pid: 30817 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.799681:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d08432 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aea expref: 905 pid: 30817 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.799701:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d08432 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aea expref: 905 pid: 30817 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.799716:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:1.0:1762167001.799733:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.799742:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.799748:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.799855:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167001.799882:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.799889:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167001.799907:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 252265 00000100:00100000:1.0:1762167001.799912:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2361:x1847765451594368:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 269us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.799920:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7212 00010000:00010000:3.0:1762167001.800049:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d08471 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aff expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.800065:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aff expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.800074:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:3.0:1762167001.800076:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167001.800079:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c600, rc 0) 00000100:00100000:3.0:1762167001.800174:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451594240:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 3741us (3943us total) trans 8589952405 rc 0/0 00000100:00100000:3.0:1762167001.800183:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19352 00000100:00100000:3.0:1762167001.801675:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451594496 00000100:00100000:3.0:1762167001.801683:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451594496 00000100:00100000:3.0:1762167001.801725:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19353 00000100:00100000:3.0:1762167001.801732:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451594496:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.801752:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.801793:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d08486 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b06 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.801876:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.801894:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aff expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.801903:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.801933:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aff expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.801946:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aff expref: 905 pid: 30817 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.801960:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454333312:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167001.802033:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2eef00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.804189:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454333312:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.804225:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167001.804356:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451594624 00000100:00100000:1.0:1762167001.804364:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451594624 00010000:00010000:1.0:1762167001.804399:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aff expref: 906 pid: 30817 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.804450:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7213 00000100:00100000:1.0:1762167001.804460:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2361:x1847765451594624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.804477:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.804483:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aff expref: 906 pid: 30817 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.804496:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aff expref: 906 pid: 30817 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.804518:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d08478 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2aff expref: 906 pid: 30817 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.804533:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:1.0:1762167001.804538:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.804547:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.804555:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.804584:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167001.804623:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167001.804633:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2361:x1847765451594624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (377us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167001.804637:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167001.804645:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7213 00000004:00200000:3.0:1762167001.804700:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 252265 00000004:00200000:3.0:1762167001.804705:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167001.804726:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.804753:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d08486 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b06 expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.804837:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b06 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.804845:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:3.0:1762167001.804848:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167001.804851:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:3.0:1762167001.804892:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451594496:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 3159us (3271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.804904:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19353 00000100:00100000:3.0:1762167001.806549:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451594880 00000100:00100000:3.0:1762167001.806555:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451594880 00000100:00100000:3.0:1762167001.806595:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16165 00000100:00100000:3.0:1762167001.806610:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451594880:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.806620:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.806635:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d08494 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b14 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.806675:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.806678:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.806693:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d08494 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b14 expref: 36 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.806726:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d08494 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b14 expref: 36 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.806741:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d200, rc 0) 00000100:00100000:3.0:1762167001.806803:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451594880:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 197us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.806814:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16165 00000100:00100000:1.0:1762167001.808860:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451595136 00000100:00100000:1.0:1762167001.808867:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451595136 00000100:00100000:1.0:1762167001.808917:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7190 00000100:00100000:1.0:1762167001.808930:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451595136:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167001.809160:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451595136:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 233us (350us total) trans 8589952406 rc 0/0 00000100:00100000:1.0:1762167001.809169:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7190 00000100:00100000:3.0:1762167001.810564:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451595392 00000100:00100000:3.0:1762167001.810570:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451595392 00000100:00100000:3.0:1762167001.810615:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19354 00000100:00100000:3.0:1762167001.810624:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451595392:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.810645:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.810648:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:3.0:1762167001.810672:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0848d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b06 expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.810692:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d08440 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2af1 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.810704:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0840f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ae3 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.810715:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77100) 00010000:00010000:3.0:1762167001.810727:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167001.810753:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d084a2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b1b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.810826:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d084a9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.810839:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d084a9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.810851:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d084a9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000040:00080000:3.0:1762167001.811334:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5255, 88 off422936 00000004:00080000:3.0:1762167001.811343:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622603580254ns, next at 623133476195ns, rc = 0 00000040:00080000:3.0:1762167001.811437:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5263, 88 off424032 00000004:00080000:3.0:1762167001.811443:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622603680242ns, next at 623133525901ns, rc = 0 00000040:00080000:3.0:1762167001.811484:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5264, 88 off424120 00000004:00080000:3.0:1762167001.811488:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622603725667ns, next at 623133525901ns, rc = 0 00000040:00080000:3.0:1762167001.811505:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5256, 88 off423024 00000004:00080000:3.0:1762167001.811509:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622603746758ns, next at 623133476195ns, rc = 0 00000040:00080000:3.0:1762167001.811541:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5265, 88 off424208 00000004:00080000:3.0:1762167001.811546:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622603782777ns, next at 623133525901ns, rc = 0 00000040:00080000:3.0:1762167001.811594:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5257, 88 off423112 00000004:00080000:3.0:1762167001.811599:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622603836163ns, next at 623133476195ns, rc = 0 00000040:00080000:3.0:1762167001.811626:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5266, 88 off424296 00000004:00080000:3.0:1762167001.811631:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622603868088ns, next at 623133525901ns, rc = 0 00000040:00080000:3.0:1762167001.811650:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5258, 88 off423200 00000004:00080000:3.0:1762167001.811655:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622603891954ns, next at 623133476195ns, rc = 0 00000040:00080000:3.0:1762167001.811681:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5267, 88 off424384 00000004:00080000:3.0:1762167001.811685:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622603922026ns, next at 623133525901ns, rc = 0 00000040:00080000:3.0:1762167001.811718:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5259, 88 off423288 00000004:00080000:3.0:1762167001.811724:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622603961201ns, next at 623133476195ns, rc = 0 00000040:00080000:3.0:1762167001.811754:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5260, 88 off423376 00000004:00080000:3.0:1762167001.811783:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622603996732ns, next at 623133476195ns, rc = 0 00000040:00080000:3.0:1762167001.811815:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5268, 88 off424472 00000004:00080000:3.0:1762167001.811820:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622604057577ns, next at 623133525901ns, rc = 0 00000040:00080000:3.0:1762167001.811853:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5261, 88 off423464 00000004:00080000:3.0:1762167001.811858:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622604095157ns, next at 623133476195ns, rc = 0 00000040:00080000:3.0:1762167001.811887:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5269, 88 off424560 00000004:00080000:3.0:1762167001.811892:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622604129131ns, next at 623133525901ns, rc = 0 00000001:00080000:1.0:1762167001.825512:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952400 is committed 00000020:00080000:1.0:1762167001.825535:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee3479d7b40 refcount 2 committed 0 result 0 batchid 4294969169 00000020:00080000:1.0:1762167001.825539:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee342bf70c0 00000020:00080000:1.0:1762167001.825542:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3479d76c0 00000020:00080000:1.0:1762167001.825544:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3728a9800 00000020:00080000:1.0:1762167001.825546:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].37 00000020:00080000:1.0:1762167001.825563:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969168 batchid updated 00000001:00080000:1.0:1762167001.825573:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952406 is committed 00000001:00080000:1.0:1762167001.825593:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952407 is committed 00000004:00080000:1.0:1762167001.825601:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3386 committed 00000004:00080000:1.0:1762167001.825623:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3373 committed 00000004:00080000:1.0:1762167001.825642:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3385 committed 00000004:00080000:1.0:1762167001.825652:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3372 committed 00000004:00080000:1.0:1762167001.825655:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3371 committed 00000004:00080000:1.0:1762167001.825660:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3384 committed 00000004:00080000:1.0:1762167001.825666:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3370 committed 00000004:00080000:1.0:1762167001.825670:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3383 committed 00000004:00080000:1.0:1762167001.825675:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3369 committed 00000004:00080000:1.0:1762167001.825677:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3382 committed 00000004:00080000:1.0:1762167001.825681:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3368 committed 00000004:00080000:1.0:1762167001.825684:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3381 committed 00000004:00080000:1.0:1762167001.825687:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3380 committed 00000004:00080000:1.0:1762167001.825688:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3367 committed 00010000:00010000:1.0:1762167001.825834:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8a00) 00010000:00010000:1.0:1762167001.825838:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762167001.825842:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f2d1a00, rc 0) 00000100:00100000:1.0:1762167001.825924:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451595392:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 15298us (15433us total) trans 8589952407 rc 0/0 00000100:00100000:1.0:1762167001.825934:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19354 00000100:00100000:3.0:1762167001.826026:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454333440:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762167001.826081:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454333696 00000100:00100000:3.0:1762167001.826083:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167001.826091:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454333696 00000100:00100000:3.0:1762167001.826117:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454333952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167001.826136:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454333440 00000100:00100000:1.0:1762167001.826141:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454333440 00000100:00100000:3.0:1762167001.826162:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454334208 00000100:00100000:3.0:1762167001.826167:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454334208 00000100:00100000:1.0:1762167001.826183:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16166 00000100:00100000:1.0:1762167001.826202:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765454333696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167001.826208:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16167 00000100:00100000:3.0:1762167001.826221:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454333440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1762167001.826237:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2070 count 1 00002000:00010000:3.0:1762167001.826287:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x816:0x0] initial LVB size: 137054, mtime: 0x690888d9, atime: 0x690888d8, ctime: 0x690888d9, blocks: 0x203 00010000:00010000:3.0:1762167001.826298:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.826311:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.826315:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.826322:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.826338:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.826348:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.826357:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.826383:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1762167001.826495:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 252265 -> 252265 00002000:00010000:1.0:1762167001.826501:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.826504:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.826507:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.826510:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 301 -> 301 00000100:00100000:1.0:1762167001.826578:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765454333696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 383us (532us total) trans 21474842956 rc 0/0 00000100:00100000:1.0:1762167001.826588:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16166 00000100:00100000:1.0:1762167001.826610:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454334720 00000100:00100000:1.0:1762167001.826615:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454334720 00000100:00100000:1.0:1762167001.826646:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454335232 00000100:00100000:1.0:1762167001.826652:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454335232 00000100:00100000:1.0:1762167001.826679:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454333824 00000100:00100000:1.0:1762167001.826687:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454333824 00000100:00100000:1.0:1762167001.826711:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454334336 00000100:00100000:1.0:1762167001.826716:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454334336 00000100:00100000:1.0:1762167001.826732:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454334848 00000100:00100000:1.0:1762167001.826740:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454334848 00000100:00100000:1.0:1762167001.826785:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454335360 00000100:00100000:1.0:1762167001.826790:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454335360 00000100:00100000:1.0:1762167001.826813:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16168 00000100:00100000:1.0:1762167001.826820:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3295:x1847765454334208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167001.827014:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.827019:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.827022:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.827027:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.827030:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167001.827089:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3295:x1847765454334208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 267us (956us total) trans 17179875478 rc 0/0 00000100:00100000:1.0:1762167001.827098:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16168 00000100:00100000:1.0:1762167001.827126:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454334592 00000100:00100000:1.0:1762167001.827135:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454334592 00000100:00100000:1.0:1762167001.827170:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454335104 00000100:00100000:1.0:1762167001.827175:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454335104 00000100:00100000:1.0:1762167001.827203:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16170 00000100:00100000:1.0:1762167001.827212:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3295:x1847765454335232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.827218:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3293:x1847765454333440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 999us (1132us total) trans 17179875479 rc 0/0 00000100:00100000:3.0:1762167001.827227:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16167 00000100:00100000:3.0:1762167001.827251:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16171 00000100:00100000:3.0:1762167001.827263:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454333824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167001.827322:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.827326:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.827329:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:1.0:1762167001.827331:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.827334:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167001.827370:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3295:x1847765454335232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (1055us total) trans 17179875481 rc 0/0 00000100:00100000:1.0:1762167001.827377:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16170 00002000:00010000:3.0:1762167001.827384:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.827390:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167001.827393:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1762167001.827395:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16173 00002000:00010000:3.0:1762167001.827397:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167001.827401:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167001.827407:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454334848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167001.827449:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454333824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (1028us total) trans 17179875482 rc 0/0 00000100:00100000:3.0:1762167001.827460:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16171 00000100:00100000:3.0:1762167001.827477:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16174 00000100:00100000:3.0:1762167001.827486:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3295:x1847765454335360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167001.827570:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454334848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (973us total) trans 21474842958 rc 0/0 00000100:00100000:1.0:1762167001.827579:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16173 00000100:00100000:1.0:1762167001.827595:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16176 00000100:00100000:1.0:1762167001.827607:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454334080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167001.827668:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.827674:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.827681:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.827684:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.827689:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1762167001.827715:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.827720:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.827722:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:1.0:1762167001.827724:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.827726:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.827734:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454335360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (1063us total) trans 17179875483 rc 0/0 00000100:00100000:3.0:1762167001.827741:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16174 00000100:00100000:3.0:1762167001.827758:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16177 00000100:00100000:3.0:1762167001.827793:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454334592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167001.827807:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee344e45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454334080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (855us total) trans 21474842959 rc 0/0 00000100:00100000:1.0:1762167001.827817:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16176 00002000:00010000:3.0:1762167001.827904:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.827908:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.827911:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167001.827915:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.827919:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.827972:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee344e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454334592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (938us total) trans 21474842960 rc 0/0 00000100:00100000:3.0:1762167001.828028:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16177 00010000:00010000:3.0:1762167001.828062:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167001.828078:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.828106:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f2d1400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167001.828113:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.828125:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.828143:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.828152:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.828172:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167001.828175:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167001.828178:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167001.828237:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454333952 00000100:00100000:1.0:1762167001.828243:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454333952 00000100:00100000:3.0:1762167001.828247:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454334976 00000100:00100000:3.0:1762167001.828253:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454334976 00000100:00100000:1.0:1762167001.828283:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16180 00000100:00100000:1.0:1762167001.828293:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454333952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167001.828408:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.828411:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.828414:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.828416:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.828433:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167001.828463:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454333952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (312us total) trans 21474842962 rc 0/0 00000100:00100000:1.0:1762167001.828470:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16180 00000004:00080000:3.0:1762167001.828479:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258000/2, rc 0, transno 21474842962 00000100:00100000:3.0:1762167001.828487:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454333952:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167001.828507:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242523480/2, rc 0, transno 17179875484 00000100:00100000:3.0:1762167001.828513:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454334464:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167001.828529:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242520700/2, rc 0, transno 17179875485 00000100:00100000:3.0:1762167001.828534:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454334976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167001.829333:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451595520 00000100:00100000:1.0:1762167001.829338:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451595520 00010000:00010000:1.0:1762167001.829357:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d07cb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2858 expref: 20 pid: 33892 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.829386:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7214 00000100:00100000:1.0:1762167001.829394:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451595520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.829405:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.829411:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d07cb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2858 expref: 20 pid: 33892 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.829434:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d07cb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2858 expref: 20 pid: 33892 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.829455:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d07cb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2858 expref: 20 pid: 33892 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.829466:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.829468:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.829472:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d084b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.829482:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d084b7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.829500:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451595648 00010000:00010000:1.0:1762167001.829505:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167001.829506:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451595648 00000100:00100000:1.0:1762167001.829534:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451595520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 140us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.829542:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7214 00000100:00100000:3.0:1762167001.829563:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16182 00000100:00100000:3.0:1762167001.829577:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:56065:x1847765451595648:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.829593:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.829605:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d084be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b22 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.829624:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0839f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ac7 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167001.829632:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167001.829633:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.829638:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.829641:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d084b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.829645:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d084be lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [110592->172031] (req 110592->172031) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b22 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.829654:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167001.829661:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d084b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.829670:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d084b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.829678:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0839f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ac7 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167001.829683:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d084b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.829688:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0839f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ac7 expref: 20 pid: 26444 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167001.829700:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d084b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.829705:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dd54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454335616:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.829726:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167001.829729:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167001.829732:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167001.829844:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2ee480 going to sleep for 11 seconds 00000004:00080000:3.0:1762167001.830084:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258e00/2, rc 0, transno 21474842963 00000100:00100000:3.0:1762167001.830092:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454333568:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762167001.830834:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dd54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454335616:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.830853:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d084be lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [110592->172031] (req 110592->172031) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b22 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.830868:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f2d1000, rc 0) 00000100:00100000:3.0:1762167001.830904:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56065:x1847765451595648:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1331us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.830911:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16182 00000100:00100000:1.0:1762167001.830983:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.832437:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451595904 00000100:00100000:1.0:1762167001.832442:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451595904 00002000:00100000:1.0:1762167001.832466:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->114687) req@ffff9ee348255f80 x1847765451595904/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/0 e 0 to 0 dl 1762167012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167001.832473:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348255f80 with x1847765451595904 ext(110592->114687) 00002000:00010000:1.0:1762167001.832476:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348255f80 00000100:00100000:1.0:1762167001.832493:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2512 00000100:00100000:1.0:1762167001.832499:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451595904:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167001.832638:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451595904:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 139us (251us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762167001.832643:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2512 00002000:00100000:1.0:1762167001.832647:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->114687) req@ffff9ee348255f80 x1847765451595904/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/4536 e 0 to 0 dl 1762167012 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167001.832655:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348255f80 with x1847765451595904 ext(110592->114687) 00002000:00010000:1.0:1762167001.832659:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348255f80 00000100:00100000:1.0:1762167001.834407:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451596032 00000100:00100000:1.0:1762167001.834415:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451596032 00002000:00100000:1.0:1762167001.834462:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (167936->172031) req@ffff9ee348254700 x1847765451596032/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/0 e 0 to 0 dl 1762167012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167001.834473:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348254700 with x1847765451596032 ext(167936->172031) 00002000:00010000:1.0:1762167001.834478:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348254700 00000100:00100000:1.0:1762167001.834505:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2513 00000100:00100000:1.0:1762167001.834514:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451596032:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167001.834693:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451596032:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 176us (332us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762167001.834701:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2513 00002000:00100000:1.0:1762167001.834708:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (167936->172031) req@ffff9ee348254700 x1847765451596032/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:32/0 lens 488/4536 e 0 to 0 dl 1762167012 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167001.834717:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348254700 with x1847765451596032 ext(167936->172031) 00002000:00010000:1.0:1762167001.834721:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348254700 00000100:00100000:1.0:1762167001.836154:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451596160 00000100:00100000:1.0:1762167001.836160:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451596160 00000100:00100000:1.0:1762167001.836202:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19355 00000100:00100000:1.0:1762167001.836211:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451596160:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167001.836227:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.836244:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d084c5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b29 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.836321:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d084cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.836336:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d084cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.836345:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d084cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167001.836370:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00000004:00200000:1.0:1762167001.836373:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167001.836387:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d084cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.836410:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d084c5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b29 expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.836440:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d084cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b29 expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.836448:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8a00) 00010000:00010000:1.0:1762167001.836451:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167001.836455:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7be00, rc 0) 00000100:00100000:1.0:1762167001.836497:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451596160:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 288us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.836503:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19355 00000100:00100000:1.0:1762167001.838405:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451596416 00000100:00100000:1.0:1762167001.838412:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451596416 00000100:00100000:1.0:1762167001.838470:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19356 00000100:00100000:1.0:1762167001.838479:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451596416:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167001.838572:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762167001.838596:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d084cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b29 expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.838618:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d084a9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b1b expref: 890 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.838628:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee36dcc8a00) 00010000:00010000:1.0:1762167001.838636:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167001.838944:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d084d3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.838956:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d084d3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.838964:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d084d3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167001.839021:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952408 00000004:00010000:1.0:1762167001.839047:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000093fa3479 reply state 00000000ad70ccdd transno 8589952409 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d084d3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167001.839056:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167001.839140:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451596416:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 658us (784us total) trans 8589952409 rc 0/0 00000100:00100000:1.0:1762167001.839149:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19356 00000020:00080000:1.0:1762167001.839155:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762167001.840054:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451596544 00000100:00100000:1.0:1762167001.840060:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451596544 00000100:00100000:1.0:1762167001.840097:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19357 00000100:00100000:1.0:1762167001.840112:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451596544:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167001.840128:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.840143:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d084da lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b30 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.840183:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d084da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b30 expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.840195:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d084da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b30 expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.840213:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167001.840217:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167001.840219:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00000100:00100000:1.0:1762167001.840264:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451596544:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 155us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.840271:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19357 00000100:00100000:3.0:1762167001.841193:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451596672 00000100:00100000:3.0:1762167001.841198:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451596672 00000100:00100000:3.0:1762167001.841233:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16183 00000100:00100000:3.0:1762167001.841242:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:56065:x1847765451596672:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.841252:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.841263:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b37 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.841286:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d083ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ace expref: 37 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.841292:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.841294:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.841297:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 37 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.841322:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d083ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ace expref: 37 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.841332:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d083ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ace expref: 37 pid: 6532 timeout: 722 lvb_type: 1 00000100:00100000:3.0:1762167001.841342:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dd54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454335872:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167001.841399:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.842479:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dd54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454335872:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.842503:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 37 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.842517:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f2d1400, rc 0) 00000100:00100000:3.0:1762167001.842574:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:56065:x1847765451596672:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1332us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.842623:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451596800 00000100:00100000:1.0:1762167001.842630:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451596800 00000100:00100000:3.0:1762167001.842636:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16183 00010000:00010000:1.0:1762167001.842660:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d083ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ace expref: 37 pid: 6532 timeout: 722 lvb_type: 1 00000100:00100000:1.0:1762167001.842699:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7216 00000100:00100000:1.0:1762167001.842707:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2361:x1847765451596800:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.842718:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.842738:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d083ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ace expref: 37 pid: 6532 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167001.842751:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d083ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ace expref: 37 pid: 6532 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167001.842797:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d083ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ace expref: 37 pid: 6532 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167001.842818:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.842820:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.842827:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 36 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.842840:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 36 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.842868:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 36 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.842878:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454336000:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167001.842933:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167001.844176:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454336000:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167001.844204:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.844259:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451596800:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1551us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.844271:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7216 00000100:00100000:3.0:1762167001.844302:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451596928 00000100:00100000:3.0:1762167001.844310:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451596928 00000100:00100000:3.0:1762167001.844370:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16184 00000100:00100000:3.0:1762167001.844382:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:56065:x1847765451596928:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.844398:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.844415:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d084e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b3e expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.844498:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d083a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ad5 expref: 20 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.844513:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.844514:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.844518:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d084e8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b3e expref: 20 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.844544:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d083a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ad5 expref: 20 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.844556:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d083a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ad5 expref: 20 pid: 33892 timeout: 722 lvb_type: 1 00000100:00100000:3.0:1762167001.844570:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dd54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454336128:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167001.844623:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.845577:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dd54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454336128:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.845599:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d084e8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b3e expref: 20 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.845613:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2431a1000, rc 0) 00000100:00100000:3.0:1762167001.845659:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee344e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56065:x1847765451596928:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1279us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.845666:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16184 00000100:00100000:1.0:1762167001.847844:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451597184 00000100:00100000:1.0:1762167001.847852:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451597184 00002000:00010000:1.0:1762167001.847898:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (46668->18446744073709551615) 00002000:00100000:1.0:1762167001.847903:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348257100 with x1847765451597184 ext(46668->18446744073709551615) 00002000:00010000:1.0:1762167001.847913:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348257100. 00000100:00100000:1.0:1762167001.847941:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2514 00000100:00100000:3.0:1762167001.847953:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2515 00000100:00100000:1.0:1762167001.847953:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451597184:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167001.847967:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2358:x1847765451597312:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167001.848167:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.848171:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167001 -> 1762167002 00002000:00010000:3.0:1762167001.848174:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.848176:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167001 -> 1762167002 00002000:00010000:3.0:1762167001.848178:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.848217:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2358:x1847765451597312:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 254us (365us total) trans 17179875486 rc 0/0 00000100:00100000:3.0:1762167001.848231:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2515 00002000:00010000:3.0:1762167001.848237:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167001.848242:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348256a00 with x1847765451597312 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167001.848250:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee348256a00. 00002000:00010000:1.0:1762167001.848434:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 252265 -> 46668 00002000:00010000:1.0:1762167001.848438:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167001 -> 1762167002 00002000:00010000:1.0:1762167001.848440:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.848442:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167001 -> 1762167002 00002000:00010000:1.0:1762167001.848444:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 301 -> 301 00000100:00100000:1.0:1762167001.848487:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451597184:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 536us (671us total) trans 21474842965 rc 0/0 00000100:00100000:1.0:1762167001.848495:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2514 00002000:00010000:1.0:1762167001.848499:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (46668->18446744073709551615) 00002000:00100000:1.0:1762167001.848502:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348257100 with x1847765451597184 ext(46668->18446744073709551615) 00002000:00010000:1.0:1762167001.848506:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348257100. 00000100:00100000:1.0:1762167001.850184:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451597568 00000100:00100000:1.0:1762167001.850190:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451597568 00000100:00100000:1.0:1762167001.850232:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19358 00000100:00100000:1.0:1762167001.850238:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451597568:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167001.850255:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.850273:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d084ef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b45 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.850375:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d084f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.850390:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d084f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.850401:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d084f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167001.850443:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 46668 00000004:00200000:1.0:1762167001.850448:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167001.850467:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d084f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.850491:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d084ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b45 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.850510:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d084f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b45 expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.850518:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167001.850520:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167001.850524:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b200, rc 0) 00000100:00100000:1.0:1762167001.850575:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451597568:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 336us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.850583:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19358 00000100:00100000:1.0:1762167001.852669:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451597824 00000100:00100000:1.0:1762167001.852681:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451597824 00000100:00100000:1.0:1762167001.852724:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19359 00000100:00100000:1.0:1762167001.852735:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451597824:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167001.852803:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.852824:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d084f6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b45 expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.852840:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167001.852845:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167001.853067:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.853080:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.853089:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167001.853140:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952410 00000004:00010000:1.0:1762167001.853164:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007b1c7c3c reply state 000000009684c18e transno 8589952411 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167001.853172:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167001.853253:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451597824:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 519us (633us total) trans 8589952411 rc 0/0 00000100:00100000:1.0:1762167001.853260:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19359 00000020:00080000:1.0:1762167001.853265:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167001.854135:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.854149:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.854155:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.854161:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.854165:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.854172:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.854184:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:3.0:1762167001.854187:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167001.854191:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.854198:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d084fd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167001.854663:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451597952 00000100:00100000:1.0:1762167001.854669:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451597952 00002000:00010000:1.0:1762167001.854695:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (61549->18446744073709551615) 00002000:00100000:1.0:1762167001.854699:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348254380 with x1847765451597952 ext(61549->18446744073709551615) 00002000:00010000:1.0:1762167001.854706:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348254380. 00000100:00100000:1.0:1762167001.854729:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451598080 00000100:00100000:1.0:1762167001.854732:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451598080 00002000:00010000:1.0:1762167001.854746:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167001.854751:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354c000 with x1847765451598080 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167001.854757:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24354c000. 00000100:00100000:1.0:1762167001.854805:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2517 00000100:00100000:1.0:1762167001.854817:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451597952:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167001.855089:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 46668 -> 61549 00002000:00010000:1.0:1762167001.855094:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167001.855101:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.855114:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167001.855121:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 301 -> 301 00000100:00100000:1.0:1762167001.855157:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451597952:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 341us (549us total) trans 21474842966 rc 0/0 00000100:00100000:1.0:1762167001.855188:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2517 00002000:00010000:1.0:1762167001.855195:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (61549->18446744073709551615) 00002000:00100000:1.0:1762167001.855198:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348254380 with x1847765451597952 ext(61549->18446744073709551615) 00002000:00010000:1.0:1762167001.855204:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348254380. 00000100:00100000:1.0:1762167001.861866:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.865334:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451598592 00000100:00100000:3.0:1762167001.865344:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451598592 00000100:00100000:3.0:1762167001.865406:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16185 00000100:00100000:3.0:1762167001.865431:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765451598592:12345-192.168.203.35@tcp:16:fsx.0 00000100:00100000:1.0:1762167001.883098:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.883155:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451598720 00000100:00100000:3.0:1762167001.883165:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451598720 00000100:00100000:3.0:1762167001.883221:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19360 00000100:00100000:3.0:1762167001.883232:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451598720:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.883255:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.883276:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d08504 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b4c expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.883369:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0850b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.883384:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0850b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.883397:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0850b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167001.883436:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 61549 00000004:00200000:3.0:1762167001.883441:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167001.883458:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0850b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.883482:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d08504 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b4c expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.883501:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0850b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b4c expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.883510:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:3.0:1762167001.883514:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167001.883517:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372abbe00, rc 0) 00000100:00100000:3.0:1762167001.883585:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451598720:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 355us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.883593:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19360 00000100:00100000:3.0:1762167001.889540:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.889658:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451598976 00000100:00100000:1.0:1762167001.889670:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451598976 00000100:00100000:1.0:1762167001.889735:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19361 00000100:00100000:1.0:1762167001.889744:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dd54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451598976:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167001.889813:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.889850:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0850b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b4c expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.889869:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167001.889875:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167001.890101:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08512 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.890115:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08512 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.890124:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08512 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167001.890172:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952412 00000004:00010000:1.0:1762167001.890195:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000075e37964 reply state 00000000a67fec0c transno 8589952413 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08512 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167001.890204:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167001.890297:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dd54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451598976:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 553us (766us total) trans 8589952413 rc 0/0 00000100:00100000:1.0:1762167001.890304:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19361 00000020:00080000:1.0:1762167001.890309:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762167001.891588:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.891620:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.891702:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.891854:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2522 00000100:00100000:3.0:1762167001.891870:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dd55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451599104:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167001.891905:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2524 00000100:00100000:1.0:1762167001.891919:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451599360:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167001.892180:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.892185:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167001.892188:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.892191:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 61549 -> 160845 00002000:00010000:1.0:1762167001.892194:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167001.892197:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167001.892201:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167001.892206:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.892210:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167001.892214:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 301 -> 121 00000100:00100000:1.0:1762167001.892235:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451599360:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 317us (530us total) trans 21474842969 rc 0/0 00000100:00100000:1.0:1762167001.892249:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2524 00000100:00100000:3.0:1762167001.892251:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dd55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451599104:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 383us (661us total) trans 21474842970 rc 0/0 00002000:00010000:1.0:1762167001.892254:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167001.892260:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dd56300 with x1847765451599360 ext(0->18446744073709551615) 00000100:00100000:3.0:1762167001.892264:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2522 00002000:00010000:1.0:1762167001.892268:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dd56300. 00002000:00010000:3.0:1762167001.892270:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (160845->18446744073709551615) 00002000:00100000:3.0:1762167001.892275:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dd55500 with x1847765451599104 ext(160845->18446744073709551615) 00002000:00010000:3.0:1762167001.892282:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dd55500. 00000100:00100000:3.0:1762167001.899026:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.917706:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451599872 00000100:00100000:1.0:1762167001.917716:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451599872 00000100:00100000:1.0:1762167001.917801:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19362 00000100:00100000:1.0:1762167001.917812:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451599872:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167001.917837:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.917861:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08519 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b53 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.917946:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08520 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.917961:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.917971:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167001.917999:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 160845 00000004:00200000:1.0:1762167001.918003:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167001.918021:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08520 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.918045:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08519 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b53 expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.918063:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08520 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b53 expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.918071:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167001.918074:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167001.918077:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a800, rc 0) 00000100:00100000:1.0:1762167001.918139:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee344e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451599872:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 329us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.918147:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19362 00000100:00100000:3.0:1762167001.921689:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.921897:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451600128 00000100:00100000:1.0:1762167001.921906:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451600128 00000100:00100000:1.0:1762167001.921956:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19363 00000100:00100000:1.0:1762167001.921965:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451600128:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167001.922014:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.922042:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08520 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b53 expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.922063:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167001.922067:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167001.922292:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.922305:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.922315:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167001.922368:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952414 00000004:00010000:1.0:1762167001.922392:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e309cd48 reply state 000000004ea48d2d transno 8589952415 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167001.922401:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167001.922514:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451600128:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 549us (835us total) trans 8589952415 rc 0/0 00000100:00100000:1.0:1762167001.922521:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19363 00000020:00080000:1.0:1762167001.922527:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167001.923669:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.923682:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.923689:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.923695:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.923699:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.923707:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.923720:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:3.0:1762167001.923723:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167001.923726:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.923732:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08527 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167001.924668:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.924751:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.924812:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.924886:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451600384 00000100:00100000:3.0:1762167001.924894:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451600384 00002000:00010000:3.0:1762167001.924919:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167001.924926:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dd57480 with x1847765451600384 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167001.924935:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dd57480. 00000100:00100000:3.0:1762167001.924964:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2529 00000100:00100000:3.0:1762167001.924975:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dd57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765451600384:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167001.925199:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.925204:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167001.925206:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.925209:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167001.925212:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.925372:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dd57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765451600384:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 394us (554us total) trans 17179875489 rc 0/0 00000100:00100000:3.0:1762167001.925624:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2529 00002000:00010000:3.0:1762167001.925630:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167001.925636:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dd57480 with x1847765451600384 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167001.925644:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dd57480. 00000100:00100000:3.0:1762167001.927390:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451600640 00000100:00100000:3.0:1762167001.927398:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451600640 00000100:00100000:3.0:1762167001.927468:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19364 00000100:00100000:3.0:1762167001.927478:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451600640:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.927500:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.927518:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0852e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b5a expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.927596:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08535 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.927610:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08535 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.927621:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08535 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167001.927647:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 188904 00000004:00200000:3.0:1762167001.927651:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167001.927667:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08535 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167001.927691:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0852e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b5a expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.927707:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08535 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b5a expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.927717:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:3.0:1762167001.927720:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167001.927723:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3a00, rc 0) 00000100:00100000:3.0:1762167001.927820:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee344e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451600640:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 343us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.927828:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19364 00000100:00100000:1.0:1762167001.930979:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.931118:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451600896 00000100:00100000:3.0:1762167001.931129:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451600896 00000100:00100000:3.0:1762167001.931193:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19365 00000100:00100000:3.0:1762167001.931204:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451600896:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:3.0:1762167001.931262:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167001.931291:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08535 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b5a expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.931311:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:3.0:1762167001.931316:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167001.931561:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0853c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.931575:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0853c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.931585:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0853c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762167001.931637:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952416 00000004:00010000:3.0:1762167001.931661:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002e31c57e reply state 00000000c81b28b0 transno 8589952417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0853c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167001.931670:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167001.931801:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56065:x1847765451600896:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 598us (835us total) trans 8589952417 rc 0/0 00000100:00100000:3.0:1762167001.931809:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19365 00000020:00080000:3.0:1762167001.931815:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762167001.933610:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.933671:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.933704:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451601024 00000100:00100000:3.0:1762167001.933715:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451601024 00002000:00010000:3.0:1762167001.933809:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (167513->18446744073709551615) 00000100:00100000:1.0:1762167001.933811:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00100000:3.0:1762167001.933817:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c2a00 with x1847765451601024 ext(167513->18446744073709551615) 00002000:00010000:3.0:1762167001.933827:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f8c2a00. 00000100:00100000:1.0:1762167001.933871:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2530 00000100:00100000:3.0:1762167001.933882:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2531 00000100:00100000:1.0:1762167001.933884:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451601280:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167001.933896:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451601024:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167001.934127:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.934131:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167001.934134:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.934137:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167001.934140:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167001.934191:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 188904 -> 167513 00002000:00010000:3.0:1762167001.934196:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167001.934199:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.934205:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00000100:00100000:1.0:1762167001.934205:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451601280:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 321us (529us total) trans 21474842974 rc 0/0 00002000:00010000:3.0:1762167001.934210:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00000100:00100000:1.0:1762167001.934220:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2530 00002000:00010000:1.0:1762167001.934225:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167001.934228:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c1880 with x1847765451601280 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167001.934233:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f8c1880. 00000100:00100000:3.0:1762167001.934257:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451601024:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 364us (648us total) trans 21474842975 rc 0/0 00000100:00100000:3.0:1762167001.934267:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2531 00002000:00010000:3.0:1762167001.934271:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (167513->18446744073709551615) 00002000:00100000:3.0:1762167001.934273:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c2a00 with x1847765451601024 ext(167513->18446744073709551615) 00002000:00010000:3.0:1762167001.934278:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f8c2a00. 00000100:00100000:3.0:1762167001.936735:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451601408 00000100:00100000:3.0:1762167001.936745:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451601408 00000100:00100000:3.0:1762167001.936828:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19366 00000100:00100000:3.0:1762167001.936838:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56065:x1847765451601408:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167001.936860:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.936879:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08543 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b61 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.936970:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0854a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.936984:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0854a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.936996:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0854a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167001.937023:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00000004:00200000:3.0:1762167001.937027:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167001.937046:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0854a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.937071:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08543 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b61 expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.937097:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0854a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b61 expref: 901 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.937106:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:3.0:1762167001.937109:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167001.937113:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3e00, rc 0) 00000100:00100000:3.0:1762167001.937177:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee344e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56065:x1847765451601408:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 340us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.937184:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19366 00000100:00100000:1.0:1762167001.940019:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451601664 00000100:00100000:1.0:1762167001.940028:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451601664 00000100:00100000:1.0:1762167001.940102:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7191 00000100:00100000:1.0:1762167001.940113:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56065:x1847765451601664:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167001.940547:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56065:x1847765451601664:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 433us (597us total) trans 8589952418 rc 0/0 00000100:00100000:1.0:1762167001.940557:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7191 00000100:00100000:1.0:1762167001.950662:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.950732:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451601792 00000100:00100000:3.0:1762167001.950743:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451601792 00000100:00100000:3.0:1762167001.950847:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19367 00000100:00100000:3.0:1762167001.950858:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56164:x1847765451601792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.950883:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.950905:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08551 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b68 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.950996:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08558 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951015:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08558 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951027:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08558 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951043:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0855f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951050:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0855f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951057:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0855f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951179:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08566 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951188:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08566 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951195:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08566 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167001.951231:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00000004:00200000:3.0:1762167001.951236:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167001.951253:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08566 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951265:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08566 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951275:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08558 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951281:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08558 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951288:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08558 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951298:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.951302:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08558 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951309:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08558 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951320:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167001.951324:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167001.951329:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08558 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951335:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08558 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951348:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0855f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951354:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0855f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951360:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0855f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951365:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167001.951368:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0855f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951374:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0855f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951381:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167001.951384:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167001.951387:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0855f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951392:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0855f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.951440:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08551 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b68 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.951454:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08566 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b68 expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.951462:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:3.0:1762167001.951465:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167001.951468:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2200, rc 0) 00000100:00100000:3.0:1762167001.951529:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56164:x1847765451601792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 673us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.951537:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19367 00000100:00100000:3.0:1762167001.954028:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451602048 00000100:00100000:3.0:1762167001.954038:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451602048 00000100:00100000:3.0:1762167001.954152:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19368 00000100:00100000:3.0:1762167001.954163:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56164:x1847765451602048:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:1.0:1762167001.954176:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167001.954183:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.954204:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0856d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b6f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.954352:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d08574 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.954385:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0854a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b61 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.954394:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d08574 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167001.954491:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0854a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b61 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.954505:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0854a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b61 expref: 904 pid: 30817 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.954520:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dd56680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454336384:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167001.954577:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167001.955938:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dd56680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454336384:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.955958:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d08574 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167001.958704:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451602432 00000100:00100000:1.0:1762167001.958712:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451602432 00000100:00100000:1.0:1762167001.958801:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19369 00000100:00100000:1.0:1762167001.958811:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56164:x1847765451602432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167001.958831:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.958846:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08582 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b76 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.958916:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08589 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.958930:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d08574 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b6f expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.958942:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08589 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.958971:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d08574 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b6f expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.958982:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d08574 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b6f expref: 904 pid: 30817 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.959002:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454336512:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167001.959073:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167001.960381:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454336512:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.960480:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08589 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.961234:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08589 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.961255:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08589 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167001.961295:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00000004:00200000:1.0:1762167001.961301:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167001.961319:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08589 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.961351:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08582 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b76 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.961373:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08589 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b76 expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.961382:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167001.961385:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167001.961388:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ae00, rc 0) 00000100:00100000:1.0:1762167001.961439:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee344e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56164:x1847765451602432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2629us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.961447:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19369 00000100:00100000:1.0:1762167001.963232:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451602816 00000100:00100000:1.0:1762167001.963241:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451602816 00000100:00100000:1.0:1762167001.963297:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19370 00000100:00100000:1.0:1762167001.963308:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56164:x1847765451602816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167001.963332:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167001.963350:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08590 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b7d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.963450:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08597 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.963465:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08597 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.963475:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08597 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167001.963487:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00010000:00010000:1.0:1762167001.963622:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08590 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b7d expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.963643:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08597 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b7d expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.963651:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167001.963655:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167001.963658:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7aa00, rc 0) 00000100:00100000:1.0:1762167001.963724:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee344e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56164:x1847765451602816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 418us (549us total) trans 8589952420 rc 0/0 00000100:00100000:1.0:1762167001.963735:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19370 00000100:00100000:3.0:1762167001.965753:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.965832:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167001.965853:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.965900:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451603200 00000100:00100000:1.0:1762167001.965906:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451603200 00000100:00100000:1.0:1762167001.965973:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16187 00000100:00100000:1.0:1762167001.965985:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451602944:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167001.966029:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.966048:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d084be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->172031) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b22 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.966062:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1762167001.966066:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16189 00010000:00010000:1.0:1762167001.966073:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167001.966078:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.966085:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dd55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2358:x1847765451603072:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167001.966113:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d085b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.966125:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d084be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->172031) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b22 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.966135:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 41 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.966156:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167001.966160:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167001.966163:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d085b3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.966169:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d084be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->172031) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b22 expref: 21 pid: 6533 timeout: 722 lvb_type: 0 00010000:00010000:3.0:1762167001.966201:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 41 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.966201:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454336640:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167001.966235:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 41 pid: 6533 timeout: 722 lvb_type: 0 00000100:00100000:3.0:1762167001.966247:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dd57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454336896:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167001.966318:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167001.966366:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167001.967735:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454336640:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167001.967796:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.968067:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451603456 00000100:00100000:1.0:1762167001.968072:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451603456 00010000:00010000:1.0:1762167001.968098:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d084e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b3e expref: 22 pid: 6533 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167001.968142:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7220 00000100:00100000:1.0:1762167001.968159:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee344e45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:2359:x1847765451603328:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167001.968180:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167001.968202:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 42 pid: 6533 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.968229:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 42 pid: 6533 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.968250:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d084e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b37 expref: 42 pid: 6533 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167001.968276:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.968281:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167001.968292:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d085b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.968326:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d085b3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.968366:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167001.968415:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee344e45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2359:x1847765451603328:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 261us (421us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167001.968436:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d085ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.968447:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7220 00010000:00010000:3.0:1762167001.968455:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d085ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.968478:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d085ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.968486:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.968487:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d085ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.968512:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.968513:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d085ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.968531:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167001.968539:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d085ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.968547:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d085ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.968549:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.968564:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d085ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.968577:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167001.968579:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d085ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.968601:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.968630:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc1709320) 00000100:00100000:3.0:1762167001.968632:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dd57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451603200:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2569us (2799us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167001.968639:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167001.968643:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16188 00010000:00010000:1.0:1762167001.968665:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.968696:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.968705:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d085a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167001.968754:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451602944:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2771us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167001.968787:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16187 00000100:00100000:3.0:1762167001.970066:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.970117:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451603840 00000100:00100000:1.0:1762167001.970123:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451603840 00000100:00100000:1.0:1762167001.970173:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19371 00000100:00100000:1.0:1762167001.970183:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dd56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56164:x1847765451603840:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167001.970242:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762167001.970267:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08589 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b76 expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.970286:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d084da lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b30 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167001.970301:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167001.970305:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167001.970346:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d085ba lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.970358:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d085ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167001.970367:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d085ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167001.983866:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952421 is committed 00000004:00080000:1.0:1762167001.983880:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3393 committed 00000004:00080000:1.0:1762167001.983895:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3380 committed 00000004:00080000:1.0:1762167001.983906:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3392 committed 00000004:00080000:1.0:1762167001.983910:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3379 committed 00000004:00080000:1.0:1762167001.983919:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3378 committed 00000004:00080000:1.0:1762167001.983924:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3391 committed 00000004:00080000:1.0:1762167001.983928:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3377 committed 00000004:00080000:1.0:1762167001.983932:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3390 committed 00000004:00080000:1.0:1762167001.983934:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3376 committed 00000004:00080000:1.0:1762167001.983937:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3389 committed 00000004:00080000:1.0:1762167001.983939:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3375 committed 00000004:00080000:1.0:1762167001.983941:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3388 committed 00000004:00080000:1.0:1762167001.983944:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3387 committed 00000004:00080000:1.0:1762167001.983947:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3374 committed 00000020:00080000:1.0:1762167001.984002:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969169 batchid updated 00000100:00100000:3.0:1762167001.984135:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454337152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.984189:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167001.984209:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454337280 00000100:00100000:1.0:1762167001.984216:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454337280 00000100:00100000:3.0:1762167001.984219:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454337664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167001.984270:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167001.984271:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454337152 00000100:00100000:1.0:1762167001.984276:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454337152 00000100:00100000:3.0:1762167001.984300:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454338176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167001.984307:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454337792 00000100:00100000:1.0:1762167001.984313:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454337792 00000100:00100000:1.0:1762167001.984344:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454337664 00000100:00100000:1.0:1762167001.984349:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454337664 00000100:00100000:3.0:1762167001.984351:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454338304 00000100:00100000:3.0:1762167001.984358:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454338304 00000100:00100000:1.0:1762167001.984392:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16191 00000100:00100000:3.0:1762167001.984401:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16192 00000100:00100000:1.0:1762167001.984407:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3294:x1847765454337152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.984414:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3295:x1847765454337792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167001.984646:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167001.984652:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3295:x1847765454337792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (410us total) trans 17179875491 rc 0/0 00002000:00010000:1.0:1762167001.984653:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167001.984660:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167001.984667:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167001.984674:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.984677:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16192 00000100:00100000:3.0:1762167001.984697:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454337408 00000100:00100000:3.0:1762167001.984702:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454337408 00000100:00100000:1.0:1762167001.984718:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3294:x1847765454337152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 314us (529us total) trans 17179875493 rc 0/0 00000100:00100000:1.0:1762167001.984728:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16191 00000100:00100000:3.0:1762167001.984737:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16193 00000100:00100000:3.0:1762167001.984749:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765454337664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167001.984754:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16194 00000100:00100000:1.0:1762167001.984792:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3295:x1847765454338304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167001.984905:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 137054 -> 137054 00002000:00010000:1.0:1762167001.984909:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.984912:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167001.984915:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.984917:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167001.984952:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3295:x1847765454338304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (641us total) trans 17179875494 rc 0/0 00000100:00100000:1.0:1762167001.984959:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16194 00000100:00100000:1.0:1762167001.984978:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16197 00000100:00100000:1.0:1762167001.984988:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454338432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167001.985035:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167001.985040:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.985043:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167001.985046:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167001.985048:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167001.985097:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454337664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 350us (826us total) trans 21474842978 rc 0/0 00002000:00010000:1.0:1762167001.985115:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 252265 -> 252265 00000100:00100000:3.0:1762167001.985117:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16193 00002000:00010000:1.0:1762167001.985122:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.985126:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.985129:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.985133:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167001.985144:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16198 00000100:00100000:3.0:1762167001.985155:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454337024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167001.985178:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454338432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (659us total) trans 21474842979 rc 0/0 00000100:00100000:1.0:1762167001.985192:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16197 00000100:00100000:1.0:1762167001.985211:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454338048 00000100:00100000:1.0:1762167001.985216:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454338048 00000100:00100000:1.0:1762167001.985239:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454338560 00000100:00100000:1.0:1762167001.985244:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454338560 00000100:00100000:1.0:1762167001.985278:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16201 00000100:00100000:1.0:1762167001.985293:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3293:x1847765454338560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167001.985311:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454337024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 157us (249us total) trans 21474842980 rc 0/0 00000100:00100000:3.0:1762167001.985319:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16198 00000100:00100000:3.0:1762167001.985365:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842963 gen 2 00000004:00080000:3.0:1762167001.985371:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de00a80, transno 21474842951 00000004:00080000:3.0:1762167001.985382:0:3293:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474842955 committed transno 21474842963 00000004:00080000:3.0:1762167001.985404:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258a80, transno 21474842956 00000004:00080000:3.0:1762167001.985412:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259500, transno 21474842957 00000004:00080000:3.0:1762167001.985429:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825a300, transno 21474842958 00000004:00080000:3.0:1762167001.985435:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258380, transno 21474842959 00000004:00080000:3.0:1762167001.985441:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825bb80, transno 21474842960 00000004:00080000:3.0:1762167001.985446:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259c00, transno 21474842961 00000004:00080000:3.0:1762167001.985451:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258000, transno 21474842962 00000004:00080000:3.0:1762167001.985456:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258e00, transno 21474842963 00002000:00010000:1.0:1762167001.985457:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.985464:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00000100:00100000:3.0:1762167001.985467:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee344e44700 x1847765454337024/t21474842980(21474842980) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167017 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00010000:1.0:1762167001.985472:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:1.0:1762167001.985480:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.985488:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167001.985524:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3293:x1847765454338560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 234us (293us total) trans 17179875496 rc 0/0 00000100:00100000:1.0:1762167001.985536:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16201 00000004:00080000:3.0:1762167001.985609:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee344e44700/2, rc 0, transno 21474842980 00000100:00100000:3.0:1762167001.985615:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee344e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454337024:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167001.985637:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee344e45880/2, rc 0, transno 21474842981 00000100:00100000:3.0:1762167001.985645:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee344e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454337536:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167001.985662:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e470a80/2, rc 0, transno 17179875495 00000100:00100000:3.0:1762167001.985670:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454338048:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167001.985687:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc59500/2, rc 0, transno 17179875496 00000100:00100000:3.0:1762167001.985694:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454338560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167001.985853:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454338176 00000100:00100000:1.0:1762167001.985859:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454338176 00000100:00100000:1.0:1762167001.985894:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454338688 00000100:00100000:1.0:1762167001.985899:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454338688 00000004:00080000:3.0:1762167001.985919:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 7 in progress, 2 in flight, 9 done 00000100:00100000:1.0:1762167001.985942:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16203 00000100:00100000:1.0:1762167001.985955:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3294:x1847765454338688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167001.986093:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167001.986097:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.986099:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.986102:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167001.986105:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167001.986147:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3294:x1847765454338688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (294us total) trans 17179875497 rc 0/0 00000100:00100000:1.0:1762167001.986159:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16203 00000100:00100000:3.0:1762167001.986288:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167001.990334:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451604224 00000100:00100000:1.0:1762167001.990344:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451604224 00000100:00100000:3.0:1762167001.990386:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451604480 00000100:00100000:3.0:1762167001.990393:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451604480 00000100:00100000:1.0:1762167001.990403:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451604352 00000100:00100000:1.0:1762167001.990409:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451604352 00000100:00100000:3.0:1762167001.990455:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16206 00000100:00100000:3.0:1762167001.990470:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765451604352:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167001.990482:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167001.990498:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d085e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2b99 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167001.990517:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888da, atime: 0x690888d9, ctime: 0x690888da, blocks: 0x3 00010000:00010000:3.0:1762167001.990531:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.990537:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167001.990546:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d085e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b99 expref: 41 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.990583:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d085e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b99 expref: 41 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167001.990614:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3c00, rc 0) 00000100:00100000:3.0:1762167001.990675:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2361:x1847765451604352:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 205us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167001.990694:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16206 00000100:00100000:3.0:1762167002.018434:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.044994:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:3.0:1762167002.066154:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x812:0x0] updating lvb size from disk: 137054 -> 167936 00002000:00010000:3.0:1762167002.066160:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x812:0x0] updating lvb mtime from disk: 1762167001 -> 1762167002 00002000:00010000:3.0:1762167002.066162:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x812:0x0] updating lvb ctime from disk: 1762167001 -> 1762167002 00010000:00010000:3.0:1762167002.066174:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d085f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.066185:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d085f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.066194:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d085f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.066201:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167002.066205:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d085f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.066219:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d085f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.066248:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d085f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.066255:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d085f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.066355:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451604864:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 21119us (21367us total) trans 17179875499 rc 0/0 00000100:00100000:3.0:1762167002.066365:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2535 00000100:00100000:3.0:1762167002.068856:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451604992 00000100:00100000:3.0:1762167002.068868:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451604992 00000100:00100000:3.0:1762167002.068955:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2536 00000100:00100000:3.0:1762167002.068966:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451604992:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762167002.069004:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08600 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.069021:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08050 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29a1 expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167002.069028:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.069030:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.069034:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08600 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.069073:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29a1 expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167002.069087:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08050 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb29a1 expref: 22 pid: 6533 timeout: 722 lvb_type: 1 00000100:00100000:3.0:1762167002.069104:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454338816:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167002.069185:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167002.070815:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454338816:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167002.070848:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08600 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.071367:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.071378:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167002.087511:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875500 is committed 00000001:00080000:1.0:1762167002.105951:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842983 is committed 00000001:00080000:1.0:1762167002.105976:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842981 is committed 00000001:00080000:1.0:1762167002.106000:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842982 is committed 00010000:00010000:3.0:1762167002.110799:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0860e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.110814:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0860e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167002.122733:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842984 is committed 00000100:00100000:1.0:1762167002.134720:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451606144 00000100:00100000:1.0:1762167002.134727:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451606144 00002000:00010000:1.0:1762167002.134749:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2061 (0->18446744073709551615) 00002000:00100000:1.0:1762167002.134754:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381bb4000 with x1847765451606144 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167002.134780:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381bb4000. 00000100:00100000:1.0:1762167002.134808:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2540 00000100:00100000:1.0:1762167002.134822:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451606144:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167002.135175:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167002.135180:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb mtime from disk: 1762167001 -> 1762167002 00002000:00010000:1.0:1762167002.135183:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:1.0:1762167002.135186:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb ctime from disk: 1762167001 -> 1762167002 00002000:00010000:1.0:1762167002.135188:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167002.135250:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451606144:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 427us (591us total) trans 21474842985 rc 0/0 00000100:00100000:1.0:1762167002.135267:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2540 00002000:00010000:1.0:1762167002.135272:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2061 (0->18446744073709551615) 00002000:00100000:1.0:1762167002.135277:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381bb4000 with x1847765451606144 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167002.135284:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381bb4000. 00000100:00100000:1.0:1762167002.138702:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451606528 00000100:00100000:1.0:1762167002.138711:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451606528 00000100:00100000:1.0:1762167002.138786:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19376 00000100:00100000:1.0:1762167002.138796:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56164:x1847765451606528:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167002.138841:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.138866:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0862a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bae expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.138884:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167002.138889:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.139075:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08631 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.139086:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08631 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.139093:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08631 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:1.0:1762167002.139140:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952424 00000004:00010000:1.0:1762167002.139164:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000052ea0c8f reply state 00000000243c1db1 transno 8589952425 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08631 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167002.139172:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167002.139248:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56164:x1847765451606528:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 454us (618us total) trans 8589952425 rc 0/0 00000100:00100000:1.0:1762167002.139256:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19376 00000020:00080000:1.0:1762167002.139261:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762167002.141578:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.141650:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.143384:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451607040 00000100:00100000:1.0:1762167002.143393:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451607040 00000100:00100000:1.0:1762167002.143456:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19377 00000100:00100000:1.0:1762167002.143466:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56164:x1847765451607040:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.143484:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.143501:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0863f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2bbc expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.143579:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08646 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.143595:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08646 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.143605:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08646 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.143631:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00000004:00200000:1.0:1762167002.143635:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167002.143657:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08646 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.143687:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0863f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bbc expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.143704:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08646 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bbc expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.143712:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167002.143716:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167002.143719:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a200, rc 0) 00000100:00100000:1.0:1762167002.143791:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56164:x1847765451607040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 326us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.143800:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19377 00000100:00100000:3.0:1762167002.145234:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.145283:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451607296 00000100:00100000:1.0:1762167002.145290:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451607296 00000100:00100000:1.0:1762167002.145333:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19378 00000100:00100000:1.0:1762167002.145342:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56164:x1847765451607296:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167002.145381:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.145401:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08646 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bbc expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.145431:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167002.145435:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.145630:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0864d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.145643:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0864d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.145656:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0864d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:1.0:1762167002.145710:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952426 00000004:00010000:1.0:1762167002.145734:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005e1273e2 reply state 000000009684c18e transno 8589952427 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0864d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167002.145742:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167002.145851:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56164:x1847765451607296:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 509us (620us total) trans 8589952427 rc 0/0 00000100:00100000:1.0:1762167002.145863:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19378 00000020:00080000:1.0:1762167002.145868:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762167002.146944:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.148292:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451607552 00000100:00100000:1.0:1762167002.148309:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451607552 00002000:00010000:1.0:1762167002.148386:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (167513->18446744073709551615) 00002000:00100000:1.0:1762167002.148394:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381bb6a00 with x1847765451607552 ext(167513->18446744073709551615) 00002000:00010000:1.0:1762167002.148408:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381bb6a00. 00000100:00100000:3.0:1762167002.148466:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2544 00000100:00100000:3.0:1762167002.148490:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451607552:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167002.148744:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 167936 -> 167513 00002000:00010000:3.0:1762167002.148749:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.148754:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167002.148758:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.148802:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167002.148848:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451607552:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 369us (627us total) trans 17179875503 rc 0/0 00000100:00100000:3.0:1762167002.148865:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2544 00002000:00010000:3.0:1762167002.148872:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (167513->18446744073709551615) 00002000:00100000:3.0:1762167002.148876:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381bb6a00 with x1847765451607552 ext(167513->18446744073709551615) 00002000:00010000:3.0:1762167002.148884:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381bb6a00. 00000100:00100000:1.0:1762167002.150368:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451607808 00000100:00100000:1.0:1762167002.150381:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451607808 00000100:00100000:1.0:1762167002.150463:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19379 00000100:00100000:1.0:1762167002.150477:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56164:x1847765451607808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.150504:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.150528:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0865b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2bca expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.150633:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08662 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.150651:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08662 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.150664:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08662 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.150696:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00000004:00200000:1.0:1762167002.150702:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167002.150721:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08662 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.150750:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0865b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bca expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.150810:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08662 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bca expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.150821:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167002.150824:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167002.150828:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a600, rc 0) 00000100:00100000:1.0:1762167002.150891:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56164:x1847765451607808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 417us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.150899:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19379 00000100:00100000:1.0:1762167002.153524:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.155274:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.157048:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451608320 00000100:00100000:3.0:1762167002.157057:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451608320 00002000:00010000:3.0:1762167002.157090:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2066 (167513->18446744073709551615) 00002000:00100000:3.0:1762167002.157100:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381bb4700 with x1847765451608320 ext(167513->18446744073709551615) 00002000:00010000:3.0:1762167002.157111:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381bb4700. 00000100:00100000:3.0:1762167002.157142:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2545 00000100:00100000:3.0:1762167002.157158:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451608320:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167002.157492:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb size from disk: 167936 -> 167513 00002000:00010000:3.0:1762167002.157497:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.157500:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:3.0:1762167002.157502:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.157505:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167002.157542:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451608320:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 389us (554us total) trans 21474842988 rc 0/0 00000100:00100000:3.0:1762167002.157567:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2545 00002000:00010000:3.0:1762167002.157573:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2066 (167513->18446744073709551615) 00002000:00100000:3.0:1762167002.157579:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381bb4700 with x1847765451608320 ext(167513->18446744073709551615) 00002000:00010000:3.0:1762167002.157586:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381bb4700. 00000100:00100000:1.0:1762167002.159119:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451608576 00000100:00100000:1.0:1762167002.159126:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451608576 00000100:00100000:1.0:1762167002.159175:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19381 00000100:00100000:1.0:1762167002.159182:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56164:x1847765451608576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.159206:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.159220:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08677 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2bd8 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.159306:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0867e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.159318:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0867e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.159326:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0867e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.159369:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00000004:00200000:1.0:1762167002.159372:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167002.159384:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0867e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.159410:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08677 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bd8 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.159450:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0867e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bd8 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.159459:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167002.159462:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167002.159465:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ba00, rc 0) 00000100:00100000:1.0:1762167002.159563:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56164:x1847765451608576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 380us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.159602:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19381 00000100:00100000:1.0:1762167002.161551:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.163892:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.169364:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451609216 00000100:00100000:3.0:1762167002.169372:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451609216 00010000:00010000:3.0:1762167002.169397:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d08494 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b14 expref: 30 pid: 6533 timeout: 722 lvb_type: 1 00000100:00100000:1.0:1762167002.169455:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7226 00000100:00100000:1.0:1762167002.169476:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451609216:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.169489:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.169513:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d08494 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b14 expref: 30 pid: 6533 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.169536:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d08494 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b14 expref: 29 pid: 6533 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.169553:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d08494 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b14 expref: 29 pid: 6533 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.169566:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.169568:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.169574:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d08693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2be6 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.169589:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d08693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2be6 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.169637:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d08693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2be6 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.169652:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765454339328:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167002.169715:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.171104:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765454339328:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167002.171124:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.171182:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451609216:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1712us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.171194:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7226 00000100:00100000:3.0:1762167002.171440:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.171480:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.171647:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2548 00000100:00100000:1.0:1762167002.171661:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451609600:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167002.172022:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167002.172027:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167001 -> 1762167002 00002000:00010000:1.0:1762167002.172030:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167002.172032:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167001 -> 1762167002 00002000:00010000:1.0:1762167002.172035:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167002.172066:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451609600:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 407us (582us total) trans 17179875505 rc 0/0 00000100:00100000:1.0:1762167002.172081:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2548 00002000:00010000:1.0:1762167002.172085:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:1.0:1762167002.172091:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348258000 with x1847765451609600 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167002.172097:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee348258000. 00000100:00100000:1.0:1762167002.173475:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451609856 00000100:00100000:1.0:1762167002.173483:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451609856 00000100:00100000:1.0:1762167002.173531:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19383 00000100:00100000:1.0:1762167002.173548:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56164:x1847765451609856:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167002.173639:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0869a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.173655:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0869a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.173667:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0869a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:1.0:1762167002.173813:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e60709e0 reply state 00000000a67fec0c transno 8589952432 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0869a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167002.173822:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167002.173900:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56164:x1847765451609856:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 360us (495us total) trans 8589952432 rc 0/0 00000100:00100000:1.0:1762167002.173907:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19383 00000100:00100000:1.0:1762167002.175404:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451609984 00000100:00100000:1.0:1762167002.175412:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451609984 00000100:00100000:1.0:1762167002.175468:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16213 00000100:00100000:1.0:1762167002.175477:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56164:x1847765451609984:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.175491:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.175508:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d086a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2bed expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.175535:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d085d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b92 expref: 23 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.175543:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.175545:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.175549:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d086a1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bed expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.175586:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d085d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b92 expref: 23 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.175610:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d085d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b92 expref: 23 pid: 6532 timeout: 722 lvb_type: 1 00000100:00100000:1.0:1762167002.175625:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454339456:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.175702:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.176902:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454339456:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.176929:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d086a1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bed expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.176950:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7bc00, rc 0) 00000100:00100000:1.0:1762167002.177004:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56164:x1847765451609984:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1527us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.177012:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16213 00000100:00100000:1.0:1762167002.178066:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451610112 00000100:00100000:1.0:1762167002.178073:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451610112 00010000:00010000:1.0:1762167002.178099:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d085d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b92 expref: 23 pid: 6532 timeout: 722 lvb_type: 1 00000100:00100000:1.0:1762167002.178128:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7227 00000100:00100000:1.0:1762167002.178134:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451610112:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.178147:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.178172:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d085d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b92 expref: 23 pid: 6532 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.178185:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d085d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b92 expref: 23 pid: 6532 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.178209:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d085d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b92 expref: 23 pid: 6532 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.178218:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.178219:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.178225:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d086a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bed expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.178231:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d086a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bed expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.178260:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d086a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bed expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.178274:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765454339584:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167002.178333:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.179590:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765454339584:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167002.179609:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.179655:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451610112:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1519us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.179675:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7227 00000100:00100000:3.0:1762167002.179949:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.180206:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451610240 00000100:00100000:1.0:1762167002.180213:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451610240 00000100:00100000:1.0:1762167002.180269:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16214 00000100:00100000:1.0:1762167002.180279:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56164:x1847765451610240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.180297:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.180315:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d086a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2bf4 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.180344:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d085e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b99 expref: 29 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.180352:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.180354:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.180358:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d086a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bf4 expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.180383:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d085e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b99 expref: 29 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.180395:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d085e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b99 expref: 29 pid: 33892 timeout: 722 lvb_type: 1 00000100:00100000:1.0:1762167002.180407:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454339712:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.180493:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.181803:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454339712:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.181828:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d086a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bf4 expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.181843:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b800, rc 0) 00000100:00100000:1.0:1762167002.182093:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56164:x1847765451610240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1814us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.182103:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16214 00000100:00100000:1.0:1762167002.182331:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451610368 00000100:00100000:1.0:1762167002.182338:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451610368 00010000:00010000:1.0:1762167002.182366:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d085e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b99 expref: 29 pid: 33892 timeout: 722 lvb_type: 1 00000100:00100000:1.0:1762167002.182402:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7228 00000100:00100000:1.0:1762167002.182411:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451610368:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.182434:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.182457:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d085e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b99 expref: 29 pid: 33892 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.182471:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d085e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b99 expref: 29 pid: 33892 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.182492:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d085e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b99 expref: 29 pid: 33892 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.182506:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.182508:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.182514:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d086a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bf4 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.182523:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d086a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bf4 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.182569:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d086a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bf4 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.182583:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765454339840:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167002.182645:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.183829:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765454339840:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167002.183842:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.183890:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451610368:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1479us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.183900:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7228 00000100:00100000:1.0:1762167002.184206:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451610496 00000100:00100000:1.0:1762167002.184216:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451610496 00000100:00100000:1.0:1762167002.184287:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16215 00000100:00100000:1.0:1762167002.184299:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56164:x1847765451610496:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.184320:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.184343:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2bfb expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.184380:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d085dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba0 expref: 23 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.184390:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.184392:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.184397:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.184451:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d085dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba0 expref: 23 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.184467:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d085dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba0 expref: 23 pid: 33894 timeout: 722 lvb_type: 1 00000100:00100000:1.0:1762167002.184483:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454339968:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.184569:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.185500:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454339968:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.185527:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.185556:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ba00, rc 0) 00000100:00100000:1.0:1762167002.185604:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56164:x1847765451610496:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1307us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.185613:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16215 00000100:00100000:1.0:1762167002.185867:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451610624 00000100:00100000:1.0:1762167002.185875:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451610624 00010000:00010000:1.0:1762167002.185906:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d085dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba0 expref: 23 pid: 33894 timeout: 722 lvb_type: 1 00000100:00100000:1.0:1762167002.185945:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7229 00000100:00100000:1.0:1762167002.185959:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451610624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.185974:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.185997:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d085dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba0 expref: 23 pid: 33894 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.186010:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d085dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba0 expref: 23 pid: 33894 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.186032:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d085dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba0 expref: 23 pid: 33894 timeout: 722 lvb_type: 1 00010000:00010000:1.0:1762167002.186045:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.186046:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.186050:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.186057:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.186082:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.186092:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765454340096:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167002.186137:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.187181:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765454340096:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167002.187198:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.187246:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451610624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1289us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.187255:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7229 00000100:00100000:3.0:1762167002.187298:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.187397:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451610752 00000100:00100000:1.0:1762167002.187403:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451610752 00000100:00100000:1.0:1762167002.187448:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16216 00000100:00100000:1.0:1762167002.187455:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451610752:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167002.187637:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 167513 -> 167513 00002000:00010000:1.0:1762167002.187643:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.187647:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167002.187652:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.187654:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00000100:00100000:1.0:1762167002.187697:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451610752:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 241us (399us total) trans 21474842990 rc 0/0 00000100:00100000:1.0:1762167002.187704:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16216 00000100:00100000:3.0:1762167002.187740:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451611008 00000100:00100000:3.0:1762167002.187746:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451611008 00000100:00100000:3.0:1762167002.187815:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16217 00000100:00100000:3.0:1762167002.187928:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451611008:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762167002.188111:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.188115:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.188118:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167002.188120:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.188124:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167002.188201:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451611008:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 377us (644us total) trans 21474842991 rc 0/0 00000100:00100000:3.0:1762167002.188210:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16217 00000100:00100000:1.0:1762167002.189441:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451611264 00000100:00100000:1.0:1762167002.189449:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451611264 00000100:00100000:1.0:1762167002.189499:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7192 00000100:00100000:1.0:1762167002.189508:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56164:x1847765451611264:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762167002.189565:0:30820:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08597 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b7d expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.189604:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d086b6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167002.189614:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d085c1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b84 expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.189619:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d086b6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167002.189646:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d085c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b84 expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.189654:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d085c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b84 expref: 902 pid: 30817 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167002.189664:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454340224:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.189733:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.191213:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451611392 00000100:00100000:1.0:1762167002.191219:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451611392 00010000:00010000:1.0:1762167002.191250:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d085c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b84 expref: 903 pid: 30817 timeout: 722 lvb_type: 0 00000100:00100000:1.0:1762167002.191285:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7230 00000100:00100000:1.0:1762167002.191295:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2361:x1847765451611392:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.191308:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.191315:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d085c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b84 expref: 903 pid: 30817 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167002.191325:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d085c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b84 expref: 903 pid: 30817 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167002.191343:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d085c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2b84 expref: 903 pid: 30817 timeout: 722 lvb_type: 0 00010000:00010000:1.0:1762167002.191357:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77600) 00010000:00010000:1.0:1762167002.191362:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d086b6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167002.191370:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d086b6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167002.191377:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d086b6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167002.191400:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.191458:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2361:x1847765451611392:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 164us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.191467:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7230 00000001:00080000:1.0:1762167002.205996:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952433 is committed 00000004:00080000:1.0:1762167002.206013:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3400 committed 00000004:00080000:1.0:1762167002.206032:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3387 committed 00000004:00080000:1.0:1762167002.206050:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3399 committed 00000004:00080000:1.0:1762167002.206054:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3386 committed 00000004:00080000:1.0:1762167002.206057:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3385 committed 00000004:00080000:1.0:1762167002.206061:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3398 committed 00000004:00080000:1.0:1762167002.206065:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3384 committed 00000004:00080000:1.0:1762167002.206070:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3397 committed 00000004:00080000:1.0:1762167002.206073:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3383 committed 00000004:00080000:1.0:1762167002.206077:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3396 committed 00000004:00080000:1.0:1762167002.206080:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3382 committed 00000004:00080000:1.0:1762167002.206083:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3395 committed 00000004:00080000:1.0:1762167002.206086:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3394 committed 00000004:00080000:1.0:1762167002.206090:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3381 committed 00000100:00100000:1.0:1762167002.206263:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454340608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.206324:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.206439:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454341120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.206472:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.206512:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454341632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167002.206543:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454340608 00000100:00100000:3.0:1762167002.206552:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454340608 00000100:00100000:3.0:1762167002.206607:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454341120 00000100:00100000:3.0:1762167002.206612:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454341120 00000100:00100000:3.0:1762167002.206646:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16219 00000100:00100000:3.0:1762167002.206659:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765454340608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167002.206930:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.206934:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.206942:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167002.206948:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.206954:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167002.207025:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.207070:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454341632 00000100:00100000:1.0:1762167002.207074:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454341632 00000100:00100000:1.0:1762167002.207095:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454341248 00000100:00100000:1.0:1762167002.207099:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454341248 00000100:00100000:1.0:1762167002.207118:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454341760 00000100:00100000:1.0:1762167002.207121:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454341760 00000100:00100000:3.0:1762167002.207126:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454340608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 469us (800us total) trans 21474842992 rc 0/0 00000100:00100000:3.0:1762167002.207136:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16219 00000100:00100000:1.0:1762167002.207144:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16221 00000100:00100000:1.0:1762167002.207152:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765454341120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.207160:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16222 00000100:00100000:3.0:1762167002.207174:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765454340736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167002.207276:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb size from disk: 167513 -> 167513 00002000:00010000:1.0:1762167002.207281:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.207284:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:1.0:1762167002.207288:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.207295:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:3.0:1762167002.207298:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.207303:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.207305:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:3.0:1762167002.207308:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.207310:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167002.207334:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454341120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 182us (861us total) trans 21474842993 rc 0/0 00000100:00100000:1.0:1762167002.207343:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16221 00000100:00100000:3.0:1762167002.207354:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454340736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (833us total) trans 21474842994 rc 0/0 00000100:00100000:1.0:1762167002.207361:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16224 00000100:00100000:3.0:1762167002.207368:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16222 00000100:00100000:1.0:1762167002.207373:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454341248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.207390:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16225 00000100:00100000:3.0:1762167002.207400:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454341760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167002.207500:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 167513 -> 167513 00002000:00010000:1.0:1762167002.207505:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.207507:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167002.207509:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.207511:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:3.0:1762167002.207536:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 167513 -> 167513 00002000:00010000:3.0:1762167002.207543:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00000100:00100000:1.0:1762167002.207549:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454341248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (486us total) trans 21474842995 rc 0/0 00002000:00010000:3.0:1762167002.207550:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167002.207558:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.207566:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167002.207572:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16224 00000100:00100000:3.0:1762167002.207604:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454341760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (492us total) trans 17179875509 rc 0/0 00000100:00100000:3.0:1762167002.207613:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16225 00000100:00100000:1.0:1762167002.207618:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.207639:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454340352 00000100:00100000:3.0:1762167002.207644:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454340352 00000100:00100000:1.0:1762167002.207650:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454340864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.207674:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16226 00000100:00100000:3.0:1762167002.207687:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454340352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.207688:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167002.207829:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 167513 -> 167513 00002000:00010000:3.0:1762167002.207835:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.207841:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167002.207847:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.207853:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00000100:00100000:3.0:1762167002.207889:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454340352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (272us total) trans 21474842996 rc 0/0 00000100:00100000:3.0:1762167002.207902:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16226 00000100:00100000:3.0:1762167002.207913:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454340864 00000100:00100000:3.0:1762167002.207916:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454340864 00000100:00100000:3.0:1762167002.207936:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16227 00000100:00100000:3.0:1762167002.207942:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454340864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167002.208018:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.208022:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.208024:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167002.208026:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.208028:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167002.208054:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454340864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (371us total) trans 21474842997 rc 0/0 00000100:00100000:3.0:1762167002.208060:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16227 00000100:00080000:3.0:1762167002.208231:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1762167002.208236:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762167002.208262:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454341376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.208298:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.208339:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454341888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.208370:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167002.208433:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa98000/2, rc 0, transno 21474842996 00000100:00100000:1.0:1762167002.208440:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454340352:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167002.208459:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa9a680/2, rc 0, transno 21474842997 00000100:00100000:1.0:1762167002.208466:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454340864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.208478:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1762167002.208488:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454341504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167002.208497:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16229 00000100:00100000:3.0:1762167002.208510:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454341888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.208521:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.208551:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454342016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.208580:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.208624:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454341504 00000100:00100000:1.0:1762167002.208631:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454341504 00000100:00100000:1.0:1762167002.208660:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454342016 00000100:00100000:1.0:1762167002.208665:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454342016 00002000:00010000:3.0:1762167002.208675:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.208679:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.208682:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:3.0:1762167002.208685:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.208688:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167002.208692:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16230 00000100:00100000:1.0:1762167002.208708:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454341504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167002.208748:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454341888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (361us total) trans 17179875511 rc 0/0 00000100:00100000:3.0:1762167002.208759:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16229 00002000:00010000:1.0:1762167002.208934:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb size from disk: 167513 -> 167513 00002000:00010000:1.0:1762167002.208939:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.208942:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:1.0:1762167002.208944:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.208946:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167002.208976:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454341504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 275us (456us total) trans 17179875513 rc 0/0 00000100:00100000:1.0:1762167002.208984:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16230 00000100:00100000:1.0:1762167002.209018:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167002.209053:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825b480/2, rc 0, transno 17179875507 00000100:00100000:1.0:1762167002.209060:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454340480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.209092:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16232 00000100:00100000:1.0:1762167002.209100:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454340992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167002.209185:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167002.209188:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.209191:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167002.209193:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.209195:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167002.209238:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454340992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (219us total) trans 21474842998 rc 0/0 00000100:00100000:1.0:1762167002.209245:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16232 00000004:00080000:1.0:1762167002.209275:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354e300/2, rc 0, transno 21474842993 00000100:00100000:1.0:1762167002.209279:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454341120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167002.209289:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825b800/2, rc 0, transno 17179875508 00000100:00100000:1.0:1762167002.209293:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454341632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167002.209302:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa9b100/2, rc 0, transno 21474842992 00000100:00100000:1.0:1762167002.209305:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454340608:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167002.209329:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348259880/2, rc 0, transno 17179875513 00000100:00100000:1.0:1762167002.209333:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454341504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167002.209341:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825aa00/2, rc 0, transno 17179875512 00000100:00100000:1.0:1762167002.209344:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454342016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167002.209352:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825a680/2, rc 0, transno 17179875510 00000100:00100000:1.0:1762167002.209356:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454341376:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167002.209363:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258700/2, rc 0, transno 17179875511 00000100:00100000:1.0:1762167002.209366:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454341888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.212785:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451611520 00000100:00100000:1.0:1762167002.212797:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451611520 00000100:00100000:1.0:1762167002.212853:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19384 00000100:00100000:1.0:1762167002.212865:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56164:x1847765451611520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.212887:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.212910:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d086bd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c02 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.212965:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d086bd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c02 expref: 890 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.212980:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d086bd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c02 expref: 890 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.212998:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:1.0:1762167002.213001:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167002.213005:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a000, rc 0) 00000100:00100000:1.0:1762167002.213059:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56164:x1847765451611520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 197us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.213066:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19384 00000100:00100000:1.0:1762167002.215372:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451611776 00000100:00100000:1.0:1762167002.215381:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451611776 00000100:00100000:1.0:1762167002.215445:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7193 00000100:00100000:1.0:1762167002.215456:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348210850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56164:x1847765451611776:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167002.215694:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348210850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56164:x1847765451611776:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 240us (433us total) trans 8589952434 rc 0/0 00000100:00100000:1.0:1762167002.215702:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7193 00000100:00100000:1.0:1762167002.225669:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451611904 00000100:00100000:1.0:1762167002.225681:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451611904 00000100:00100000:1.0:1762167002.225739:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19385 00000100:00100000:1.0:1762167002.225750:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56165:x1847765451611904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.225798:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.225818:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d086c4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c09 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.225883:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d086cb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.225895:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d086cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.225906:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d086cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.225919:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d086d2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.225924:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d086d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.225931:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d086d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226032:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226039:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226046:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.226075:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00000004:00200000:1.0:1762167002.226079:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167002.226094:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226103:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226109:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d086cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226113:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d086cb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226117:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d086cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226121:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ac00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167002.226123:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d086cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226128:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d086cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226136:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:1.0:1762167002.226139:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167002.226142:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d086cb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226147:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d086cb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226166:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d086d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226171:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d086d2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226177:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d086d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226182:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167002.226184:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d086d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226190:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d086d2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226198:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee345a77a00) 00010000:00010000:1.0:1762167002.226200:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167002.226203:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d086d2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226208:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d086d2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.226239:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d086c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c09 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.226253:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c09 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.226260:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:1.0:1762167002.226262:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167002.226265:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b600, rc 0) 00000100:00100000:1.0:1762167002.226330:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56165:x1847765451611904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 583us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.226338:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19385 00000100:00100000:1.0:1762167002.228580:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451612160 00000100:00100000:1.0:1762167002.228589:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451612160 00000100:00100000:1.0:1762167002.228695:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19386 00000100:00100000:1.0:1762167002.228707:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56165:x1847765451612160:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.228728:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.228747:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d086e0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c10 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.228875:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d086e7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.228890:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d086e7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.228901:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d086e7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.228914:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00010000:00010000:1.0:1762167002.229051:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d086e0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c10 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.229071:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d086e7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c10 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.229080:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:1.0:1762167002.229084:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762167002.229088:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00000100:00100000:1.0:1762167002.229148:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56165:x1847765451612160:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 443us (630us total) trans 8589952435 rc 0/0 00000100:00100000:1.0:1762167002.229155:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19386 00000100:00100000:1.0:1762167002.231363:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451612416 00000100:00100000:1.0:1762167002.231372:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451612416 00000100:00100000:1.0:1762167002.231461:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19387 00000100:00100000:1.0:1762167002.231473:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56165:x1847765451612416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.231492:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.231510:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d086f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c17 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.231596:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d086fc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.231611:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d086fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.231621:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d086fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.231633:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00010000:00010000:1.0:1762167002.231735:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d086f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c17 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.231752:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d086fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c17 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.231778:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:1.0:1762167002.231782:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167002.231785:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b200, rc 0) 00000100:00100000:1.0:1762167002.231845:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56165:x1847765451612416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 375us (558us total) trans 8589952436 rc 0/0 00000100:00100000:1.0:1762167002.231853:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19387 00000100:00100000:1.0:1762167002.259215:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451612672 00000100:00100000:1.0:1762167002.259221:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451612672 00010000:00010000:1.0:1762167002.259247:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d086a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bed expref: 25 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.259280:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7231 00000100:00100000:1.0:1762167002.259289:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451612672:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.259300:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.259320:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d086a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bed expref: 25 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.259333:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d086a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bed expref: 25 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.259355:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d086a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bed expref: 25 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.259378:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.259380:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.259384:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0870a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.259393:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0870a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.259429:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.259471:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451612672:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 183us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.259479:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7231 00010000:00010000:0.0:1762167002.261259:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0870a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.261265:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167002.261269:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0870a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.261277:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0870a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.261290:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0870a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.261297:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0870a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.261360:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765451612544:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3689us (3888us total) trans 0 rc 167513/167513 00000100:00100000:0.0:1762167002.261368:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2549 00000100:00100000:1.0:1762167002.263653:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.263735:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451612800 00000100:00100000:0.0:1762167002.263743:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451612800 00000100:00100000:0.0:1762167002.263841:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2550 00000100:00100000:0.0:1762167002.263853:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451612800:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167002.263888:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.263908:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0861c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba7 expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.263921:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167002.263923:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167002.263926:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.263958:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0861c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba7 expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.263972:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0861c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba7 expref: 29 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.263990:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454342272:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167002.264076:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.265298:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454342272:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167002.265320:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.265622:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.265682:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451612928 00000100:00100000:3.0:1762167002.265731:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451612928 00010000:00010000:3.0:1762167002.265789:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0861c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba7 expref: 30 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.265821:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7232 00000100:00100000:3.0:1762167002.265830:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451612928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.265842:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.265875:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0861c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba7 expref: 30 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.265893:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0861c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba7 expref: 30 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.265914:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0861c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x810:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ba7 expref: 30 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.265928:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.265931:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.265935:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.265944:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.265977:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167002.266026:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451612928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 196us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.266035:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7232 00010000:00010000:1.0:1762167002.266072:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.266083:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.267953:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.267965:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.267970:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.267978:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167002.267981:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.267986:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.267997:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.268000:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08711 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.268067:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451612800:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4214us (4417us total) trans 0 rc 167513/167513 00000100:00100000:0.0:1762167002.268076:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2550 00000100:00100000:0.0:1762167002.270747:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451613056 00000100:00100000:0.0:1762167002.270757:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451613056 00000100:00100000:0.0:1762167002.270856:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2551 00000100:00100000:0.0:1762167002.270865:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451613056:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167002.270894:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.270908:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08638 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bb5 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.270916:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167002.270918:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167002.270920:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.270945:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08638 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bb5 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.270955:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08638 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bb5 expref: 28 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.270966:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454342400:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167002.271037:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.272283:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454342400:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167002.272305:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.272723:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451613184 00000100:00100000:0.0:1762167002.272730:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451613184 00010000:00010000:0.0:1762167002.272758:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08638 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bb5 expref: 29 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.272824:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7233 00000100:00100000:0.0:1762167002.272839:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451613184:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167002.272853:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.272874:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08638 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bb5 expref: 29 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.272883:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08638 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bb5 expref: 29 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.272903:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08638 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bb5 expref: 29 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.272917:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.272918:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.272922:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.272932:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.272959:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.272989:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.273000:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.273007:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451613184:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.273017:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7233 00010000:00010000:1.0:1762167002.274377:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.274396:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.274403:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.274410:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167002.274414:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.274432:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.274445:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.274452:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08718 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.274516:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451613056:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3650us (3860us total) trans 0 rc 167513/167513 00000100:00100000:1.0:1762167002.274525:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2551 00000100:00100000:1.0:1762167002.277435:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451613312 00000100:00100000:1.0:1762167002.277444:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451613312 00000100:00100000:1.0:1762167002.277516:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2552 00000100:00100000:1.0:1762167002.277530:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451613312:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167002.277563:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.277582:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bc3 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.277589:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167002.277591:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167002.277595:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.277629:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bc3 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.277642:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bc3 expref: 27 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.277656:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454342528:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.278025:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.279350:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454342528:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.279386:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.279740:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451613440 00000100:00100000:0.0:1762167002.279747:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451613440 00010000:00010000:0.0:1762167002.279815:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bc3 expref: 28 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.279859:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7234 00000100:00100000:0.0:1762167002.279872:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451613440:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167002.279889:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.279914:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bc3 expref: 28 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.279937:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bc3 expref: 28 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.279972:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08654 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bc3 expref: 28 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.279992:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.279995:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.280000:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.280014:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.280019:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765454343040:0@lo:400:kworker.0 00000100:00100000:3.0:1762167002.280053:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454342656 00000100:00100000:3.0:1762167002.280059:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454342656 00010000:00010000:0.0:1762167002.280064:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.280098:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.280106:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1762167002.280121:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3293:x1847765454342656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762167002.280131:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451613440:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 262us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.280142:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7234 00000100:00100000:1.0:1762167002.280161:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762167002.280174:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765454342912:0@lo:400:kworker.0 00000100:00100000:3.0:1762167002.280185:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3293:x1847765454342656:12345-0@lo:400:kworker.0 Request processed in 68us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.280199:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1762167002.280223:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167002.280229:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1847765454342784:0@lo:400:kworker.0 00000100:00100000:0.0:1762167002.280282:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167002.280295:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.280296:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454343168 00000100:00100000:1.0:1762167002.280306:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454343168 00010000:00010000:3.0:1762167002.280315:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.280331:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454343296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762167002.280351:0:33893:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454343040 00000100:00100000:3.0:1762167002.280357:0:33893:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454343040 00000100:00100000:0.0:1762167002.280360:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.280383:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454343296 00000100:00100000:1.0:1762167002.280390:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454343296 00000100:00100000:3.0:1762167002.280399:0:33893:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454342912 00000100:00100000:3.0:1762167002.280405:0:33893:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454342912 00000100:00100000:0.0:1762167002.280411:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1762167002.280437:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454343168:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762167002.280460:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00002000:00000024:0.0:1762167002.280466:0:8383:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 136511488 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1762167002.280476:0:6537:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454343296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1762167002.280503:0:6537:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 221839360 pending 0 free 3855613952 avail 3844079616 00000100:00100000:3.0:1762167002.280509:0:33893:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454342784 00000100:00100000:3.0:1762167002.280515:0:33893:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454342784 00000100:00100000:0.0:1762167002.280519:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454343168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.280528:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1762167002.280556:0:33893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1762167002.280572:0:6537:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454343296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.280573:0:33893:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765454343040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762167002.280585:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1762167002.280600:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1762167002.280605:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765454342912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762167002.280641:0:33893:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1847765454343040:12345-0@lo:400:kworker.0 Request processed in 77us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.280649:0:33893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1762167002.280671:0:33893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1762167002.280675:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1847765454343040:0@lo:400:kworker.0 00000100:00100000:0.0:1762167002.280677:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1847765454342912:12345-0@lo:400:kworker.0 Request processed in 76us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.280687:0:33893:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1847765454342784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762167002.280700:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1762167002.280724:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1847765454342912:0@lo:400:kworker.0 00000100:00100000:3.0:1762167002.280753:0:33893:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1847765454342784:12345-0@lo:400:kworker.0 Request processed in 70us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.280795:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454343168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762167002.280811:0:33893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1762167002.280811:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1847765454342784:0@lo:400:kworker.0 00000100:00080000:0.0:1762167002.280848:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762167002.280850:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454343296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1762167002.282519:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.282533:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.282541:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.282548:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167002.282552:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.282560:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.282575:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.282582:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0871f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.282651:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451613312:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5120us (5306us total) trans 0 rc 167513/167513 00000100:00100000:3.0:1762167002.282660:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2552 00000100:00100000:3.0:1762167002.285189:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451613568 00000100:00100000:3.0:1762167002.285198:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451613568 00000100:00100000:3.0:1762167002.285260:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2553 00000100:00100000:3.0:1762167002.285273:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee373e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765451613568:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167002.285307:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.285325:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bd1 expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.285338:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167002.285339:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167002.285342:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.285372:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bd1 expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.285385:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08670 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bd1 expref: 23 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.285400:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454343424:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167002.285485:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167002.286686:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454343424:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167002.286708:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.286967:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451613696 00000100:00100000:0.0:1762167002.286973:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451613696 00010000:00010000:0.0:1762167002.286996:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08670 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bd1 expref: 24 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.287019:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7235 00000100:00100000:0.0:1762167002.287024:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451613696:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167002.287036:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.287053:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08670 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bd1 expref: 24 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.287062:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bd1 expref: 24 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.287083:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08670 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bd1 expref: 24 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.287093:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.287095:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.287098:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.287112:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.287138:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167002.287156:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.287166:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.287187:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451613696:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 161us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.287193:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7235 00010000:00010000:3.0:1762167002.289038:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.289060:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.289068:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.289075:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167002.289079:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.289088:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.289104:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.289112:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08726 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.289200:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee373e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451613568:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3928us (4084us total) trans 0 rc 167513/167513 00000100:00100000:3.0:1762167002.289209:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2553 00000100:00100000:3.0:1762167002.291925:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451613824 00000100:00100000:3.0:1762167002.291934:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451613824 00000100:00100000:3.0:1762167002.291986:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2554 00000100:00100000:3.0:1762167002.291993:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451613824:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167002.292019:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.292033:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0868c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bdf expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.292039:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167002.292041:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167002.292043:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.292067:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0868c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bdf expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.292075:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0868c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bdf expref: 22 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.292085:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454343552:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167002.292139:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167002.293060:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454343552:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167002.293079:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.293385:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451613952 00000100:00100000:0.0:1762167002.293391:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451613952 00010000:00010000:0.0:1762167002.293427:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0868c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bdf expref: 23 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.293460:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7236 00000100:00100000:0.0:1762167002.293470:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451613952:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167002.293483:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.293500:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0868c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bdf expref: 23 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.293513:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0868c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bdf expref: 23 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.293527:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0868c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bdf expref: 23 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.293536:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.293537:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.293542:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.293550:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.293577:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167002.293602:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.293611:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.293619:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451613952:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 148us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.293629:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7236 00010000:00010000:1.0:1762167002.294862:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.294872:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.294877:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.294881:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167002.294884:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.294893:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.294903:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.294906:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0872d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.294985:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451613824:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2990us (3101us total) trans 0 rc 167513/167513 00000100:00100000:1.0:1762167002.294995:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2554 00000100:00100000:1.0:1762167002.302351:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.302464:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451614080 00000100:00100000:0.0:1762167002.302474:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451614080 00000100:00100000:0.0:1762167002.302537:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 607 00000100:00100000:0.0:1762167002.302548:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56165:x1847765451614080:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:0.0:1762167002.302563:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.302586:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d086fc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c17 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.302602:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:0.0:1762167002.302606:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167002.302662:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56165:x1847765451614080:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 111us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.302672:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 607 00000100:00100000:3.0:1762167002.304074:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.304138:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451614336 00000100:00100000:1.0:1762167002.304146:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451614336 00000100:00100000:1.0:1762167002.304188:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7194 00000100:00100000:1.0:1762167002.304197:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56165:x1847765451614336:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167002.304411:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56165:x1847765451614336:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 215us (341us total) trans 8589952437 rc 0/0 00000100:00100000:1.0:1762167002.304431:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7194 00000100:00100000:0.0:1762167002.307014:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451614592 00000100:00100000:0.0:1762167002.307023:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451614592 00000100:00100000:0.0:1762167002.307079:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19388 00000100:00100000:0.0:1762167002.307089:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451614592:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167002.307112:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.307147:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08734 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c1e expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.307260:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.307274:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c09 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.307283:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.307316:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c09 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.307329:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c09 expref: 897 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.307341:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454343680:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167002.307411:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.308585:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aabb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454343680:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167002.308609:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167002.308698:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451614720 00000100:00100000:0.0:1762167002.308705:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451614720 00010000:00010000:0.0:1762167002.308732:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c09 expref: 898 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.308785:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7237 00000100:00100000:0.0:1762167002.308794:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451614720:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167002.308807:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.308813:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c09 expref: 898 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.308824:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c09 expref: 898 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.308843:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d086d9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c09 expref: 898 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.308858:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:0.0:1762167002.308862:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.308871:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.308879:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.308910:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.308944:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.308951:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167002.308961:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451614720:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 167us (312us total) trans 0 rc 0/0 00000004:00200000:1.0:1762167002.308964:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00000100:00100000:0.0:1762167002.308972:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7237 00010000:00010000:1.0:1762167002.309107:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08734 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c1e expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.309124:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c1e expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.309132:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:1.0:1762167002.309135:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762167002.309138:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8a00, rc 0) 00000100:00100000:1.0:1762167002.309180:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451614592:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2093us (2441us total) trans 8589952438 rc 0/0 00000100:00100000:1.0:1762167002.309186:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19388 00000100:00100000:1.0:1762167002.310658:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451614848 00000100:00100000:1.0:1762167002.310664:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451614848 00000100:00100000:1.0:1762167002.310708:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19389 00000100:00100000:1.0:1762167002.310718:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451614848:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167002.310737:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.310753:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08749 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c25 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.310866:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.310879:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c1e expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.310886:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.310917:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c1e expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.310931:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c1e expref: 898 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.310945:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454343808:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.311018:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.312564:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454343808:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.312587:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.312806:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451614976 00000100:00100000:3.0:1762167002.312814:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451614976 00010000:00010000:3.0:1762167002.312851:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c1e expref: 899 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.312923:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7238 00000100:00100000:3.0:1762167002.312933:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2361:x1847765451614976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.312946:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.312952:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c1e expref: 899 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.312964:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c1e expref: 899 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.312986:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0873b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c1e expref: 899 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.313008:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:3.0:1762167002.313013:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.313022:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.313030:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.313056:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.313062:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.313072:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.313108:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451614976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (380us total) trans 0 rc 0/0 00000004:00200000:1.0:1762167002.313109:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00000004:00200000:1.0:1762167002.313116:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1762167002.313121:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7238 00000004:00010000:1.0:1762167002.313139:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.313170:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08749 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c25 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.313187:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c25 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.313195:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:1.0:1762167002.313199:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167002.313202:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b000, rc 0) 00000100:00100000:1.0:1762167002.313250:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451614848:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2534us (2832us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.313258:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19389 00000100:00100000:1.0:1762167002.315089:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451615104 00000100:00100000:1.0:1762167002.315098:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451615104 00000100:00100000:1.0:1762167002.315150:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16233 00000100:00100000:1.0:1762167002.315159:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451615104:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167002.315174:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.315282:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08757 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c2c expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167002.315308:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 167513, mtime: 0x690888da, atime: 0x690888d5, ctime: 0x690888da, blocks: 0x203 00010000:00010000:1.0:1762167002.315324:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.315327:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.315334:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c2c expref: 27 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.315351:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c2c expref: 27 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.315363:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b200, rc 0) 00000100:00100000:1.0:1762167002.315493:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451615104:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 334us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.315500:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16233 00000100:00100000:3.0:1762167002.317334:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.317390:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451615360 00000100:00100000:1.0:1762167002.317399:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451615360 00000100:00100000:1.0:1762167002.317462:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19390 00000100:00100000:1.0:1762167002.317471:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451615360:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167002.317520:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.317544:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08750 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c25 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.317562:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:1.0:1762167002.317566:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.317850:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.317863:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.317872:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:1.0:1762167002.317925:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952439 00000004:00010000:1.0:1762167002.317949:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001421749f reply state 000000004ea48d2d transno 8589952440 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167002.317955:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167002.318034:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451615360:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 562us (707us total) trans 8589952440 rc 0/0 00000100:00100000:1.0:1762167002.318040:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19390 00000020:00080000:1.0:1762167002.318045:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167002.319271:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.319285:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.319292:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.319298:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.319303:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.319311:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.319329:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:0.0:1762167002.319332:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.319335:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.319341:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0875e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.319626:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.319665:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451615616 00000100:00100000:1.0:1762167002.319673:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451615616 00000100:00100000:1.0:1762167002.319723:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7195 00000100:00100000:1.0:1762167002.319731:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451615616:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167002.319995:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451615616:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 264us (373us total) trans 8589952441 rc 0/0 00000100:00100000:1.0:1762167002.320000:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7195 00000100:00100000:1.0:1762167002.321357:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451615872 00000100:00100000:1.0:1762167002.321363:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451615872 00000100:00100000:1.0:1762167002.321411:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19391 00000100:00100000:1.0:1762167002.321432:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451615872:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167002.321449:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.321452:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762167002.321474:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d086e7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c10 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.321493:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d086bd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c02 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.321504:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:1.0:1762167002.321516:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.321530:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08765 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c33 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.321573:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d0876c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.321585:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d0876c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.321593:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d0876c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000040:00080000:1.0:1762167002.322034:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5276, 88 off424784 00000004:00080000:1.0:1762167002.322043:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623114279416ns, next at 623133476195ns, rc = 0 00000040:00080000:1.0:1762167002.322083:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5284, 88 off425880 00000004:00080000:1.0:1762167002.322087:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623114324196ns, next at 623133525901ns, rc = 0 00000040:00080000:1.0:1762167002.322172:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5286, 88 off426072 00000004:00080000:1.0:1762167002.322178:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623114415074ns, next at 623133525901ns, rc = 0 00000040:00080000:1.0:1762167002.322204:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5277, 88 off424872 00000004:00080000:1.0:1762167002.322208:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623114445516ns, next at 623133476195ns, rc = 0 00000040:00080000:1.0:1762167002.322241:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5287, 88 off426160 00000004:00080000:1.0:1762167002.322247:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623114484169ns, next at 623133525901ns, rc = 0 00000040:00080000:1.0:1762167002.322283:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5278, 88 off424960 00000004:00080000:1.0:1762167002.322287:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623114524319ns, next at 623133476195ns, rc = 0 00000040:00080000:1.0:1762167002.322311:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5288, 88 off426248 00000004:00080000:1.0:1762167002.322316:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623114552919ns, next at 623133525901ns, rc = 0 00000040:00080000:1.0:1762167002.322333:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5279, 88 off425048 00000004:00080000:1.0:1762167002.322337:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623114574159ns, next at 623133476195ns, rc = 0 00000040:00080000:1.0:1762167002.322362:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5289, 88 off426336 00000004:00080000:1.0:1762167002.322366:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623114603854ns, next at 623133525901ns, rc = 0 00000040:00080000:1.0:1762167002.322383:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5280, 88 off425136 00000004:00080000:1.0:1762167002.322388:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623114625116ns, next at 623133476195ns, rc = 0 00000040:00080000:1.0:1762167002.322413:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5281, 88 off425224 00000004:00080000:1.0:1762167002.322428:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623114665404ns, next at 623133476195ns, rc = 0 00000040:00080000:1.0:1762167002.322449:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5290, 88 off426424 00000004:00080000:1.0:1762167002.322453:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623114690086ns, next at 623133525901ns, rc = 0 00000040:00080000:1.0:1762167002.322485:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5282, 88 off425312 00000004:00080000:1.0:1762167002.322491:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623114727925ns, next at 623133476195ns, rc = 0 00000040:00080000:1.0:1762167002.322520:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5291, 88 off426512 00000004:00080000:1.0:1762167002.322524:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623114761096ns, next at 623133525901ns, rc = 0 00000001:00080000:1.0:1762167002.334470:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952442 is committed 00000004:00080000:1.0:1762167002.334482:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3407 committed 00000004:00080000:1.0:1762167002.334497:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3394 committed 00000004:00080000:1.0:1762167002.334509:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3406 committed 00000004:00080000:1.0:1762167002.334512:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3393 committed 00000004:00080000:1.0:1762167002.334515:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3392 committed 00000004:00080000:1.0:1762167002.334518:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3405 committed 00000004:00080000:1.0:1762167002.334521:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3391 committed 00000004:00080000:1.0:1762167002.334525:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3404 committed 00000004:00080000:1.0:1762167002.334528:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3390 committed 00000004:00080000:1.0:1762167002.334531:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3403 committed 00000004:00080000:1.0:1762167002.334535:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3389 committed 00010000:00010000:0.0:1762167002.334537:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d0876c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c33 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167002.334549:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3402 committed 00010000:00010000:0.0:1762167002.334552:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77c00) 00000004:00080000:1.0:1762167002.334555:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3401 committed 00010000:00010000:0.0:1762167002.334558:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1762167002.334560:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3388 committed 00010000:00010000:0.0:1762167002.334579:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08765 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c33 expref: 894 pid: 32138 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1762167002.334601:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d0876c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c33 expref: 890 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.334635:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77c00) 00010000:00010000:0.0:1762167002.334639:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762167002.334642:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ac00, rc 0) 00000100:00100000:1.0:1762167002.334676:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454344192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167002.334710:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451615872:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 13290us (13445us total) trans 8589952442 rc 0/0 00000100:00100000:0.0:1762167002.334721:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19391 00000100:00100000:1.0:1762167002.334734:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.334759:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454344320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.334824:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454344704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167002.334829:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454344192 00000100:00100000:3.0:1762167002.334832:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167002.334837:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454344192 00000100:00100000:3.0:1762167002.334862:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454344832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.334867:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167002.334887:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454344064 00000100:00100000:0.0:1762167002.334892:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454344064 00000100:00100000:3.0:1762167002.334902:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454344704 00000100:00100000:3.0:1762167002.334908:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454344704 00000100:00100000:1.0:1762167002.334919:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454345216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167002.334925:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16234 00000100:00100000:0.0:1762167002.334938:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454344192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.334948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.334957:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454345216 00000100:00100000:3.0:1762167002.334964:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454345216 00000100:00100000:3.0:1762167002.334989:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16236 00000100:00100000:3.0:1762167002.334998:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454344320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167002.335175:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167002.335175:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.335183:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.335183:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.335190:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167002.335195:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:0.0:1762167002.335198:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.335203:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.335204:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167002.335210:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167002.335260:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454344192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 325us (525us total) trans 21474843000 rc 0/0 00000100:00100000:3.0:1762167002.335265:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454344320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 265us (432us total) trans 17179875514 rc 0/0 00000100:00100000:0.0:1762167002.335274:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16234 00000100:00100000:3.0:1762167002.335281:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16236 00000004:00080000:1.0:1762167002.335291:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550e680/2, rc 0, transno 21474843000 00000100:00100000:1.0:1762167002.335298:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454344192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167002.335300:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16238 00000004:00080000:1.0:1762167002.335316:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348259180/2, rc 0, transno 17179875515 00000100:00100000:0.0:1762167002.335317:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454345216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.335322:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454344704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167002.335333:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.335362:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454345344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.335399:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.335427:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454345344 00000100:00100000:1.0:1762167002.335432:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454345344 00002000:00010000:0.0:1762167002.335438:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167002.335443:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.335446:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167002.335449:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.335451:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:3.0:1762167002.335454:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258a80/2, rc 0, transno 17179875514 00000100:00100000:3.0:1762167002.335462:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454344320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.335468:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16240 00000100:00100000:1.0:1762167002.335479:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454345344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167002.335497:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3293:x1847765454345216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (547us total) trans 21474843001 rc 0/0 00000100:00100000:3.0:1762167002.335498:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454343936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167002.335511:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16238 00000100:00100000:3.0:1762167002.335540:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.335567:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454344576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167002.335577:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550d180/2, rc 0, transno 21474843001 00000100:00100000:0.0:1762167002.335587:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454345216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.335598:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.335625:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454344960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.335637:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454345344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (243us total) trans 21474843002 rc 0/0 00000100:00100000:1.0:1762167002.335646:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16240 00000100:00100000:3.0:1762167002.335655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.335668:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454344960 00000100:00100000:1.0:1762167002.335674:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454344960 00000100:00100000:3.0:1762167002.335679:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454345472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.335709:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16242 00000100:00100000:3.0:1762167002.335712:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.335722:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454344576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167002.335734:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454345472 00000100:00100000:0.0:1762167002.335740:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454345472 00000100:00100000:3.0:1762167002.335745:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1762167002.335754:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454345600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167002.335798:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16243 00000100:00100000:0.0:1762167002.335808:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454344960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.335818:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.335853:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454345600 00000100:00100000:3.0:1762167002.335859:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454345600 00000100:00100000:3.0:1762167002.335893:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16244 00000100:00100000:3.0:1762167002.335902:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454345472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.335928:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454344576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (331us total) trans 17179875518 rc 0/0 00000100:00100000:1.0:1762167002.335941:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16242 00002000:00010000:0.0:1762167002.335949:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167002.335954:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.335957:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167002.335959:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.335962:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167002.336000:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454344960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (347us total) trans 21474843003 rc 0/0 00000100:00100000:0.0:1762167002.336007:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16243 00000100:00100000:3.0:1762167002.336064:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454345472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (356us total) trans 21474843004 rc 0/0 00000100:00100000:3.0:1762167002.336076:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16244 00000004:00080000:3.0:1762167002.336109:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa99500/2, rc 0, transno 17179875516 00000100:00100000:3.0:1762167002.336114:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454344832:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167002.336122:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550f800/2, rc 0, transno 21474843002 00000100:00100000:3.0:1762167002.336126:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454345344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.336153:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454344448 00000100:00100000:3.0:1762167002.336158:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454344448 00000100:00100000:3.0:1762167002.336197:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16246 00000100:00100000:1.0:1762167002.336206:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454345088 00000100:00100000:3.0:1762167002.336207:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3296:x1847765454344448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.336211:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454345088 00000100:00100000:1.0:1762167002.336238:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16247 00000100:00100000:1.0:1762167002.336247:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3296:x1847765454345088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167002.336331:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.336336:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.336337:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.336339:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:1.0:1762167002.336342:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.336344:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.336347:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:3.0:1762167002.336348:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167002.336353:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.336357:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167002.336405:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454344448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (274us total) trans 21474843005 rc 0/0 00000100:00100000:1.0:1762167002.336406:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454345088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (216us total) trans 17179875520 rc 0/0 00000100:00100000:3.0:1762167002.336431:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16246 00000100:00100000:1.0:1762167002.336438:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16247 00000004:00080000:3.0:1762167002.336576:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa99c00/2, rc 0, transno 17179875519 00000100:00100000:3.0:1762167002.336582:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454345600:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167002.336592:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348259c00/2, rc 0, transno 17179875517 00000100:00100000:3.0:1762167002.336595:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454343936:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167002.336602:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825b100/2, rc 0, transno 17179875518 00000100:00100000:3.0:1762167002.336605:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454344576:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167002.336613:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550ce00/2, rc 0, transno 21474843003 00000100:00100000:3.0:1762167002.336616:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454344960:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167002.336623:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550c700/2, rc 0, transno 21474843004 00000100:00100000:3.0:1762167002.336626:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454345472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.338743:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451616000 00000100:00100000:3.0:1762167002.338751:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451616000 00000100:00100000:3.0:1762167002.338837:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16248 00000100:00100000:3.0:1762167002.338847:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56065:x1847765451616000:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167002.338867:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167002.338888:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08773 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c3a expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167002.338910:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 167513, mtime: 0x690888da, atime: 0x690888d9, ctime: 0x690888da, blocks: 0x135 00010000:00010000:3.0:1762167002.338929:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.338931:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.338940:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c3a expref: 22 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.338967:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c3a expref: 22 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.338979:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3e00, rc 0) 00000100:00100000:3.0:1762167002.339094:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56065:x1847765451616000:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 249us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.339101:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16248 00000100:00100000:3.0:1762167002.340525:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.340565:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.340594:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.340650:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451616128 00000100:00100000:0.0:1762167002.340656:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451616128 00000100:00100000:1.0:1762167002.340662:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451616384 00000100:00100000:1.0:1762167002.340668:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451616384 00002000:00010000:1.0:1762167002.340706:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167002.340711:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354fb80 with x1847765451616384 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167002.340718:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354fb80. 00000100:00100000:1.0:1762167002.340754:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2556 00000100:00100000:1.0:1762167002.340791:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451616384:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:0.0:1762167002.340813:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (119986->18446744073709551615) 00002000:00100000:0.0:1762167002.340819:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354c380 with x1847765451616128 ext(119986->18446744073709551615) 00002000:00010000:0.0:1762167002.340825:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354c380. 00000100:00100000:0.0:1762167002.340857:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2557 00000100:00100000:0.0:1762167002.340866:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451616128:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167002.341100:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167002.341107:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.341113:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167002.341118:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.341124:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167002.341174:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 167513 -> 119986 00002000:00010000:0.0:1762167002.341177:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.341179:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:0.0:1762167002.341181:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00000100:00100000:1.0:1762167002.341186:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451616384:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 420us (587us total) trans 21474843006 rc 0/0 00002000:00010000:0.0:1762167002.341186:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00000100:00100000:0.0:1762167002.341215:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451616128:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 349us (646us total) trans 21474843007 rc 0/0 00000100:00100000:1.0:1762167002.341217:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2556 00002000:00010000:1.0:1762167002.341226:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:0.0:1762167002.341229:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2557 00002000:00100000:1.0:1762167002.341233:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354fb80 with x1847765451616384 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167002.341234:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (119986->18446744073709551615) 00002000:00100000:0.0:1762167002.341240:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354c380 with x1847765451616128 ext(119986->18446744073709551615) 00002000:00010000:1.0:1762167002.341244:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354fb80. 00002000:00010000:0.0:1762167002.341246:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354c380. 00000100:00100000:0.0:1762167002.342862:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451616512 00000100:00100000:0.0:1762167002.342870:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451616512 00000100:00100000:0.0:1762167002.342922:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19392 00000100:00100000:0.0:1762167002.342930:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451616512:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167002.342948:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.342966:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0877a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c41 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.343039:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08781 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.343057:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08781 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.343067:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08781 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.343091:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 167513 00000004:00200000:0.0:1762167002.343095:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167002.343111:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08781 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.343133:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0877a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c41 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.343150:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08781 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c41 expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.343158:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77c00) 00010000:00010000:0.0:1762167002.343161:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.343164:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:0.0:1762167002.343219:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451616512:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 288us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.343226:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19392 00000100:00100000:3.0:1762167002.345329:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.345384:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451616768 00000100:00100000:0.0:1762167002.345393:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451616768 00000100:00100000:0.0:1762167002.345465:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19393 00000100:00100000:0.0:1762167002.345475:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451616768:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167002.345528:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167002.345562:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08781 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c41 expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.345580:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d0876c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c33 expref: 890 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.345589:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77c00) 00010000:00010000:0.0:1762167002.345600:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167002.345864:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.345875:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.345883:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:0.0:1762167002.345934:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952443 00000004:00010000:0.0:1762167002.345959:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000083314cd2 reply state 00000000c65122d7 transno 8589952444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167002.345968:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167002.346050:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451616768:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 576us (728us total) trans 8589952444 rc 0/0 00000100:00100000:0.0:1762167002.346059:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19393 00000020:00080000:0.0:1762167002.346063:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167002.346846:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.346866:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.346873:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.346895:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.346900:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.346908:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.346920:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167002.346923:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.346927:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.346934:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08788 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.347227:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.347276:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451616896 00000100:00100000:0.0:1762167002.347283:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451616896 00000100:00100000:0.0:1762167002.347327:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19394 00000100:00100000:0.0:1762167002.347338:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451616896:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167002.347357:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.347371:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0878f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c48 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.347428:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0878f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c48 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.347441:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0878f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c48 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.347458:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167002.347461:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167002.347464:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8c00, rc 0) 00000100:00100000:0.0:1762167002.347512:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451616896:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 176us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.347519:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19394 00000100:00100000:3.0:1762167002.349135:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.349171:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.349208:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.349212:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451617024 00000100:00100000:0.0:1762167002.349229:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451617024 00000100:00100000:1.0:1762167002.349251:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451617152 00000100:00100000:1.0:1762167002.349262:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451617152 00002000:00010000:0.0:1762167002.349284:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (135510->18446744073709551615) 00002000:00100000:0.0:1762167002.349291:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354c700 with x1847765451617024 ext(135510->18446744073709551615) 00002000:00010000:1.0:1762167002.349299:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167002.349306:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354d500 with x1847765451617152 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167002.349307:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354c700. 00002000:00010000:1.0:1762167002.349326:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24354d500. 00000100:00100000:0.0:1762167002.349383:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2558 00000100:00100000:1.0:1762167002.349396:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2559 00000100:00100000:0.0:1762167002.349404:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451617024:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167002.349424:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2560 00000100:00100000:1.0:1762167002.349426:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451617152:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167002.349443:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451617280:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167002.349801:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.349807:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.349811:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167002.349815:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.349818:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167002.349820:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 119986 -> 135510 00002000:00010000:0.0:1762167002.349825:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.349829:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167002.349834:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167002.349834:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.349838:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00002000:00010000:1.0:1762167002.349842:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.349848:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167002.349851:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.349858:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167002.349870:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451617280:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 434us (659us total) trans 21474843008 rc 0/0 00000100:00100000:3.0:1762167002.349880:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2560 00002000:00010000:3.0:1762167002.349884:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167002.349887:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354ce00 with x1847765451617280 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167002.349894:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354ce00. 00000100:00100000:0.0:1762167002.349901:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451617024:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 502us (766us total) trans 21474843009 rc 0/0 00000100:00100000:1.0:1762167002.349914:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451617152:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 495us (734us total) trans 17179875522 rc 0/0 00000100:00100000:0.0:1762167002.349925:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2558 00002000:00010000:0.0:1762167002.349935:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (135510->18446744073709551615) 00000100:00100000:1.0:1762167002.349942:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2559 00002000:00100000:0.0:1762167002.349943:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354c700 with x1847765451617024 ext(135510->18446744073709551615) 00002000:00010000:1.0:1762167002.349951:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:0.0:1762167002.349953:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354c700. 00002000:00100000:1.0:1762167002.349959:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354d500 with x1847765451617152 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167002.349968:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24354d500. 00000100:00100000:0.0:1762167002.351541:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451617408 00000100:00100000:0.0:1762167002.351548:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451617408 00000100:00100000:0.0:1762167002.351596:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19395 00000100:00100000:0.0:1762167002.351606:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451617408:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167002.351622:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.351639:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08796 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c4f expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.351714:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0879d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.351727:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0879d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.351737:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0879d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.351809:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 135510 00000004:00200000:0.0:1762167002.351814:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167002.351833:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0879d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.351857:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08796 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c4f expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.351874:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0879d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c4f expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.351881:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167002.351884:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.351888:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8000, rc 0) 00000100:00100000:0.0:1762167002.351939:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451617408:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 334us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.351946:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19395 00000100:00100000:1.0:1762167002.355306:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451617536 00000100:00100000:1.0:1762167002.355315:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451617536 00002000:00100000:1.0:1762167002.355359:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (49152->53247) req@ffff9ee35047d180 x1847765451617536/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167002.355370:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047d180 with x1847765451617536 ext(49152->53247) 00002000:00010000:1.0:1762167002.355376:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047d180 00000100:00100000:1.0:1762167002.355411:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2561 00000100:00100000:1.0:1762167002.355430:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451617536:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:1.0:1762167002.355663:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451617536:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 230us (451us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762167002.355671:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2561 00002000:00100000:1.0:1762167002.355680:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (49152->53247) req@ffff9ee35047d180 x1847765451617536/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/4536 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167002.355689:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047d180 with x1847765451617536 ext(49152->53247) 00002000:00010000:1.0:1762167002.355693:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047d180 00000100:00100000:0.0:1762167002.358007:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.358095:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451617664 00000100:00100000:1.0:1762167002.358105:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451617664 00002000:00100000:1.0:1762167002.358150:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (53248->57343) req@ffff9ee346aabb80 x1847765451617664/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167002.358162:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aabb80 with x1847765451617664 ext(53248->57343) 00002000:00010000:1.0:1762167002.358167:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aabb80 00000100:00100000:1.0:1762167002.358195:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2562 00000100:00100000:1.0:1762167002.358207:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451617664:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:1.0:1762167002.358399:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451617664:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 194us (401us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762167002.358407:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2562 00002000:00100000:1.0:1762167002.358425:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (53248->57343) req@ffff9ee346aabb80 x1847765451617664/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/4536 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167002.358435:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aabb80 with x1847765451617664 ext(53248->57343) 00002000:00010000:1.0:1762167002.358439:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aabb80 00000100:00100000:1.0:1762167002.360663:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451617792 00000100:00100000:1.0:1762167002.360672:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451617792 00002000:00100000:1.0:1762167002.360713:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (28672->94207) req@ffff9ee35047f100 x1847765451617792/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 504/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167002.360724:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047f100 with x1847765451617792 ext(28672->94207) 00002000:00010000:1.0:1762167002.360735:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047f100 00000100:00100000:1.0:1762167002.360790:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2563 00000100:00100000:1.0:1762167002.360801:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451617792:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167002.362476:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451617792:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1670us (1904us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1762167002.362489:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2563 00002000:00100000:0.0:1762167002.362500:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (28672->94207) req@ffff9ee35047f100 x1847765451617792/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 504/440 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.362510:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047f100 with x1847765451617792 ext(28672->94207) 00002000:00010000:0.0:1762167002.362515:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047f100 00000100:00100000:0.0:1762167002.365903:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.365982:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451617920 00000100:00100000:1.0:1762167002.365993:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451617920 00002000:00100000:1.0:1762167002.366042:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (94208->131071) req@ffff9ee346aaaa00 x1847765451617920/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167002.366055:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aaaa00 with x1847765451617920 ext(94208->131071) 00002000:00010000:1.0:1762167002.366060:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aaaa00 00000100:00100000:1.0:1762167002.366097:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2564 00000100:00100000:1.0:1762167002.366107:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451617920:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:1.0:1762167002.367862:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451617920:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1748us (1960us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1762167002.367875:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2564 00002000:00100000:1.0:1762167002.367887:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (94208->131071) req@ffff9ee346aaaa00 x1847765451617920/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/440 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 36864/36864 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167002.367898:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aaaa00 with x1847765451617920 ext(94208->131071) 00002000:00010000:1.0:1762167002.367904:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aaaa00 00000100:00100000:1.0:1762167002.370601:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451618048 00000100:00100000:1.0:1762167002.370612:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451618048 00002000:00100000:1.0:1762167002.370657:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (49152->110591) req@ffff9ee35047ca80 x1847765451618048/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167002.370668:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047ca80 with x1847765451618048 ext(49152->110591) 00002000:00010000:1.0:1762167002.370675:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047ca80 00000100:00100000:1.0:1762167002.370713:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2565 00000100:00100000:1.0:1762167002.370722:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451618048:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:1.0:1762167002.373318:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451618048:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 2588us (2811us total) trans 21474843010 rc 0/0 00000100:00100000:1.0:1762167002.373337:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2565 00002000:00100000:1.0:1762167002.373356:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (49152->110591) req@ffff9ee35047ca80 x1847765451618048/t21474843010(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/448 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167002.373367:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047ca80 with x1847765451618048 ext(49152->110591) 00002000:00010000:1.0:1762167002.373373:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047ca80 00000100:00100000:3.0:1762167002.374873:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451618176 00000100:00100000:3.0:1762167002.374882:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451618176 00000100:00100000:3.0:1762167002.374936:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16249 00000100:00100000:3.0:1762167002.374946:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451618176:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:3.0:1762167002.391868:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843009 is committed 00000001:00080000:3.0:1762167002.391887:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843003 is committed 00000001:00080000:0.0:1762167002.391967:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843010 is committed 00000001:00080000:0.0:1762167002.392023:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843005 is committed 00000100:00100000:0.0:1762167002.392151:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451618176:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 17201us (17339us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.392164:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16249 00000100:00100000:0.0:1762167002.396813:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451618432 00000100:00100000:0.0:1762167002.396823:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451618432 00000100:00100000:0.0:1762167002.396886:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19396 00000100:00100000:0.0:1762167002.396895:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451618432:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167002.396950:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.396976:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0879d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c4f expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.396996:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167002.397001:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167002.397207:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.397245:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.397261:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:0.0:1762167002.397314:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952445 00000004:00010000:0.0:1762167002.397352:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000baab3b2b reply state 00000000057df341 transno 8589952446 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167002.397361:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167002.397466:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451618432:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 571us (746us total) trans 8589952446 rc 0/0 00000100:00100000:0.0:1762167002.397472:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19396 00000020:00080000:0.0:1762167002.397478:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167002.399002:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.399017:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.399025:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.399031:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.399036:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.399042:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.399062:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167002.399066:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.399237:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.399245:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087a4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167002.399735:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451618560 00000100:00100000:1.0:1762167002.399745:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451618560 00002000:00010000:1.0:1762167002.399804:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (258129->18446744073709551615) 00002000:00100000:1.0:1762167002.399813:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047c000 with x1847765451618560 ext(258129->18446744073709551615) 00000100:00100000:0.0:1762167002.399814:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451618688 00000100:00100000:0.0:1762167002.399821:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451618688 00002000:00010000:1.0:1762167002.399828:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047c000. 00000100:00100000:1.0:1762167002.399847:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451618816 00000100:00100000:1.0:1762167002.399851:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451618816 00002000:00010000:0.0:1762167002.399853:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167002.399858:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047f480 with x1847765451618688 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167002.399865:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:0.0:1762167002.399867:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee35047f480. 00002000:00100000:1.0:1762167002.399871:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047e300 with x1847765451618816 ext(0->18446744073709551615) 00000100:00100000:3.0:1762167002.399882:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2566 00002000:00010000:1.0:1762167002.399890:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047e300. 00000100:00100000:3.0:1762167002.399897:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451618560:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167002.399905:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2567 00000100:00100000:0.0:1762167002.399917:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451618688:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167002.399921:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2568 00000100:00100000:1.0:1762167002.399934:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451618816:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167002.400215:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 135510 -> 258129 00002000:00010000:3.0:1762167002.400219:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.400222:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167002.400224:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.400226:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 235 00002000:00010000:0.0:1762167002.400257:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167002.400262:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.400264:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:0.0:1762167002.400267:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.400269:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167002.400285:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451618560:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 392us (642us total) trans 21474843011 rc 0/0 00002000:00010000:1.0:1762167002.400289:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167002.400296:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.400300:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00000100:00100000:3.0:1762167002.400304:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2566 00002000:00010000:1.0:1762167002.400305:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.400310:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167002.400311:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (258129->18446744073709551615) 00002000:00100000:3.0:1762167002.400315:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047c000 with x1847765451618560 ext(258129->18446744073709551615) 00002000:00010000:3.0:1762167002.400321:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047c000. 00000100:00100000:1.0:1762167002.400339:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451618816:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 406us (624us total) trans 21474843012 rc 0/0 00000100:00100000:1.0:1762167002.400351:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2568 00002000:00010000:1.0:1762167002.400355:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167002.400358:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047e300 with x1847765451618816 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167002.400362:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047e300. 00000100:00100000:0.0:1762167002.400452:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451618688:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 538us (767us total) trans 17179875523 rc 0/0 00000100:00100000:0.0:1762167002.400460:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2567 00002000:00010000:0.0:1762167002.400464:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167002.400467:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047f480 with x1847765451618688 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167002.400472:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee35047f480. 00000100:00100000:0.0:1762167002.402960:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451618944 00000100:00100000:0.0:1762167002.402969:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451618944 00002000:00100000:0.0:1762167002.403011:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (212992->262143) req@ffff9ee35047e680 x1847765451618944/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.403021:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047e680 with x1847765451618944 ext(212992->262143) 00002000:00010000:0.0:1762167002.403026:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047e680 00000100:00100000:0.0:1762167002.403058:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2569 00000100:00100000:0.0:1762167002.403067:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451618944:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167002.404835:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451618944:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1761us (1942us total) trans 0 rc 49152/49152 00000100:00100000:0.0:1762167002.404847:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2569 00002000:00100000:0.0:1762167002.404858:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (212992->262143) req@ffff9ee35047e680 x1847765451618944/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/440 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 49152/49152 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.404867:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047e680 with x1847765451618944 ext(212992->262143) 00002000:00010000:0.0:1762167002.404871:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047e680 00000100:00100000:0.0:1762167002.408813:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451619072 00000100:00100000:0.0:1762167002.408823:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451619072 00002000:00100000:0.0:1762167002.408867:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (241664->258128) req@ffff9ee35047ce00 x1847765451619072/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.408878:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047ce00 with x1847765451619072 ext(241664->258128) 00002000:00010000:0.0:1762167002.408883:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047ce00 00000100:00100000:0.0:1762167002.408917:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2570 00000100:00100000:0.0:1762167002.408928:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451619072:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:0.0:1762167002.410732:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451619072:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 1799us (2042us total) trans 21474843013 rc 0/0 00000100:00100000:0.0:1762167002.410745:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2570 00002000:00100000:0.0:1762167002.410757:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (241664->258128) req@ffff9ee35047ce00 x1847765451619072/t21474843013(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/448 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.410805:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047ce00 with x1847765451619072 ext(241664->258128) 00002000:00010000:0.0:1762167002.410811:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047ce00 00000100:00100000:3.0:1762167002.412156:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.412246:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451619200 00000100:00100000:0.0:1762167002.412254:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451619200 00000100:00100000:0.0:1762167002.412310:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16250 00000100:00100000:0.0:1762167002.412321:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451619200:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:0.0:1762167002.425577:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843013 is committed 00000100:00100000:0.0:1762167002.425696:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2359:x1847765451619200:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 13372us (13539us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.425709:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16250 00000100:00100000:0.0:1762167002.427508:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451619328 00000100:00100000:0.0:1762167002.427519:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451619328 00000100:00100000:0.0:1762167002.427577:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19397 00000100:00100000:0.0:1762167002.427587:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451619328:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167002.427609:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.427629:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c56 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.427705:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.427719:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.427730:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.427759:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00000004:00200000:0.0:1762167002.427799:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167002.427819:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.427845:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c56 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.427862:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c56 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.427870:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167002.427873:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.427877:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8000, rc 0) 00000100:00100000:0.0:1762167002.427930:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451619328:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 343us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.427937:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19397 00000100:00100000:1.0:1762167002.432545:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451619584 00000100:00100000:1.0:1762167002.432556:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451619584 00000100:00100000:1.0:1762167002.432614:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7196 00000100:00100000:1.0:1762167002.432624:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451619584:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167002.432992:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451619584:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 369us (561us total) trans 8589952447 rc 0/0 00000100:00100000:1.0:1762167002.433000:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7196 00000100:00100000:3.0:1762167002.443092:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.443193:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451619840 00000100:00100000:0.0:1762167002.443206:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451619840 00000100:00100000:0.0:1762167002.443263:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19398 00000100:00100000:0.0:1762167002.443270:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56166:x1847765451619840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.443291:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.443306:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c5d expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.443367:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087c0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443384:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443394:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443409:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d087c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443426:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d087c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443433:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d087c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443558:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d087ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443567:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d087ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443574:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d087ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.443583:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00010000:00010000:0.0:1762167002.443676:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443683:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087c0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443689:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443698:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.443703:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443710:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087c0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443720:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167002.443723:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.443727:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087c0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443733:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087c0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443746:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d087c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443752:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d087c7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443758:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d087c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443833:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.443836:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d087c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443841:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d087c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443849:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167002.443852:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.443855:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d087c7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443860:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d087c7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.443899:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d087b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c5d expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.443912:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d087ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c5d expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.443919:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167002.443921:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.443924:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9a00, rc 0) 00000100:00100000:0.0:1762167002.443995:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56166:x1847765451619840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 724us (916us total) trans 8589952448 rc 0/0 00000100:00100000:0.0:1762167002.444002:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19398 00000100:00100000:3.0:1762167002.445729:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.445807:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451619968 00000100:00100000:1.0:1762167002.445814:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451619968 00000100:00100000:1.0:1762167002.445876:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 608 00000100:00100000:1.0:1762167002.445887:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451619968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.445901:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.445918:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d087ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c5d expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.445931:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:1.0:1762167002.445934:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.445976:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451619968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.445984:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 608 00000100:00100000:3.0:1762167002.446188:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.447680:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.447730:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451620480 00000100:00100000:0.0:1762167002.447737:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451620480 00000100:00100000:0.0:1762167002.447806:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19399 00000100:00100000:0.0:1762167002.447817:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56166:x1847765451620480:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.447835:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.447853:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d087dc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c64 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.447938:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d087e3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.447957:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d087e3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.447966:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d087e3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.447975:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00010000:00010000:0.0:1762167002.448076:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d087dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c64 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.448094:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d087e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c64 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.448103:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167002.448107:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762167002.448110:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:0.0:1762167002.448159:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56166:x1847765451620480:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 344us (482us total) trans 8589952450 rc 0/0 00000100:00100000:0.0:1762167002.448166:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19399 00000100:00100000:3.0:1762167002.450270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.450319:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451620736 00000100:00100000:0.0:1762167002.450332:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451620736 00000100:00100000:0.0:1762167002.450386:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19400 00000100:00100000:0.0:1762167002.450397:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56166:x1847765451620736:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.450427:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.450444:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087f1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c6b expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.450534:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d087f8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.450548:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c56 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.450554:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d087f8 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.450579:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c56 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.450588:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c56 expref: 901 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.450598:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454345728:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167002.450658:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242543c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.451865:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454345728:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167002.451885:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167002.451890:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d087f8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167002.451967:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451620864 00000100:00100000:1.0:1762167002.451973:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451620864 00010000:00010000:1.0:1762167002.451999:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c56 expref: 902 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.452028:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7239 00000100:00100000:1.0:1762167002.452034:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2360:x1847765451620864:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.452052:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.452058:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c56 expref: 902 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.452069:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c56 expref: 902 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.452090:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d087b2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c56 expref: 902 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.452106:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:1.0:1762167002.452109:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d087f8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.452117:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d087f8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.452123:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d087f8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.452147:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167002.452163:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d087f8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.452177:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d087f8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167002.452191:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:2360:x1847765451620864:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 154us (306us total) trans 0 rc 0/0 00000004:00200000:0.0:1762167002.452192:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00000100:00100000:1.0:1762167002.452202:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7239 00010000:00010000:0.0:1762167002.452344:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d087f1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c6b expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.452361:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d087f8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c6b expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.452369:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167002.452372:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167002.452374:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:0.0:1762167002.452410:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56166:x1847765451620736:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2015us (2148us total) trans 8589952451 rc 0/0 00000100:00100000:0.0:1762167002.452430:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19400 00000100:00100000:3.0:1762167002.453575:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.454908:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.456822:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.456908:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451621504 00000100:00100000:0.0:1762167002.456916:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451621504 00000100:00100000:0.0:1762167002.456962:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19401 00000100:00100000:0.0:1762167002.456971:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56166:x1847765451621504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.456991:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.456994:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762167002.457017:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d087f8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c6b expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.457036:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d087e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c64 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.457047:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167002.457051:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167002.457061:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08806 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c72 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.457145:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0880d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.457158:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0880d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.457167:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0880d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.457177:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00010000:00010000:0.0:1762167002.457285:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08806 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c72 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.457298:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0880d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c72 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.457304:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167002.457307:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167002.457309:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9400, rc 0) 00000100:00100000:0.0:1762167002.457363:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56166:x1847765451621504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 393us (548us total) trans 8589952453 rc 0/0 00000100:00100000:0.0:1762167002.457371:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19401 00000100:00100000:3.0:1762167002.459041:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.461107:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.461183:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451621888 00000100:00100000:1.0:1762167002.461194:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451621888 00010000:00010000:1.0:1762167002.461229:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0878f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c48 expref: 903 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.461270:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7240 00000100:00100000:1.0:1762167002.461279:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2360:x1847765451621888:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.461294:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.461300:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0878f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c48 expref: 903 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.461312:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0878f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c48 expref: 903 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.461330:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0878f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c48 expref: 903 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.461346:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:1.0:1762167002.461351:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0881b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167002.461359:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0881b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167002.461366:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0881b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167002.461396:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.461457:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2360:x1847765451621888:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 179us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.461470:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7240 00000100:00100000:3.0:1762167002.463441:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.463493:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451622016 00000100:00100000:0.0:1762167002.463502:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451622016 00000100:00100000:0.0:1762167002.463551:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19402 00000100:00100000:0.0:1762167002.463562:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56166:x1847765451622016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.463582:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.463602:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08822 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c79 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.463651:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08822 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c79 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.463664:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08822 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c79 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.463682:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167002.463685:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167002.463689:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:0.0:1762167002.463735:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56166:x1847765451622016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.463741:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19402 00000100:00100000:3.0:1762167002.465738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.465820:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451622272 00000100:00100000:0.0:1762167002.465829:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451622272 00000100:00100000:0.0:1762167002.465890:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19403 00000100:00100000:0.0:1762167002.465903:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56166:x1847765451622272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.465919:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.465937:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08829 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c80 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.466472:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08830 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x63e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.466485:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08830 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.466495:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08830 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.466504:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x63e:0x0]: returning size 0 00010000:00010000:0.0:1762167002.466548:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08829 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c80 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.466566:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08830 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c80 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.466574:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63e:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167002.466577:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.466580:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9a00, rc 0) 00000100:00100000:0.0:1762167002.466638:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56166:x1847765451622272:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 738us (910us total) trans 8589952455 rc 0/0 00000100:00100000:0.0:1762167002.466645:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19403 00000100:00100000:3.0:1762167002.468390:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.468448:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451622528 00000100:00100000:0.0:1762167002.468455:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451622528 00000100:00100000:0.0:1762167002.468495:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19404 00000100:00100000:0.0:1762167002.468501:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56166:x1847765451622528:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.468518:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.468531:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0883e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c87 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.468596:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08845 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.468605:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08845 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.468612:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08845 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.468621:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00010000:00010000:0.0:1762167002.468708:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0883e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c87 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.468725:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08845 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c87 expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.468733:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167002.468736:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167002.468740:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8e00, rc 0) 00000100:00100000:0.0:1762167002.468821:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56166:x1847765451622528:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 318us (437us total) trans 8589952456 rc 0/0 00000100:00100000:0.0:1762167002.468828:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19404 00000100:00100000:3.0:1762167002.470225:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.472347:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.472424:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451622912 00000100:00100000:1.0:1762167002.472432:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451622912 00010000:00010000:1.0:1762167002.472467:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08822 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c79 expref: 907 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.472509:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7241 00000100:00100000:1.0:1762167002.472523:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:2360:x1847765451622912:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.472535:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.472546:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08822 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c79 expref: 907 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.472560:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08822 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c79 expref: 907 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.472579:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08822 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c79 expref: 907 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.472595:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:1.0:1762167002.472600:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08853 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167002.472608:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08853 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167002.472615:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08853 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167002.472636:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.472673:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2360:x1847765451622912:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.472689:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7241 00000100:00100000:3.0:1762167002.474250:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.474324:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451623040 00000100:00100000:1.0:1762167002.474331:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451623040 00010000:00010000:1.0:1762167002.474358:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08830 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x63e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c80 expref: 906 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.474395:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7242 00000100:00100000:1.0:1762167002.474404:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2360:x1847765451623040:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.474426:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.474433:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08830 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x63e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c80 expref: 906 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.474444:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08830 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c80 expref: 906 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.474461:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08830 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x63e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c80 expref: 906 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.474476:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63e:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:1.0:1762167002.474481:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0885a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167002.474492:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0885a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167002.474498:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0885a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x63e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167002.474524:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.474567:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2360:x1847765451623040:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 164us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.474576:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7242 00000100:00100000:3.0:1762167002.475164:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346240:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.475196:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.475217:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2ee0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167002.475357:0:33886:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843005 gen 2 00000004:00080000:3.0:1762167002.475363:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa9b100, transno 21474842992 00000004:00080000:3.0:1762167002.475375:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354e300, transno 21474842993 00000004:00080000:3.0:1762167002.475377:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa98380, transno 21474842994 00000004:00080000:3.0:1762167002.475379:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354f480, transno 21474842995 00000004:00080000:3.0:1762167002.475381:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa98000, transno 21474842996 00000004:00080000:3.0:1762167002.475383:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa9a680, transno 21474842997 00000004:00080000:3.0:1762167002.475386:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa99880, transno 21474842998 00000004:00080000:3.0:1762167002.475389:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550d500, transno 21474842999 00000004:00080000:3.0:1762167002.475391:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550e680, transno 21474843000 00000004:00080000:3.0:1762167002.475395:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550d180, transno 21474843001 00000004:00080000:3.0:1762167002.475398:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550f800, transno 21474843002 00000004:00080000:3.0:1762167002.475402:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550ce00, transno 21474843003 00000004:00080000:3.0:1762167002.475405:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550c700, transno 21474843004 00000004:00080000:3.0:1762167002.475408:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550ea00, transno 21474843005 00000100:00100000:3.0:1762167002.475422:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346240:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.475459:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346368:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.475479:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.475507:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2ee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.475518:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454346368 00000100:00100000:0.0:1762167002.475524:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454346368 00000100:00100000:0.0:1762167002.475562:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1762167002.475570:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454346368:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167002.475641:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454346368:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 72us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.475650:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1762167002.475673:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346368:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.475728:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346496:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.475754:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.475807:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36f2eea80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.475826:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454346496 00000100:00100000:0.0:1762167002.475831:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454346496 00000100:00100000:0.0:1762167002.475862:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1762167002.475870:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454346496:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167002.475926:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454346496:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 57us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.475932:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1762167002.475960:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346496:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.475990:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346624:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.476012:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.476031:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.476051:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454346624 00000100:00100000:0.0:1762167002.476056:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454346624 00000100:00100000:0.0:1762167002.476085:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1762167002.476091:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454346624:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167002.476147:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454346624:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 55us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.476154:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1762167002.476172:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346624:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.476208:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346752:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.476238:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.476255:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c36e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.476272:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454346752 00000100:00100000:0.0:1762167002.476277:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454346752 00000100:00100000:0.0:1762167002.476305:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1762167002.476311:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454346752:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167002.476360:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454346752:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.476371:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1762167002.476376:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346752:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.476404:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346880:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.476436:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.476451:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3780 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.476457:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454346880 00000100:00100000:0.0:1762167002.476462:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454346880 00000100:00100000:0.0:1762167002.476492:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1762167002.476499:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454346880:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167002.476552:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454346880:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 53us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.476559:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1762167002.476564:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454346880:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.476597:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454347008:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.476617:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.476637:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3780 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.476657:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454347008 00000100:00100000:0.0:1762167002.476663:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454347008 00000100:00100000:0.0:1762167002.476693:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1762167002.476700:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454347008:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167002.476792:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454347008:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 61us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.476799:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454347008:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167002.476804:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1762167002.476836:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454347136:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.476860:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.476884:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454347136 00000100:00100000:3.0:1762167002.476885:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.476890:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454347136 00000100:00100000:1.0:1762167002.476936:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1762167002.476943:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454347136:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.476995:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454347136:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 54us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.477002:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1762167002.477165:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454347264 00000100:00100000:1.0:1762167002.477168:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454347264 00000100:00100000:1.0:1762167002.477191:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1762167002.477197:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454347264:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.477240:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454347264:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.477247:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1762167002.477351:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454347392 00000100:00100000:1.0:1762167002.477355:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454347392 00000100:00100000:1.0:1762167002.477399:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1762167002.477407:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454347392:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.477466:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454347392:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 60us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.477472:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1762167002.477677:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454347520 00000100:00100000:1.0:1762167002.477681:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454347520 00000100:00100000:1.0:1762167002.477709:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1762167002.477715:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454347520:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.477796:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454347520:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 80us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.477803:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1762167002.477895:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454347648 00000100:00100000:1.0:1762167002.477899:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454347648 00000100:00100000:1.0:1762167002.477922:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1762167002.477928:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454347648:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.477973:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454347648:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 44us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.477980:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1762167002.478391:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454347776 00000100:00100000:1.0:1762167002.478396:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454347776 00000100:00100000:1.0:1762167002.478437:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1762167002.478445:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454347776:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.478709:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454347776:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 264us (375us total) trans 21474843014 rc 0/0 00000100:00100000:1.0:1762167002.478717:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1762167002.478969:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454347904 00000100:00100000:1.0:1762167002.478975:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454347904 00000100:00100000:1.0:1762167002.479006:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1762167002.479013:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454347904:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.479169:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:33886:x1847765454347904:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 156us (324us total) trans 17179875524 rc 0/0 00000100:00100000:1.0:1762167002.479180:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1762167002.480806:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.480851:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451623168 00000100:00100000:0.0:1762167002.480859:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451623168 00000100:00100000:0.0:1762167002.480913:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19405 00000100:00100000:0.0:1762167002.480922:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56166:x1847765451623168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.480945:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.480965:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08861 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c8e expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.481016:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08861 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c8e expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.481030:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08861 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c8e expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.481046:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.481048:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167002.481052:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8600, rc 0) 00000100:00100000:0.0:1762167002.481094:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56166:x1847765451623168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 174us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.481098:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19405 00000100:00100000:3.0:1762167002.482950:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167002.483999:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167002.484007:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08868 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.484016:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167002.484020:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08868 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.484033:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08868 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.484046:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63e:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:3.0:1762167002.484050:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762167002.484054:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08868 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x63e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.484060:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08868 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x63e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.484075:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167002.484077:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167002.484079:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167002.485273:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.495732:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.495800:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451623808 00000100:00100000:1.0:1762167002.495811:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451623808 00000100:00100000:1.0:1762167002.495868:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19406 00000100:00100000:1.0:1762167002.495879:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:56167:x1847765451623808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.495901:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.495920:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0886f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c95 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.495978:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08876 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.495990:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08876 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496000:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08876 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496011:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0887d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496018:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0887d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496029:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0887d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496123:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496131:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496139:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.496170:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00000004:00200000:1.0:1762167002.496174:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167002.496190:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496202:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496210:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08876 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496216:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08876 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496222:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08876 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496227:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167002.496230:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08876 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496238:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08876 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496248:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:1.0:1762167002.496251:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167002.496255:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08876 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496261:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08876 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496275:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0887d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496285:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0887d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496290:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0887d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496295:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167002.496298:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0887d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496303:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0887d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496310:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee345a77200) 00010000:00010000:1.0:1762167002.496312:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167002.496315:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0887d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496320:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0887d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.496352:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0886f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c95 expref: 912 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.496364:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c95 expref: 911 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.496371:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:1.0:1762167002.496373:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167002.496376:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a200, rc 0) 00000100:00100000:1.0:1762167002.496447:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56167:x1847765451623808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 570us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.496455:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19406 00000100:00100000:3.0:1762167002.498629:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.498687:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451624064 00000100:00100000:1.0:1762167002.498697:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451624064 00000100:00100000:1.0:1762167002.498752:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19407 00000100:00100000:1.0:1762167002.498787:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56167:x1847765451624064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.498804:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.498822:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0888b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2c9c expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.498925:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.498938:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.498947:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.498957:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00010000:00010000:1.0:1762167002.499068:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0888b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c9c expref: 914 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.499086:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c9c expref: 913 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.499095:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:1.0:1762167002.499098:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762167002.499101:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7bc00, rc 0) 00000100:00100000:1.0:1762167002.499155:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56167:x1847765451624064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 394us (536us total) trans 8589952463 rc 0/0 00000100:00100000:1.0:1762167002.499162:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19407 00000100:00100000:3.0:1762167002.500753:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.500908:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451624320 00000100:00100000:1.0:1762167002.500917:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451624320 00000100:00100000:1.0:1762167002.500960:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19408 00000100:00100000:1.0:1762167002.500970:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56167:x1847765451624320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.500989:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.501010:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088a0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ca3 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.501080:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d088a7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.501092:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d088a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.501102:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d088a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.501115:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00010000:00010000:1.0:1762167002.501201:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088a0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ca3 expref: 916 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.501213:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d088a7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ca3 expref: 915 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.501219:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:1.0:1762167002.501222:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167002.501224:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ae00, rc 0) 00000100:00100000:1.0:1762167002.501262:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56167:x1847765451624320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 296us (516us total) trans 8589952464 rc 0/0 00000100:00100000:1.0:1762167002.501267:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19408 00000100:00100000:0.0:1762167002.503188:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.503261:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451624448 00000100:00100000:1.0:1762167002.503268:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451624448 00000100:00100000:1.0:1762167002.503316:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 609 00000100:00100000:1.0:1762167002.503322:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56167:x1847765451624448:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167002.503332:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.503350:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d088a7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ca3 expref: 915 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.503364:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:1.0:1762167002.503367:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.503410:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56167:x1847765451624448:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.503428:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 609 00000100:00100000:3.0:1762167002.504491:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.507066:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.507120:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451624960 00000100:00100000:1.0:1762167002.507130:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451624960 00000100:00100000:1.0:1762167002.507189:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19409 00000100:00100000:1.0:1762167002.507199:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56065:x1847765451624960:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167002.507220:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.507237:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d088b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2caa expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.507340:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.507356:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c95 expref: 916 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.507364:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.507395:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c95 expref: 916 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.507408:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c95 expref: 916 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.507434:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454348032:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.507506:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.509309:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454348032:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167002.509318:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167002.509338:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.509431:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451625088 00000100:00100000:3.0:1762167002.509438:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451625088 00010000:00010000:3.0:1762167002.509473:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c95 expref: 917 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.509515:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7243 00000100:00100000:3.0:1762167002.509526:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:2360:x1847765451625088:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.509540:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.509547:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c95 expref: 917 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.509566:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c95 expref: 917 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.509587:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08884 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c95 expref: 917 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.509603:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167002.509608:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.509617:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.509624:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.509654:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.509690:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.509700:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.509714:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:2360:x1847765451625088:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 188us (406us total) trans 0 rc 0/0 00000004:00200000:1.0:1762167002.509718:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00000100:00100000:3.0:1762167002.509724:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7243 00010000:00010000:1.0:1762167002.509918:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d088b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2caa expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.509935:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2caa expref: 916 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.509943:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:1.0:1762167002.509945:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762167002.509948:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b000, rc 0) 00000100:00100000:1.0:1762167002.509981:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56065:x1847765451624960:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2784us (2923us total) trans 8589952466 rc 0/0 00000100:00100000:1.0:1762167002.509988:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19409 00000100:00100000:0.0:1762167002.511310:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.511354:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451625216 00000100:00100000:1.0:1762167002.511361:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451625216 00000100:00100000:1.0:1762167002.511405:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19410 00000100:00100000:1.0:1762167002.511427:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56065:x1847765451625216:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167002.511447:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.511462:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d088ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2cb1 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.511533:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.511546:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2caa expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.511554:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.511583:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2caa expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.511600:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2caa expref: 917 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.511614:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454348160:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.511699:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.512714:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454348160:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.512733:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167002.512965:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.513013:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451625344 00000100:00100000:3.0:1762167002.513019:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451625344 00010000:00010000:3.0:1762167002.513086:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2caa expref: 918 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.513113:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7244 00000100:00100000:3.0:1762167002.513118:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:2361:x1847765451625344:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.513128:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.513134:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2caa expref: 918 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.513141:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2caa expref: 918 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.513155:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d088bc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2caa expref: 918 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.513167:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167002.513170:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.513177:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.513182:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.513197:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.513223:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.513232:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.513245:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:2361:x1847765451625344:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 125us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.513253:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7244 00000004:00200000:1.0:1762167002.513268:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 258129 00000004:00200000:1.0:1762167002.513273:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167002.513290:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.513326:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d088ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cb1 expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.513341:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cb1 expref: 916 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.513349:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:1.0:1762167002.513351:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167002.513354:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a800, rc 0) 00000100:00100000:1.0:1762167002.513393:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56065:x1847765451625216:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1981us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.513403:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19410 00000100:00100000:0.0:1762167002.515803:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.515834:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451625600 00000100:00100000:1.0:1762167002.515843:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451625600 00000100:00100000:1.0:1762167002.515892:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19411 00000100:00100000:1.0:1762167002.515900:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56065:x1847765451625600:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167002.515940:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.515961:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d088d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cb1 expref: 916 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.515983:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:1.0:1762167002.515987:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.516189:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.516202:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.516210:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:1.0:1762167002.516259:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952467 00000004:00010000:1.0:1762167002.516284:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000072274aa5 reply state 000000001c1a0b31 transno 8589952468 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167002.516293:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167002.516376:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56065:x1847765451625600:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 475us (581us total) trans 8589952468 rc 0/0 00000100:00100000:1.0:1762167002.516381:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19411 00000020:00080000:1.0:1762167002.516385:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167002.517128:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.517139:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.517145:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.517152:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.517157:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.517164:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.517176:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.517179:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.517183:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.517188:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d088d8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167002.517759:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.517813:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.517844:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451625728 00000100:00100000:0.0:1762167002.517851:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.517853:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451625728 00002000:00010000:3.0:1762167002.517887:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (262144->18446744073709551615) 00002000:00100000:3.0:1762167002.517892:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243183100 with x1847765451625728 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762167002.517901:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243183100. 00000100:00100000:3.0:1762167002.517926:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451625856 00000100:00100000:3.0:1762167002.517930:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451625856 00000100:00100000:1.0:1762167002.517942:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451625984 00002000:00010000:3.0:1762167002.517945:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:1.0:1762167002.517948:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451625984 00002000:00100000:3.0:1762167002.517951:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243182680 with x1847765451625856 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167002.517959:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee243182680. 00002000:00010000:1.0:1762167002.517968:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:0.0:1762167002.517978:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2572 00002000:00100000:1.0:1762167002.517984:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243182300 with x1847765451625984 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167002.517994:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451625856:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167002.517996:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243182300. 00000100:00100000:3.0:1762167002.518031:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2573 00000100:00100000:3.0:1762167002.518043:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765451625984:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167002.518265:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.518269:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.518269:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.518277:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:0.0:1762167002.518277:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.518283:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167002.518284:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.518290:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.518291:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167002.518297:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167002.518425:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451625984:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 377us (567us total) trans 21474843015 rc 0/0 00000100:00100000:3.0:1762167002.518434:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2573 00002000:00010000:3.0:1762167002.518438:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167002.518441:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243182300 with x1847765451625984 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167002.518446:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243182300. 00000100:00100000:0.0:1762167002.518513:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451625856:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 366us (540us total) trans 17179875525 rc 0/0 00000100:00100000:0.0:1762167002.518521:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2572 00002000:00010000:0.0:1762167002.518526:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167002.518528:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243182680 with x1847765451625856 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167002.518534:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee243182680. 00000100:00100000:3.0:1762167002.520657:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.520710:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451626112 00000100:00100000:0.0:1762167002.520721:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451626112 00002000:00100000:0.0:1762167002.520793:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (237568->241663) req@ffff9ee2477d1f80 x1847765451626112/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.520805:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d1f80 with x1847765451626112 ext(237568->241663) 00002000:00010000:0.0:1762167002.520812:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d1f80 00000100:00100000:0.0:1762167002.520840:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2574 00000100:00100000:0.0:1762167002.520849:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451626112:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167002.521055:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451626112:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 208us (407us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167002.521061:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2574 00002000:00100000:0.0:1762167002.521066:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (237568->241663) req@ffff9ee2477d1f80 x1847765451626112/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/4536 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.521072:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d1f80 with x1847765451626112 ext(237568->241663) 00002000:00010000:0.0:1762167002.521075:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d1f80 00000100:00100000:1.0:1762167002.523017:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.523137:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451626240 00000100:00100000:0.0:1762167002.523146:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451626240 00002000:00100000:0.0:1762167002.523192:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (241664->245759) req@ffff9ee348255180 x1847765451626240/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.523203:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348255180 with x1847765451626240 ext(241664->245759) 00002000:00010000:0.0:1762167002.523209:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348255180 00000100:00100000:0.0:1762167002.523252:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2575 00000100:00100000:0.0:1762167002.523264:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451626240:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167002.523472:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451626240:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 209us (461us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167002.523480:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2575 00002000:00100000:0.0:1762167002.523487:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (241664->245759) req@ffff9ee348255180 x1847765451626240/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/4536 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.523495:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348255180 with x1847765451626240 ext(241664->245759) 00002000:00010000:0.0:1762167002.523498:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348255180 00000100:00100000:3.0:1762167002.526004:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.526083:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451626368 00000100:00100000:0.0:1762167002.526093:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451626368 00002000:00100000:0.0:1762167002.526139:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (217088->262143) req@ffff9ee2477d1500 x1847765451626368/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 504/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.526150:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d1500 with x1847765451626368 ext(217088->262143) 00002000:00010000:0.0:1762167002.526155:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d1500 00000100:00100000:0.0:1762167002.526186:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2576 00000100:00100000:0.0:1762167002.526197:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451626368:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167002.527646:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451626368:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1448us (1647us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1762167002.527657:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2576 00002000:00100000:0.0:1762167002.527667:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (217088->262143) req@ffff9ee2477d1500 x1847765451626368/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 504/440 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 36864/36864 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.527674:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d1500 with x1847765451626368 ext(217088->262143) 00002000:00010000:0.0:1762167002.527678:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d1500 00000100:00100000:1.0:1762167002.529984:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.530041:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451626496 00000100:00100000:0.0:1762167002.530050:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451626496 00002000:00100000:0.0:1762167002.530084:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (237568->262143) req@ffff9ee348255880 x1847765451626496/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.530091:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348255880 with x1847765451626496 ext(237568->262143) 00002000:00010000:0.0:1762167002.530095:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348255880 00000100:00100000:0.0:1762167002.530125:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2577 00000100:00100000:0.0:1762167002.530134:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451626496:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:0.0:1762167002.531849:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451626496:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 1701us (1858us total) trans 21474843017 rc 0/0 00000100:00100000:0.0:1762167002.531863:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2577 00002000:00100000:0.0:1762167002.531872:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (237568->262143) req@ffff9ee348255880 x1847765451626496/t21474843017(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/448 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.531882:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348255880 with x1847765451626496 ext(237568->262143) 00002000:00010000:0.0:1762167002.531887:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348255880 00000100:00100000:3.0:1762167002.534013:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.534095:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451626624 00000100:00100000:0.0:1762167002.534106:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451626624 00000100:00100000:0.0:1762167002.534161:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16251 00000100:00100000:0.0:1762167002.534171:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451626624:12345-192.168.203.35@tcp:16:fsx.0 00010000:00010000:3.0:1762167002.535897:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1762167002.546979:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843017 is committed 00000001:00080000:1.0:1762167002.547006:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843014 is committed 00000100:00100000:0.0:1762167002.547071:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451626624:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 12897us (13061us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.547082:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16251 00000100:00100000:1.0:1762167002.548833:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.548903:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451626752 00000100:00100000:0.0:1762167002.548912:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451626752 00000100:00100000:0.0:1762167002.548967:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19412 00000100:00100000:0.0:1762167002.548979:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:56065:x1847765451626752:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167002.549003:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.549023:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2cb8 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.549103:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d088e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.549113:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d088e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.549122:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d088e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.549141:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:0.0:1762167002.549144:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167002.549157:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d088e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.549175:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cb8 expref: 919 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.549190:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d088e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cb8 expref: 918 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.549198:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.549201:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.549205:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9800, rc 0) 00000100:00100000:0.0:1762167002.549260:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56065:x1847765451626752:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 283us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.549267:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19412 00000100:00100000:3.0:1762167002.551883:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.551988:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451626880 00000100:00100000:0.0:1762167002.551997:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451626880 00002000:00100000:0.0:1762167002.552043:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->86015) req@ffff9ee2477d1180 x1847765451626880/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.552053:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d1180 with x1847765451626880 ext(69632->86015) 00002000:00010000:0.0:1762167002.552058:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d1180 00000100:00100000:0.0:1762167002.552089:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2578 00000100:00100000:0.0:1762167002.552099:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451626880:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167002.552310:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451626880:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 213us (434us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1762167002.552316:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2578 00002000:00100000:0.0:1762167002.552320:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->86015) req@ffff9ee2477d1180 x1847765451626880/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/16824 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.552326:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d1180 with x1847765451626880 ext(69632->86015) 00002000:00010000:0.0:1762167002.552329:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d1180 00000100:00100000:3.0:1762167002.558258:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.558373:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451627008 00000100:00100000:0.0:1762167002.558384:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451627008 00002000:00100000:0.0:1762167002.558447:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (36864->102399) req@ffff9ee36f330380 x1847765451627008/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 504/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.558459:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f330380 with x1847765451627008 ext(36864->102399) 00002000:00010000:0.0:1762167002.558465:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f330380 00000100:00100000:0.0:1762167002.558497:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2579 00000100:00100000:0.0:1762167002.558508:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451627008:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167002.560619:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451627008:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 2106us (2366us total) trans 0 rc 49152/49152 00000100:00100000:0.0:1762167002.560631:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2579 00002000:00100000:0.0:1762167002.560642:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (36864->102399) req@ffff9ee36f330380 x1847765451627008/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 504/440 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.560653:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f330380 with x1847765451627008 ext(36864->102399) 00002000:00010000:0.0:1762167002.560658:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f330380 00000100:00100000:3.0:1762167002.563703:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.563796:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451627136 00000100:00100000:0.0:1762167002.563806:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451627136 00002000:00100000:0.0:1762167002.563864:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->139263) req@ffff9ee36f330700 x1847765451627136/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.563875:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f330700 with x1847765451627136 ext(102400->139263) 00002000:00010000:0.0:1762167002.563884:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f330700 00000100:00100000:0.0:1762167002.563915:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2580 00000100:00100000:0.0:1762167002.563928:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2359:x1847765451627136:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167002.565458:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2359:x1847765451627136:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1527us (1758us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1762167002.565474:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2580 00002000:00100000:0.0:1762167002.565485:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->139263) req@ffff9ee36f330700 x1847765451627136/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 488/440 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.565495:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f330700 with x1847765451627136 ext(102400->139263) 00002000:00010000:0.0:1762167002.565500:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f330700 00000100:00100000:1.0:1762167002.568742:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.568842:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451627264 00000100:00100000:0.0:1762167002.568851:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451627264 00002000:00100000:0.0:1762167002.568896:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (65536->241663) req@ffff9ee348257480 x1847765451627264/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 504/0 e 0 to 0 dl 1762167013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.568913:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348257480 with x1847765451627264 ext(65536->241663) 00002000:00010000:0.0:1762167002.568920:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348257480 00000100:00100000:0.0:1762167002.568956:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2581 00000100:00100000:0.0:1762167002.568966:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451627264:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:0.0:1762167002.571858:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451627264:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 2793us (3022us total) trans 21474843018 rc 0/0 00000100:00100000:0.0:1762167002.571874:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2581 00002000:00100000:0.0:1762167002.571887:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (65536->241663) req@ffff9ee348257480 x1847765451627264/t21474843018(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:33/0 lens 504/448 e 0 to 0 dl 1762167013 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167002.571898:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348257480 with x1847765451627264 ext(65536->241663) 00002000:00010000:0.0:1762167002.571904:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348257480 00000100:00100000:3.0:1762167002.573311:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.573391:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451627392 00000100:00100000:0.0:1762167002.573400:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451627392 00000100:00100000:0.0:1762167002.573476:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16252 00000100:00100000:0.0:1762167002.573491:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451627392:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167002.586070:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843018 is committed 00000100:00100000:0.0:1762167002.586186:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451627392:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 12693us (12875us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.586196:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16252 00000100:00100000:3.0:1762167002.588850:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.588902:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451627648 00000100:00100000:0.0:1762167002.588912:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451627648 00000100:00100000:0.0:1762167002.588964:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19413 00000100:00100000:0.0:1762167002.588975:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56065:x1847765451627648:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167002.589021:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.589044:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d088e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cb8 expref: 918 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.589060:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.589063:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167002.589257:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.589270:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.589279:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:0.0:1762167002.589332:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952469 00000004:00010000:0.0:1762167002.589358:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000484fbd64 reply state 00000000a9f492dd transno 8589952470 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167002.589366:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167002.589470:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56065:x1847765451627648:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 496us (640us total) trans 8589952470 rc 0/0 00000100:00100000:0.0:1762167002.589478:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19413 00000020:00080000:0.0:1762167002.589482:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167002.590651:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.590663:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.590671:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.590676:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.590681:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.590688:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.590701:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.590704:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.590708:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.590713:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d088ed lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.591289:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.591323:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.591446:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451627776 00000100:00100000:0.0:1762167002.591456:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451627776 00000100:00100000:3.0:1762167002.591466:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:0.0:1762167002.591494:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (235850->18446744073709551615) 00002000:00100000:0.0:1762167002.591502:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f332d80 with x1847765451627776 ext(235850->18446744073709551615) 00002000:00010000:0.0:1762167002.591514:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f332d80. 00000100:00100000:1.0:1762167002.591523:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451628032 00000100:00100000:1.0:1762167002.591530:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451628032 00000100:00100000:0.0:1762167002.591548:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2582 00002000:00010000:1.0:1762167002.591549:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167002.591555:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f331f80 with x1847765451628032 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167002.591563:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f331f80. 00000100:00100000:0.0:1762167002.591565:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451627776:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167002.591597:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2584 00000100:00100000:3.0:1762167002.591608:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451628032:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167002.591917:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.591920:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.591922:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167002.591925:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.591928:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167002.591954:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451628032:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 350us (489us total) trans 21474843019 rc 0/0 00000100:00100000:3.0:1762167002.591962:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2584 00002000:00010000:3.0:1762167002.591965:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167002.591968:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f331f80 with x1847765451628032 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167002.591973:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f331f80. 00002000:00010000:0.0:1762167002.591996:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 262144 -> 235850 00002000:00010000:0.0:1762167002.592001:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.592004:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167001 -> 1762167002 00002000:00010000:0.0:1762167002.592006:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.592009:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 275 -> 309 00000100:00100000:0.0:1762167002.592053:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451627776:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 493us (768us total) trans 21474843020 rc 0/0 00000100:00100000:0.0:1762167002.592060:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2582 00002000:00010000:0.0:1762167002.592064:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (235850->18446744073709551615) 00002000:00100000:0.0:1762167002.592067:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f332d80 with x1847765451627776 ext(235850->18446744073709551615) 00002000:00010000:0.0:1762167002.592071:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f332d80. 00000100:00100000:3.0:1762167002.593356:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.593412:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451628160 00000100:00100000:0.0:1762167002.593431:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451628160 00000100:00100000:0.0:1762167002.593476:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19414 00000100:00100000:0.0:1762167002.593485:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:56065:x1847765451628160:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167002.593504:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.593521:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d088f4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2cbf expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.593587:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d088fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.593600:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d088fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.593611:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d088fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.593632:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 235850 00000004:00200000:0.0:1762167002.593636:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167002.593649:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d088fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.593671:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d088f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cbf expref: 921 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.593687:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d088fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cbf expref: 920 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.593701:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.593704:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.593707:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9000, rc 0) 00000100:00100000:0.0:1762167002.593750:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56065:x1847765451628160:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 266us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.593757:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19414 00000100:00100000:1.0:1762167002.596067:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.596133:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451628416 00000100:00100000:0.0:1762167002.596141:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451628416 00000100:00100000:0.0:1762167002.596193:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19415 00000100:00100000:0.0:1762167002.596202:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56065:x1847765451628416:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167002.596258:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.596286:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d088fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cbf expref: 920 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.596304:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.596308:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167002.596558:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.596572:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.596581:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:0.0:1762167002.596634:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952471 00000004:00010000:0.0:1762167002.596659:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008251fc78 reply state 000000005c55f408 transno 8589952472 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167002.596672:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167002.596785:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:56065:x1847765451628416:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 559us (703us total) trans 8589952472 rc 0/0 00000100:00100000:0.0:1762167002.596793:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19415 00000020:00080000:0.0:1762167002.596797:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167002.597730:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.597742:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.597750:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.597755:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.597759:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.597794:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.597807:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.597811:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.597815:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.597821:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08902 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167002.598576:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.598615:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.598647:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.598662:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451628544 00000100:00100000:0.0:1762167002.598672:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451628544 00000100:00100000:3.0:1762167002.598701:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451628672 00002000:00010000:0.0:1762167002.598704:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (72042->18446744073709551615) 00000100:00100000:3.0:1762167002.598709:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451628672 00002000:00100000:0.0:1762167002.598716:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348254a80 with x1847765451628544 ext(72042->18446744073709551615) 00002000:00010000:0.0:1762167002.598728:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348254a80. 00002000:00010000:3.0:1762167002.598733:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167002.598739:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348256300 with x1847765451628672 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167002.598749:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee348256300. 00000100:00100000:0.0:1762167002.598794:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2585 00000100:00100000:0.0:1762167002.598806:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451628544:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167002.598812:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2586 00000100:00100000:1.0:1762167002.598824:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2587 00000100:00100000:3.0:1762167002.598826:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451628672:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167002.598851:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451628800:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167002.599103:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.599108:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.599108:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.599112:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167002.599114:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.599117:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.599119:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:3.0:1762167002.599122:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167002.599124:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.599129:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167002.599188:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451628672:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 365us (569us total) trans 17179875527 rc 0/0 00000100:00100000:1.0:1762167002.599189:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451628800:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 351us (540us total) trans 21474843021 rc 0/0 00000100:00100000:3.0:1762167002.599206:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2586 00002000:00010000:3.0:1762167002.599211:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:1.0:1762167002.599215:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2587 00002000:00100000:3.0:1762167002.599216:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348256300 with x1847765451628672 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167002.599222:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:3.0:1762167002.599225:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee348256300. 00002000:00100000:1.0:1762167002.599227:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348257800 with x1847765451628800 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167002.599235:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348257800. 00002000:00010000:0.0:1762167002.599268:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 235850 -> 72042 00002000:00010000:0.0:1762167002.599273:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.599276:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.599279:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.599281:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00000100:00100000:0.0:1762167002.599308:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451628544:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 505us (737us total) trans 21474843022 rc 0/0 00000100:00100000:0.0:1762167002.599315:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2585 00002000:00010000:0.0:1762167002.599319:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (72042->18446744073709551615) 00002000:00100000:0.0:1762167002.599321:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348254a80 with x1847765451628544 ext(72042->18446744073709551615) 00002000:00010000:0.0:1762167002.599326:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348254a80. 00000100:00100000:1.0:1762167002.601076:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.601128:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451628928 00000100:00100000:0.0:1762167002.601136:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451628928 00000100:00100000:0.0:1762167002.601181:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19416 00000100:00100000:0.0:1762167002.601188:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:56065:x1847765451628928:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167002.601203:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.601220:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08909 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2cc6 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.601300:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08910 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.601317:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08910 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.601327:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08910 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.601366:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 72042 00000004:00200000:0.0:1762167002.601370:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167002.601393:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08910 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.601428:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08909 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cc6 expref: 923 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.601446:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08910 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cc6 expref: 922 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.601458:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.601461:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.601465:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8800, rc 0) 00000100:00100000:0.0:1762167002.601519:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:56065:x1847765451628928:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 331us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.601526:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19416 00000100:00100000:3.0:1762167002.604339:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451629184 00000100:00100000:3.0:1762167002.604349:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451629184 00000100:00100000:3.0:1762167002.604405:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7205 00000100:00100000:3.0:1762167002.604426:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:56065:x1847765451629184:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:3.0:1762167002.604741:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:56065:x1847765451629184:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 327us (573us total) trans 8589952473 rc 0/0 00000100:00100000:3.0:1762167002.604749:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7205 00000100:00100000:1.0:1762167002.614717:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.614792:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451629440 00000100:00100000:0.0:1762167002.614803:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451629440 00000100:00100000:0.0:1762167002.614858:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19417 00000100:00100000:0.0:1762167002.614867:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:56168:x1847765451629440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.614888:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.614908:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08917 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ccd expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.614976:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0891e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.614990:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0891e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615001:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0891e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615014:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08925 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615022:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08925 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615028:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08925 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615155:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0892c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615164:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0892c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615171:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0892c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.615181:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 72042 00010000:00010000:0.0:1762167002.615271:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0891e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615279:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0891e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615289:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0891e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615295:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.615299:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0891e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615307:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0891e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615319:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167002.615322:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.615327:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0891e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615334:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0891e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615349:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08925 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615355:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08925 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615362:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08925 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615367:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.615370:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08925 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615376:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08925 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615384:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2446b8500) 00010000:00010000:0.0:1762167002.615387:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.615390:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08925 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615396:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d08925 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.615449:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08917 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ccd expref: 926 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.615463:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0892c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ccd expref: 925 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.615470:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.615473:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.615476:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8a00, rc 0) 00000100:00100000:0.0:1762167002.615542:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:56168:x1847765451629440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 675us (830us total) trans 8589952474 rc 0/0 00000100:00100000:0.0:1762167002.615549:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19417 00000100:00100000:1.0:1762167002.617396:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.617458:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451629568 00000100:00100000:3.0:1762167002.617467:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451629568 00000100:00100000:1.0:1762167002.617475:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.617527:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 610 00000100:00100000:0.0:1762167002.617550:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451629824 00000100:00100000:0.0:1762167002.617556:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451629824 00000100:00100000:3.0:1762167002.617581:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:2361:x1847765451629568:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.617597:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762167002.617603:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19418 00000100:00100000:0.0:1762167002.617612:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:56168:x1847765451629824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167002.617622:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0892c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ccd expref: 926 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.617631:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167002.617642:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.617647:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0893a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2cd4 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.617648:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167002.617698:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:2361:x1847765451629568:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 162us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.617706:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 610 00010000:00010000:0.0:1762167002.618139:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.618151:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.618160:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.618170:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x63f:0x0]: returning size 0 00010000:00010000:0.0:1762167002.618224:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0893a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cd4 expref: 927 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.618240:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cd4 expref: 926 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.618247:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63f:0x0].0x0 (ffff9ee2446b8c00) 00010000:00010000:0.0:1762167002.618250:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.618253:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:0.0:1762167002.618290:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:56168:x1847765451629824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 678us (815us total) trans 8589952475 rc 0/0 00000100:00100000:0.0:1762167002.618297:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19418 00000100:00100000:1.0:1762167002.620288:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.620407:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451630080 00000100:00100000:0.0:1762167002.620424:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451630080 00000100:00100000:0.0:1762167002.620475:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19419 00000100:00100000:0.0:1762167002.620484:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:56168:x1847765451630080:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.620503:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.620519:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0894f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2cdb expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.620600:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.620614:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cd4 expref: 927 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.620622:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.620654:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cd4 expref: 927 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.620667:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cd4 expref: 927 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.620680:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243183480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454348288:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167002.620752:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242543cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.621955:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243183480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454348288:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167002.621991:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167002.622138:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.622264:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451630208 00000100:00100000:3.0:1762167002.622274:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451630208 00010000:00010000:3.0:1762167002.622304:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cd4 expref: 928 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.622337:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7245 00000100:00100000:3.0:1762167002.622343:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:2361:x1847765451630208:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.622355:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.622361:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cd4 expref: 928 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.622373:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cd4 expref: 928 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.622391:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08941 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cd4 expref: 928 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.622407:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63f:0x0].0x0 (ffff9ee2446b8c00) 00010000:00010000:3.0:1762167002.622423:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.622430:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.622435:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.622457:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167002.622487:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.622498:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.622508:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:2361:x1847765451630208:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 163us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.622517:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7245 00000004:00200000:0.0:1762167002.622520:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x63f:0x0]: returning size 0 00000004:00080000:0.0:1762167002.622977:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x818:0x0], index 1: 0 00000004:00080000:0.0:1762167002.622986:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x815:0x0], index 0: 0 00010000:00010000:0.0:1762167002.623169:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.623180:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.623187:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.623199:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.623204:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.623212:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.623227:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63f:0x0].0x0 (ffff9ee2446b8c00) 00010000:00010000:0.0:1762167002.623230:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167002.623235:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.623241:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08956 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.623311:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0894f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cdb expref: 927 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.623323:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167002.623326:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762167002.623330:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0894f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cdb expref: 927 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.623346:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:0.0:1762167002.623430:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:56168:x1847765451630080:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2947us (3148us total) trans 8589952476 rc 301/301 00000100:00100000:0.0:1762167002.623440:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19419 00000100:00100000:1.0:1762167002.624911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.624977:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451630464 00000100:00100000:3.0:1762167002.624986:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451630464 00000100:00100000:3.0:1762167002.625035:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7206 00000100:00100000:3.0:1762167002.625044:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:56168:x1847765451630464:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167002.625386:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:56168:x1847765451630464:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 342us (481us total) trans 8589952477 rc 0/0 00000100:00100000:3.0:1762167002.625393:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7206 00000100:00100000:0.0:1762167002.627502:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451630592 00000100:00100000:0.0:1762167002.627520:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451630592 00000100:00100000:0.0:1762167002.627609:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19420 00000100:00100000:0.0:1762167002.627621:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:56168:x1847765451630592:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.627649:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.627680:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08964 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x63f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ce2 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.627797:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0896b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.627815:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0896b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.627828:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0896b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.627886:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x63f:0x0]: returning size 0 00000004:00200000:0.0:1762167002.627892:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167002.627917:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0896b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.627947:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08964 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce2 expref: 929 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.627974:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0896b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce2 expref: 928 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.627984:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63f:0x0].0x0 (ffff9ee2446b8500) 00010000:00010000:0.0:1762167002.627988:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762167002.627992:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9000, rc 0) 00000100:00100000:0.0:1762167002.628066:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:56168:x1847765451630592:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 448us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.628072:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19420 00000100:00100000:0.0:1762167002.630221:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451630720 00000100:00100000:0.0:1762167002.630238:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451630720 00000100:00100000:1.0:1762167002.630317:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451630848 00000100:00100000:0.0:1762167002.630327:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16253 00000100:00100000:1.0:1762167002.630328:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451630848 00000100:00100000:0.0:1762167002.630351:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451630720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.630372:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.630396:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08972 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ce9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.630407:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16254 00000100:00100000:1.0:1762167002.630438:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451630848:12345-192.168.203.35@tcp:101:lfs.0 00002000:00010000:0.0:1762167002.630447:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167002.630455:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.630468:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.630473:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.630479:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08979 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2cf0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.630487:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08972 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce9 expref: 34 pid: 6533 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1762167002.630514:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x815:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762167002.630514:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08972 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce9 expref: 34 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167002.630547:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00010000:00010000:1.0:1762167002.630550:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.630554:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.630563:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf0 expref: 20 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.630582:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf0 expref: 20 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.630595:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7be00, rc 0) 00000100:00100000:0.0:1762167002.630612:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451630720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 271us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.630619:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16253 00000100:00100000:1.0:1762167002.630642:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451630848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 206us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.630650:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16254 00000100:00100000:1.0:1762167002.632668:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.632726:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451631104 00000100:00100000:0.0:1762167002.632734:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451631104 00000100:00100000:0.0:1762167002.632809:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19421 00000100:00100000:0.0:1762167002.632820:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:56168:x1847765451631104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.632837:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.632855:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08980 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2cf7 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.632943:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08987 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.632958:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08987 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.632967:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08987 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.632980:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 72042 00010000:00010000:0.0:1762167002.633097:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08980 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf7 expref: 931 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.633114:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08987 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf7 expref: 930 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.633140:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.633143:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167002.633146:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9a00, rc 0) 00000100:00100000:0.0:1762167002.633206:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+930:56168:x1847765451631104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 389us (545us total) trans 8589952478 rc 0/0 00000100:00100000:0.0:1762167002.633214:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19421 00000100:00100000:3.0:1762167002.635552:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451631360 00000100:00100000:3.0:1762167002.635561:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451631360 00000100:00100000:3.0:1762167002.635622:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451631232 00000100:00100000:3.0:1762167002.635629:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451631232 00000100:00100000:1.0:1762167002.635678:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451631488 00000100:00100000:1.0:1762167002.635684:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451631488 00000100:00100000:3.0:1762167002.635687:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16255 00000100:00100000:3.0:1762167002.635700:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451631360:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:0.0:1762167002.635702:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16256 00000100:00100000:0.0:1762167002.635721:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451631232:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167002.635732:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16257 00000100:00100000:1.0:1762167002.635743:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451631488:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167002.635747:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.635752:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.635792:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d086a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bf4 expref: 34 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.635794:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d089a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.635797:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c3a expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.635813:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167002.635817:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167002.635822:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167002.635823:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.635825:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 21 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.635826:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167002.635832:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.635851:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167002.635855:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167002.635858:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d089a3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.635871:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d086a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bf4 expref: 34 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.635874:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c3a expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.635885:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 21 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.635905:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d086a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bf4 expref: 34 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.635906:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 21 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.635906:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c3a expref: 21 pid: 6533 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.635944:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454348416:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167002.635944:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454348544:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.635945:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454348672:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167002.636031:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.636031:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345742840 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.636032:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242543540 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.637727:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454348672:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167002.637809:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454348416:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.637809:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d089a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.637822:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454348544:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167002.637828:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.637844:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.637858:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451631744 00000100:00100000:3.0:1762167002.637862:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451631744 00010000:00010000:3.0:1762167002.637879:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c3a expref: 22 pid: 6533 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.637905:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7247 00000100:00100000:1.0:1762167002.637920:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451631744:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.637933:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762167002.637952:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167002.637953:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c3a expref: 22 pid: 6533 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.637970:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c3a expref: 22 pid: 6533 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.638003:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08773 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c3a expref: 22 pid: 6533 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.638031:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762167002.638031:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451631872 00000100:00100000:0.0:1762167002.638035:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451631872 00010000:00010000:1.0:1762167002.638040:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.638046:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.638052:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 22 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.638062:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.638088:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167002.638089:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7248 00000100:00100000:0.0:1762167002.638098:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451631872:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167002.638112:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.638122:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 22 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.638133:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451631744:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 215us (409us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167002.638136:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 22 pid: 33894 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.638153:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7247 00010000:00010000:0.0:1762167002.638157:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d086af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2bfb expref: 22 pid: 33894 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.638168:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.638170:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.638174:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d089a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.638186:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d089a3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.638190:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.638200:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.638207:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.638224:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.638234:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451631872:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 136us (283us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167002.638235:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.638245:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7248 00010000:00010000:1.0:1762167002.638259:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.638266:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167002.638271:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.638292:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.638329:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.638351:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d0899c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.638384:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.638392:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.638408:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.638435:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.638435:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451631232:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2716us (2957us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167002.638452:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.638456:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16256 00010000:00010000:3.0:1762167002.638464:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167002.638468:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.638476:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.638488:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.638495:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08995 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.638625:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451631360:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2928us (3220us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.638632:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16255 00000100:00100000:0.0:1762167002.640493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.640531:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.640562:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.640579:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451632128 00000100:00100000:3.0:1762167002.640589:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451632128 00000100:00100000:3.0:1762167002.640635:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451632256 00000100:00100000:3.0:1762167002.640638:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451632256 00000100:00100000:0.0:1762167002.640809:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16259 00000100:00100000:3.0:1762167002.640819:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16260 00000100:00100000:0.0:1762167002.640821:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451632000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.640830:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167002.640835:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451632256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167002.640846:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.640847:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d089aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2cfe expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.640860:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d089b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d0c expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167002.640886:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888da, atime: 0x690888d9, ctime: 0x690888da, blocks: 0x3 00002000:00010000:0.0:1762167002.640886:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 72042, mtime: 0x690888da, atime: 0x690888da, ctime: 0x690888da, blocks: 0x135 00010000:00010000:3.0:1762167002.640908:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.640909:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.640914:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.640915:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.640927:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d089b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d0c expref: 21 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167002.640929:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d089aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cfe expref: 21 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167002.640960:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d089b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d0c expref: 21 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167002.640963:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d089aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cfe expref: 21 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167002.640981:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3a00, rc 0) 00010000:00010000:0.0:1762167002.640992:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9800, rc 0) 00000100:00100000:0.0:1762167002.641048:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451632000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 226us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.641050:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451632256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 216us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.641066:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16259 00000100:00100000:3.0:1762167002.641074:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16260 00000100:00100000:0.0:1762167002.666586:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451632384 00000100:00100000:0.0:1762167002.666595:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451632384 00000100:00100000:0.0:1762167002.666658:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2588 00000100:00100000:0.0:1762167002.666666:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451632384:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167002.666700:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089bf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.666715:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.666717:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.666722:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.666735:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.668206:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.668221:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.668230:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.668236:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167002.668240:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.668249:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.668264:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.668271:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.668330:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451632384:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1659us (1847us total) trans 0 rc 72042/72042 00000100:00100000:0.0:1762167002.668339:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2588 00000100:00100000:1.0:1762167002.670007:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.670109:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451632512 00000100:00100000:0.0:1762167002.670118:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451632512 00000100:00100000:0.0:1762167002.670182:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2589 00000100:00100000:0.0:1762167002.670192:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451632512:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762167002.670225:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.670242:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08972 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce9 expref: 34 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167002.670250:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.670252:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.670255:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.670293:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08972 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce9 expref: 34 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167002.670306:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08972 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce9 expref: 34 pid: 6533 timeout: 723 lvb_type: 1 00000100:00100000:0.0:1762167002.670320:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454348800:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167002.670393:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242543540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.672178:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454348800:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167002.672204:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.672545:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.672626:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451632640 00000100:00100000:3.0:1762167002.672634:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451632640 00010000:00010000:3.0:1762167002.672669:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08972 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce9 expref: 35 pid: 6533 timeout: 723 lvb_type: 1 00000100:00100000:3.0:1762167002.672713:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7249 00000100:00100000:3.0:1762167002.672722:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451632640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.672738:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.672843:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08972 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce9 expref: 35 pid: 6533 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.672863:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08972 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce9 expref: 35 pid: 6533 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.672889:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08972 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce9 expref: 35 pid: 6533 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.672904:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.672906:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.672910:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.672919:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.673030:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.673038:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167002.692411:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875524 is committed 00002000:00010000:0.0:1762167002.692449:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 0 -> 72042 00002000:00010000:0.0:1762167002.692455:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 0 -> 1762167002 00002000:00010000:0.0:1762167002.692458:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 0 -> 1762167002 00002000:00010000:0.0:1762167002.692461:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 1 -> 259 00010000:00010000:0.0:1762167002.692475:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.692487:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.692496:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.692504:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167002.692508:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.692517:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.692535:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.692542:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d089c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.692639:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451632512:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 22444us (22634us total) trans 17179875528 rc 0/0 00000100:00100000:0.0:1762167002.692648:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2589 00000100:00100000:0.0:1762167002.694715:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451632768 00000100:00100000:0.0:1762167002.694732:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451632768 00000100:00100000:0.0:1762167002.694871:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19422 00000100:00100000:0.0:1762167002.694886:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+930:56168:x1847765451632768:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762167002.711180:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952478 is committed 00000004:00080000:1.0:1762167002.711285:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3395 committed 00000100:00100000:3.0:1762167002.711305:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56168:x1847765451632768:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 16411us (16660us total) trans 0 rc 0/0 00000004:00080000:1.0:1762167002.711308:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3408 committed 00000100:00100000:3.0:1762167002.711325:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19422 00000020:00080000:1.0:1762167002.711355:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee36f2ee0c0 refcount 2 committed 0 result 0 batchid 4294969170 00000020:00080000:1.0:1762167002.711363:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2433c7800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36f2ee3c0 00000020:00080000:1.0:1762167002.711368:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee242cece00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36f2ee180 00000020:00080000:1.0:1762167002.711372:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee242cec500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee242a3d000 00000020:00080000:1.0:1762167002.711376:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].38 00000100:00100000:0.0:1762167002.711562:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454348928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.711586:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454349056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167002.711625:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.711663:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167002.711698:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454348928 00000100:00100000:0.0:1762167002.711706:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454348928 00000100:00100000:3.0:1762167002.711719:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454349056 00000100:00100000:3.0:1762167002.711729:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454349056 00000100:00100000:0.0:1762167002.711808:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16261 00000100:00100000:3.0:1762167002.711820:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16262 00000100:00100000:0.0:1762167002.711827:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765454348928:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762167002.711839:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765454349056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1762167002.711858:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2066 count 1 00002000:00080000:3.0:1762167002.711860:0:12400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2063 count 1 00010000:00010000:3.0:1762167002.711884:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167002.711893:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x812:0x0] initial LVB size: 167513, mtime: 0x690888da, atime: 0x690888d5, ctime: 0x690888da, blocks: 0x203 00010000:00010000:0.0:1762167002.711901:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.711904:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d06bc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2223 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.711921:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.711927:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.711928:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167002.711933:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167002.711938:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.711938:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.711968:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.711979:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.711982:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d06bc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2223 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.711988:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.712004:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d06bc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2223 expref: 19 pid: 6535 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.712015:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1762167002.712020:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454349184:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.712057:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167002.712070:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.712088:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167002.712094:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.712100:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3507b6f00 going to sleep for 11 seconds 00010000:00010000:1.0:1762167002.712107:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.712135:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.712144:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.712176:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167002.712179:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167002.712185:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167002.712534:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765454348928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 715us (910us total) trans 17179875529 rc 0/0 00000100:00100000:0.0:1762167002.712541:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16261 00000100:00100000:1.0:1762167002.712581:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875524 gen 2 00000004:00080000:1.0:1762167002.712588:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825b480, transno 17179875507 00000004:00080000:1.0:1762167002.712610:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825b800, transno 17179875508 00000004:00080000:1.0:1762167002.712613:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259f80, transno 17179875509 00000004:00080000:1.0:1762167002.712616:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825a680, transno 17179875510 00000004:00080000:1.0:1762167002.712618:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258700, transno 17179875511 00000004:00080000:1.0:1762167002.712621:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825aa00, transno 17179875512 00000004:00080000:1.0:1762167002.712623:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259880, transno 17179875513 00000004:00080000:1.0:1762167002.712625:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258a80, transno 17179875514 00000004:00080000:1.0:1762167002.712628:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259180, transno 17179875515 00000004:00080000:1.0:1762167002.712631:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa99500, transno 17179875516 00000004:00080000:1.0:1762167002.712634:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259c00, transno 17179875517 00000004:00080000:1.0:1762167002.712636:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825b100, transno 17179875518 00000004:00080000:1.0:1762167002.712638:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa99c00, transno 17179875519 00000004:00080000:1.0:1762167002.712641:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa9a300, transno 17179875520 00000004:00080000:1.0:1762167002.712644:0:3293:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875524 committed transno 17179875524 00000100:00100000:1.0:1762167002.712665:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36f333480 x1847765454348928/t17179875529(17179875529) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762167018 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762167002.712676:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f333480/2, rc 0, transno 17179875529 00000100:00100000:1.0:1762167002.712682:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454348928:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762167002.713004:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451633024 00000100:00100000:0.0:1762167002.713009:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451633024 00000100:00100000:0.0:1762167002.713042:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451632896 00000100:00100000:0.0:1762167002.713046:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451632896 00000100:00100000:1.0:1762167002.713062:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16263 00000100:00100000:1.0:1762167002.713078:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451633024:12345-192.168.203.35@tcp:16:lfs.0 00000004:00080000:3.0:1762167002.713156:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 14 done 00000100:00100000:1.0:1762167002.713165:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451633024:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.713180:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16263 00000100:00100000:3.0:1762167002.713217:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454349184:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167002.713327:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.713439:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451633152 00000100:00100000:0.0:1762167002.713444:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451633152 00010000:00010000:0.0:1762167002.713464:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d06bc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2223 expref: 20 pid: 6535 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.713497:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7250 00000100:00100000:0.0:1762167002.713505:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451633152:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167002.713515:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.713521:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d06bc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2223 expref: 20 pid: 6535 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.713533:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d06bc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2223 expref: 20 pid: 6535 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.713555:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d06bc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2223 expref: 20 pid: 6535 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.713569:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.713570:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.713574:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.713583:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.713605:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167002.713633:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.713639:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451633152:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 133us (277us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167002.713650:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.713652:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7250 00010000:00010000:3.0:1762167002.713676:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.713689:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.713714:0:12400:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762167002.713738:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167002.713746:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.713756:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167002.713784:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.713795:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.713809:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.713822:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x80f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.713845:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167002.713847:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167002.713848:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167002.714149:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454349056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2319us (2486us total) trans 21474843023 rc 0/0 00000100:00100000:3.0:1762167002.714157:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16262 00000100:00100000:1.0:1762167002.714209:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843014 gen 2 00000004:00080000:1.0:1762167002.714215:0:3294:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843014 committed transno 21474843014 00000100:00100000:1.0:1762167002.714232:0:3294:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36e62ad80 x1847765454349056/t21474843023(21474843023) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762167018 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762167002.714241:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e62ad80/2, rc 0, transno 21474843023 00000100:00100000:1.0:1762167002.714246:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454349056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167002.721525:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.721594:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.721636:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.721670:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451633408 00000100:00100000:3.0:1762167002.721686:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451633408 00000100:00100000:1.0:1762167002.721697:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451633280 00000100:00100000:1.0:1762167002.721704:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451633280 00000100:00100000:3.0:1762167002.721739:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451633536 00000100:00100000:3.0:1762167002.721742:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451633536 00000100:00100000:1.0:1762167002.721760:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16265 00000100:00100000:1.0:1762167002.721908:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451633408:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167002.721933:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16266 00000100:00100000:0.0:1762167002.721944:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16267 00000100:00100000:3.0:1762167002.721947:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451633280:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:0.0:1762167002.721960:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451633536:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167002.721968:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d089db lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.721973:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d089e2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.721987:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.721993:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.721993:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.721998:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.721999:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.722004:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.722008:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d089e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.722008:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d089db lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.722009:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.722016:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.722039:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d089e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.722039:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d089db lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.722041:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.722089:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d089e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.722090:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.722091:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d089db lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.722117:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d089db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.722117:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.722121:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d089e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.722145:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.722146:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d089db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.722147:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d089e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.722168:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167002.722171:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167002.722172:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7aa00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167002.722174:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.722178:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d089e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.722180:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d089db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.722188:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.722192:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d089e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.722215:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.722216:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d089e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.722218:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d089db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.722233:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d089e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.722237:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d089e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.722259:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d089db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.722268:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d089db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.722324:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451633280:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 382us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.722331:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451633536:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 375us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.722335:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16266 00000100:00100000:0.0:1762167002.722346:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16267 00000100:00100000:1.0:1762167002.722447:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451633408:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 541us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.722454:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16265 00000100:00100000:3.0:1762167002.724075:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451633792 00000100:00100000:3.0:1762167002.724083:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451633792 00000100:00100000:3.0:1762167002.724135:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19423 00000100:00100000:3.0:1762167002.724145:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56168:x1847765451633792:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167002.724201:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.724231:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0896b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x63f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ce2 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.724249:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63f:0x0].0x0 (ffff9ee2446b8500) 00010000:00010000:3.0:1762167002.724260:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167002.724317:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.724331:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.724341:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:3.0:1762167002.724555:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000da3f369 reply state 00000000cc1b4937 transno 8589952479 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.724566:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167002.724682:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56168:x1847765451633792:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 538us (695us total) trans 8589952479 rc 0/0 00000100:00100000:3.0:1762167002.724690:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19423 00010000:00010000:0.0:1762167002.725756:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.725802:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.725809:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.725815:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.725819:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.725828:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.725844:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63f:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:0.0:1762167002.725847:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.725851:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.725857:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d089f0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.726026:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451633920 00000100:00100000:3.0:1762167002.726033:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451633920 00000100:00100000:3.0:1762167002.726115:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19424 00000100:00100000:3.0:1762167002.726130:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56168:x1847765451633920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167002.726146:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167002.726161:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d089f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x63f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d13 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.726206:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d089f7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d13 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.726217:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d089f7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d13 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.726231:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63f:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167002.726234:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167002.726237:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3e00, rc 0) 00000100:00100000:3.0:1762167002.726278:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56168:x1847765451633920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 151us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.726285:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19424 00000100:00100000:1.0:1762167002.727455:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451634048 00000100:00100000:1.0:1762167002.727461:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451634048 00000100:00100000:1.0:1762167002.727506:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16268 00000100:00100000:1.0:1762167002.727515:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56168:x1847765451634048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.727526:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.727542:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d089fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d1a expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167002.727564:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 72042, mtime: 0x690888da, atime: 0x0, ctime: 0x690888da, blocks: 0x103 00010000:00010000:1.0:1762167002.727578:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.727580:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.727587:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d089fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d1a expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.727601:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d089fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d1a expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.727616:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a200, rc 0) 00000100:00100000:1.0:1762167002.727655:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56168:x1847765451634048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 142us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.727662:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16268 00000100:00100000:0.0:1762167002.728834:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.728952:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451634176 00000100:00100000:1.0:1762167002.728958:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451634176 00000100:00100000:1.0:1762167002.729003:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16269 00000100:00100000:1.0:1762167002.729012:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:56168:x1847765451634176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.729023:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.729036:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d21 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.729064:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08979 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf0 expref: 20 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.729073:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.729075:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.729078:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.729112:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf0 expref: 20 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.729125:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf0 expref: 20 pid: 6532 timeout: 723 lvb_type: 1 00000100:00100000:1.0:1762167002.729140:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454349312:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.729221:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.731902:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454349312:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.731948:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.731969:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b000, rc 0) 00000100:00100000:1.0:1762167002.732033:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56168:x1847765451634176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3021us (3201us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.732042:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16269 00000100:00100000:3.0:1762167002.732461:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451634304 00000100:00100000:3.0:1762167002.732468:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451634304 00010000:00010000:3.0:1762167002.732497:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf0 expref: 20 pid: 6532 timeout: 723 lvb_type: 1 00000100:00100000:3.0:1762167002.732536:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7251 00000100:00100000:3.0:1762167002.732555:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451634304:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.732568:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.732590:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf0 expref: 20 pid: 6532 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.732603:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf0 expref: 20 pid: 6532 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.732631:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08979 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf0 expref: 20 pid: 6532 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.732643:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.732646:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.732651:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 19 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.732660:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 19 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.732699:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 19 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.732713:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454349440:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167002.732792:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3507b6600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167002.734594:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454349440:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167002.734614:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167002.734617:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167002.734667:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451634304:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2114us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.734678:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7251 00000100:00100000:1.0:1762167002.734706:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451634432 00000100:00100000:1.0:1762167002.734714:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451634432 00000100:00100000:1.0:1762167002.734786:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16270 00000100:00100000:1.0:1762167002.734797:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451634432:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167002.734936:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451634560 00000100:00100000:3.0:1762167002.734940:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451634560 00000100:00100000:3.0:1762167002.734977:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16271 00000100:00100000:3.0:1762167002.734986:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451634560:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762167002.735147:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167002.735151:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 0 -> 1762167002 00002000:00010000:3.0:1762167002.735153:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 0 -> 1762167002 00002000:00010000:3.0:1762167002.735155:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 0 -> 1762167003 00002000:00010000:3.0:1762167002.735157:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167002.735195:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451634560:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 211us (382us total) trans 21474843024 rc 0/0 00000100:00100000:3.0:1762167002.735201:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16271 00002000:00010000:1.0:1762167002.735917:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 72042 -> 72042 00002000:00010000:1.0:1762167002.735922:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.735924:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 0 -> 1762167002 00002000:00010000:1.0:1762167002.735927:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167002 -> 1762167003 00002000:00010000:1.0:1762167002.735929:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:1.0:1762167002.735966:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451634432:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 1172us (1354us total) trans 17179875530 rc 0/0 00000100:00100000:1.0:1762167002.735974:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16270 00000100:00100000:3.0:1762167002.737386:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451634816 00000100:00100000:3.0:1762167002.737394:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451634816 00000100:00100000:3.0:1762167002.737454:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19425 00000100:00100000:3.0:1762167002.737464:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56168:x1847765451634816:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:3.0:1762167002.737522:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a0c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.737537:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a0c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.737549:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a0c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.737571:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a0c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.737577:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a0c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.737584:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a0c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.737589:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167002.737594:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a0c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.737601:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a0c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.737611:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63f:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167002.737614:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1762167002.737617:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a0c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.737624:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a0c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.737678:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56168:x1847765451634816:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 215us (359us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762167002.737685:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19425 00000100:00100000:0.0:1762167002.739156:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.739207:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451635072 00000100:00100000:3.0:1762167002.739224:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451635072 00000100:00100000:3.0:1762167002.739267:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19426 00000100:00100000:3.0:1762167002.739276:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56168:x1847765451635072:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167002.739318:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.739339:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08910 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cc6 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.739356:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167002.739360:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167002.739390:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.739401:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.739410:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:3.0:1762167002.739553:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000091f91d7 reply state 00000000c81b28b0 transno 8589952480 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167002.739562:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167002.739635:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56168:x1847765451635072:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 359us (483us total) trans 8589952480 rc 0/0 00000100:00100000:3.0:1762167002.739642:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19426 00010000:00010000:0.0:1762167002.740531:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.740541:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.740549:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.740554:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167002.740558:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.740565:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.740579:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.740582:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167002.740586:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.740594:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a13 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167002.740759:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.740834:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451635200 00000100:00100000:1.0:1762167002.740840:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451635200 00000100:00100000:1.0:1762167002.740878:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16272 00000100:00100000:1.0:1762167002.740884:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56168:x1847765451635200:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.740895:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.740906:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08a1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d28 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.740933:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d089aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cfe expref: 21 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.740945:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.740947:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.740952:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08a1a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d28 expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.740988:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d089aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cfe expref: 21 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.741001:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d089aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cfe expref: 21 pid: 33892 timeout: 723 lvb_type: 1 00000100:00100000:1.0:1762167002.741013:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454349568:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.741067:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.742223:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454349568:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.742248:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08a1a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d28 expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.742262:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7aa00, rc 0) 00000100:00100000:1.0:1762167002.742304:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56168:x1847765451635200:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1419us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.742312:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16272 00000100:00100000:0.0:1762167002.742374:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.742437:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451635328 00000100:00100000:3.0:1762167002.742444:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451635328 00010000:00010000:3.0:1762167002.742527:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d089aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cfe expref: 21 pid: 33892 timeout: 723 lvb_type: 1 00000100:00100000:3.0:1762167002.742553:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7252 00000100:00100000:3.0:1762167002.742558:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451635328:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.742568:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.742584:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d089aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cfe expref: 21 pid: 33892 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.742593:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d089aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cfe expref: 21 pid: 33892 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.742606:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d089aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cfe expref: 21 pid: 33892 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.742617:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.742618:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.742623:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08a1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d28 expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.742629:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08a1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d28 expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.742648:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08a1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d28 expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.742657:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454349696:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167002.742701:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34821d780 going to sleep for 11 seconds 00000100:00100000:3.0:1762167002.743968:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454349696:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167002.743992:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167002.744011:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.744042:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451635328:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1482us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.744052:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7252 00000100:00100000:1.0:1762167002.744087:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451635456 00000100:00100000:1.0:1762167002.744094:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451635456 00000100:00100000:1.0:1762167002.744284:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16273 00000100:00100000:1.0:1762167002.744293:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56168:x1847765451635456:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.744305:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.744320:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d2f expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.744344:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d089b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d05 expref: 24 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.744352:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.744354:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.744359:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.744383:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d089b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d05 expref: 24 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.744395:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d089b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d05 expref: 24 pid: 6532 timeout: 723 lvb_type: 1 00000100:00100000:1.0:1762167002.744406:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454349824:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.744477:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.745822:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454349824:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.745849:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.745856:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451635584 00000100:00100000:3.0:1762167002.745864:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451635584 00010000:00010000:1.0:1762167002.745869:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b400, rc 0) 00010000:00010000:3.0:1762167002.745893:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d089b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d05 expref: 25 pid: 6532 timeout: 723 lvb_type: 1 00000100:00100000:1.0:1762167002.745915:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56168:x1847765451635456:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1622us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.745925:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16273 00000100:00100000:3.0:1762167002.745931:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7253 00000100:00100000:3.0:1762167002.745944:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451635584:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.745956:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167002.745984:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d089b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d05 expref: 24 pid: 6532 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.745999:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d089b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d05 expref: 24 pid: 6532 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.746021:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d089b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d05 expref: 24 pid: 6532 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.746031:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.746033:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.746039:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 23 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.746049:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 23 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.746122:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 23 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.746135:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454349952:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167002.746197:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3507b6600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167002.747201:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454349952:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167002.747217:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167002.747256:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451635584:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1316us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.747265:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7253 00000100:00100000:1.0:1762167002.747645:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451635712 00000100:00100000:1.0:1762167002.747651:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451635712 00000100:00100000:1.0:1762167002.747695:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16274 00000100:00100000:1.0:1762167002.747704:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56168:x1847765451635712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.747717:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.747732:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08a28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d36 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.747754:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d089b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d0c expref: 21 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.747791:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.747794:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.747799:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08a28 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d36 expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.747824:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d089b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d0c expref: 21 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.747836:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d089b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d0c expref: 21 pid: 12400 timeout: 723 lvb_type: 1 00000100:00100000:1.0:1762167002.747848:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454350080:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.747901:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d3300 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.749182:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.749226:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451635840 00000100:00100000:3.0:1762167002.749231:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451635840 00010000:00010000:3.0:1762167002.749250:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d089b8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d0c expref: 22 pid: 12400 timeout: 723 lvb_type: 1 00000100:00100000:1.0:1762167002.749269:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454350080:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167002.749275:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7254 00000100:00100000:3.0:1762167002.749283:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451635840:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167002.749291:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.749296:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08a28 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d36 expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.749307:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d089b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d0c expref: 22 pid: 12400 timeout: 723 lvb_type: 1 00010000:00010000:1.0:1762167002.749312:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a800, rc 0) 00010000:00010000:3.0:1762167002.749317:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d089b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d0c expref: 22 pid: 12400 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.749333:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d089b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d0c expref: 22 pid: 12400 timeout: 723 lvb_type: 1 00010000:00010000:3.0:1762167002.749342:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.749343:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.749346:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08a28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d36 expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.749354:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08a28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d36 expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.749357:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56168:x1847765451635712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1652us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.749371:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16274 00010000:00010000:3.0:1762167002.749403:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08a28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d36 expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.749427:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454350208:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167002.749480:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3507b6600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167002.750958:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454350208:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167002.750976:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167002.751025:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451635840:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1741us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.751040:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7254 00000100:00100000:0.0:1762167002.751121:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.751134:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451635968 00000100:00100000:1.0:1762167002.751141:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451635968 00000100:00100000:0.0:1762167002.751154:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.751183:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451636096 00000100:00100000:3.0:1762167002.751187:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451636224 00000100:00100000:1.0:1762167002.751187:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451636096 00000100:00100000:3.0:1762167002.751195:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451636224 00000100:00100000:1.0:1762167002.751225:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16276 00000100:00100000:1.0:1762167002.751239:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451636096:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:0.0:1762167002.751242:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16277 00000100:00100000:0.0:1762167002.751257:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451636224:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167002.751478:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167002.751481:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167002.751483:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.751489:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.751490:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167001 -> 1762167002 00002000:00010000:0.0:1762167002.751497:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167001 -> 1762167002 00002000:00010000:1.0:1762167002.751498:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167002 -> 1762167003 00002000:00010000:1.0:1762167002.751506:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167002.751507:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167002 -> 1762167003 00002000:00010000:0.0:1762167002.751514:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167002.751558:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451636096:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 320us (437us total) trans 17179875531 rc 0/0 00000100:00100000:0.0:1762167002.751563:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451636224:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 309us (406us total) trans 21474843026 rc 0/0 00000100:00100000:1.0:1762167002.751578:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16276 00000100:00100000:0.0:1762167002.751594:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16277 00000100:00100000:3.0:1762167002.753045:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451636480 00000100:00100000:3.0:1762167002.753050:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451636480 00000100:00100000:3.0:1762167002.753088:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7207 00000100:00100000:3.0:1762167002.753094:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56168:x1847765451636480:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762167002.753166:0:33886:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08987 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2cf7 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.753201:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a2f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.753213:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08861 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c8e expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.753221:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c9c expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.753229:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a2f lrc: 5/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.753256:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c9c expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.753268:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c9c expref: 895 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.753281:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454350336:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167002.753356:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08861 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c8e expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.753366:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08861 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c8e expref: 895 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.753375:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454350464:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167002.753403:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3507b6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167002.754750:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451636736 00000100:00100000:3.0:1762167002.754756:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451636736 00000100:00100000:1.0:1762167002.754782:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451636864 00000100:00100000:1.0:1762167002.754786:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451636864 00010000:00010000:3.0:1762167002.754807:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08861 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c8e expref: 897 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.754827:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7208 00000100:00100000:1.0:1762167002.754835:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:43349:x1847765451636864:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762167002.754908:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7255 00000100:00100000:0.0:1762167002.754919:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451636736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167002.754941:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.754950:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08861 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c8e expref: 898 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.754967:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08861 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c8e expref: 898 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.754988:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08861 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c8e expref: 898 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.755009:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.755015:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a2f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167002.755024:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a2f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167002.755030:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.755040:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:43349:x1847765451636864:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 204us (367us total) trans 8589952481 rc 0/0 00000100:00100000:1.0:1762167002.755049:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7208 00000100:00100000:0.0:1762167002.755060:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451636736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 142us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.755069:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7255 00000100:00100000:3.0:1762167002.756289:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.756408:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451636992 00000100:00100000:0.0:1762167002.756426:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451636992 00010000:00010000:0.0:1762167002.756451:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c9c expref: 896 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.756487:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7256 00000100:00100000:0.0:1762167002.756496:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451636992:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167002.756508:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.756513:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c9c expref: 896 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.756531:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c9c expref: 896 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.756549:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08892 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c9c expref: 896 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.756562:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167002.756567:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a2f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167002.756574:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a2f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167002.756582:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a2f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167002.756614:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167002.756657:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451636992:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 162us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.756665:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7256 00010000:00010000:3.0:1762167002.756693:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a2f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.756701:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a2f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.756717:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a36 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.756726:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d089f7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d13 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.756731:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a36 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.756753:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d089f7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d13 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.756802:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d089f7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x63f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d13 expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.756851:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454350592:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167002.756898:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3507b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.758503:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167002.758937:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a36 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.758946:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a36 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x63f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167002.759462:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454350720:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.759506:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.759539:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36dc36900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.759576:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454350720 00000100:00100000:1.0:1762167002.759582:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454350720 00000100:00100000:1.0:1762167002.759615:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1762167002.759624:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454350720:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.759700:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454350720:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.759707:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1762167002.759884:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454350720:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.759926:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454350848:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.759953:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.759976:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.760009:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454350848 00000100:00100000:1.0:1762167002.760014:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454350848 00000100:00100000:1.0:1762167002.760042:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1762167002.760048:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454350848:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.760089:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454350848:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 42us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.760094:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1762167002.760109:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454350848:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.760152:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454350976:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.760177:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.760201:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36dc36900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.760231:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454350976 00000100:00100000:1.0:1762167002.760248:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454350976 00000100:00100000:1.0:1762167002.760279:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1762167002.760286:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454350976:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.760337:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454350976:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 53us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.760344:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1762167002.760502:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454351104 00000100:00100000:1.0:1762167002.760506:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454351104 00000100:00100000:1.0:1762167002.760536:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1762167002.760541:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351104:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.760590:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351104:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 49us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.760596:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1762167002.760736:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454351232 00000100:00100000:3.0:1762167002.760740:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454351232 00000100:00100000:3.0:1762167002.760799:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1762167002.760807:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351232:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.760859:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351232:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 54us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.760866:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1762167002.761048:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454351360 00000100:00100000:3.0:1762167002.761051:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454351360 00000100:00100000:3.0:1762167002.761078:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1762167002.761084:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351360:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.761132:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351360:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.761136:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1762167002.761237:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454351488 00000100:00100000:3.0:1762167002.761242:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454351488 00000100:00100000:3.0:1762167002.761268:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1762167002.761274:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351488:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.761318:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351488:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 45us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.761325:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1762167002.761449:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454351616 00000100:00100000:3.0:1762167002.761455:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454351616 00000100:00100000:3.0:1762167002.761489:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1762167002.761496:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351616:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.761540:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351616:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 45us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.761544:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1762167002.761722:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454351744 00000100:00100000:1.0:1762167002.761728:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454351744 00000100:00100000:1.0:1762167002.761757:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1762167002.761789:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351744:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.761851:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351744:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 86us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.761859:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1762167002.762488:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454351872 00000100:00100000:1.0:1762167002.762493:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454351872 00000100:00100000:1.0:1762167002.762525:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1762167002.762532:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351872:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.762591:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454351872:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 58us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.762597:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1762167002.762751:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454352000 00000100:00100000:1.0:1762167002.762754:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454352000 00000100:00100000:1.0:1762167002.762799:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1762167002.762805:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454352000:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.762855:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454352000:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.762875:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1762167002.763054:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454352128 00000100:00100000:3.0:1762167002.763060:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454352128 00000100:00100000:3.0:1762167002.763091:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1762167002.763099:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454352128:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.763159:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454352128:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.763167:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1762167002.763316:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454352256 00000100:00100000:3.0:1762167002.763321:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454352256 00000100:00100000:3.0:1762167002.763361:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1762167002.763369:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454352256:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167002.763434:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454352256:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.763441:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1762167002.763601:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454352384 00000100:00100000:1.0:1762167002.763606:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454352384 00000100:00100000:1.0:1762167002.763640:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1762167002.763647:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454352384:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.763721:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454352384:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 74us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.763744:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1762167002.764343:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454352512 00000100:00100000:1.0:1762167002.764349:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454352512 00000100:00100000:1.0:1762167002.764382:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1762167002.764389:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454352512:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.764627:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33886:x1847765454352512:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 237us (380us total) trans 21474843027 rc 0/0 00000100:00100000:1.0:1762167002.764634:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1762167002.764803:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454352640 00000100:00100000:1.0:1762167002.764808:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454352640 00000100:00100000:1.0:1762167002.764839:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1762167002.764845:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454352640:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167002.765053:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33886:x1847765454352640:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 207us (324us total) trans 17179875532 rc 0/0 00000100:00100000:1.0:1762167002.765060:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1762167002.766985:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.767066:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451637248 00000100:00100000:3.0:1762167002.767073:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451637248 00000100:00100000:3.0:1762167002.767118:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19427 00000100:00100000:3.0:1762167002.767128:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56168:x1847765451637248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167002.767154:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167002.767175:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08a3d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d3d expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.767233:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08a3d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d3d expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.767247:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08a3d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d3d expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.767263:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167002.767266:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167002.767269:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3a00, rc 0) 00000100:00100000:3.0:1762167002.767314:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56168:x1847765451637248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 188us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.767321:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19427 00000100:00100000:3.0:1762167002.769428:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.770913:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167002.771474:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167002.771483:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08a44 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.771491:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167002.771495:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08a44 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.771503:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08a44 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.771515:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x63f:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:3.0:1762167002.771520:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762167002.771526:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08a44 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.771538:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08a44 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x63f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167002.771556:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167002.771559:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167002.771561:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167002.782085:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.782159:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451637888 00000100:00100000:3.0:1762167002.782170:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451637888 00000100:00100000:3.0:1762167002.782226:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19428 00000100:00100000:3.0:1762167002.782236:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56170:x1847765451637888:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167002.782260:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167002.782281:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a4b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d44 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.782342:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a52 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782355:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a52 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782365:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a52 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782385:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08a59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782392:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08a59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782399:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08a59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782511:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a60 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782520:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782526:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167002.782559:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 72042 00000004:00200000:3.0:1762167002.782563:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167002.782579:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782589:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782596:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a52 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782602:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a52 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782609:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a52 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782614:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167002.782617:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a52 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782624:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a52 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782635:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167002.782639:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167002.782644:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a52 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782650:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08a52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782663:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08a59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782670:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08a59 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782675:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08a59 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782680:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167002.782683:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08a59 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782689:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08a59 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782696:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23a00) 00010000:00010000:3.0:1762167002.782699:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167002.782702:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08a59 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782708:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08a59 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167002.782735:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08a4b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d44 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.782757:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d44 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.782805:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167002.782807:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167002.782810:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3200, rc 0) 00000100:00100000:0.0:1762167002.785525:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.788240:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.814739:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.814882:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451638528 00000100:00100000:0.0:1762167002.814892:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451638528 00000100:00100000:0.0:1762167002.814974:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2590 00000100:00100000:0.0:1762167002.814985:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451638528:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167002.815026:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08a91 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.815045:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08a1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d28 expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.815053:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167002.815055:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167002.815058:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08a91 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.815093:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08a1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d28 expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.815106:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08a1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d28 expref: 22 pid: 12402 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.815120:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454352768:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167002.815227:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.817884:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167002.818383:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08a91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.818391:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08a91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.822358:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.822401:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.822462:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451638784 00000100:00100000:0.0:1762167002.822472:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451638784 00000100:00100000:0.0:1762167002.822552:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16279 00000100:00100000:0.0:1762167002.822563:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451638784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167002.822577:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.822593:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08a98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d59 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.822667:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454353024:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762167002.822823:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.824915:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454353024:192.168.203.35@tcp:106: 00010000:00010000:1.0:1762167002.824941:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08a98 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d59 expref: 25 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.824957:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08a98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d59 expref: 25 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.824968:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9c00, rc 0) 00000100:00100000:1.0:1762167002.825002:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451638784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2438us (2647us total) trans 0 rc 301/301 00000100:00100000:1.0:1762167002.825030:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16279 00000100:00100000:3.0:1762167002.827886:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.830605:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.830703:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451639168 00000100:00100000:1.0:1762167002.830715:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451639168 00010000:00010000:1.0:1762167002.830855:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d089fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d1a expref: 25 pid: 12402 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.830898:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7259 00000100:00100000:1.0:1762167002.830910:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451639168:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.830926:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.830947:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d089fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d1a expref: 25 pid: 12402 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.830960:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d089fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d1a expref: 25 pid: 12402 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.830982:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d089fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d1a expref: 25 pid: 12402 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.830996:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.830998:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.831001:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08aa6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.831014:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08aa6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.831044:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.831096:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451639168:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.831105:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7259 00000100:00100000:0.0:1762167002.841197:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.841236:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451639296 00000100:00100000:1.0:1762167002.841246:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451639296 00000100:00100000:1.0:1762167002.841310:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 611 00000100:00100000:1.0:1762167002.841322:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56170:x1847765451639296:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167002.841340:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.841378:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08a83 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d52 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.841396:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:1.0:1762167002.841401:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.841466:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56170:x1847765451639296:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 146us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.841474:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 611 00000100:00100000:3.0:1762167002.842919:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.846426:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.848870:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.848940:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451639936 00000100:00100000:1.0:1762167002.848948:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451639936 00010000:00010000:1.0:1762167002.848986:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d44 expref: 905 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.849023:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7260 00000100:00100000:1.0:1762167002.849032:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2360:x1847765451639936:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.849048:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.849054:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d44 expref: 905 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.849065:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d44 expref: 905 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.849084:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08a60 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d44 expref: 905 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167002.849098:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:1.0:1762167002.849107:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d08ab4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.849115:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d08ab4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.849121:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d08ab4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.849150:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.849196:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2360:x1847765451639936:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.849203:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7260 00000100:00100000:1.0:1762167002.851115:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.853130:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167002.853444:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d08ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.853455:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d08ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167002.853509:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 72042 00000004:00200000:0.0:1762167002.853515:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167002.853540:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d08ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.853577:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08ac2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d6e expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.853600:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d08ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d6e expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.853608:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:0.0:1762167002.853611:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167002.853615:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:0.0:1762167002.853658:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451640064:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2389us (2548us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.853666:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19432 00000100:00100000:1.0:1762167002.855519:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.855563:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.855584:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451640320 00000100:00100000:0.0:1762167002.855594:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451640320 00000100:00100000:0.0:1762167002.855644:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451640448 00000100:00100000:0.0:1762167002.855647:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451640448 00000100:00100000:0.0:1762167002.855789:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16281 00000100:00100000:0.0:1762167002.855799:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451640448:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167002.855810:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.855822:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d08ad7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d7c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.855875:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454353536:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762167002.855940:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.857508:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454353536:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762167002.857538:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d08ad7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d7c expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167002.857559:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d08ad7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d7c expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167002.857571:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8c00, rc 0) 00000100:00100000:0.0:1762167002.857625:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451640448:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1828us (2061us total) trans 0 rc 301/301 00000100:00100000:0.0:1762167002.857633:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16281 00000100:00100000:1.0:1762167002.859509:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.861116:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.861187:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451640960 00000100:00100000:0.0:1762167002.861194:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451640960 00000100:00100000:0.0:1762167002.861249:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19433 00000100:00100000:0.0:1762167002.861259:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451640960:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167002.861277:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.861280:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762167002.861308:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d08ac9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d6e expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.861329:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d08a6e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d4b expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.861341:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08a3d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d3d expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.861351:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:0.0:1762167002.861360:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167002.861374:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08ade lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d83 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.861431:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08ae5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.861443:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167002.861451:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000040:00080000:0.0:1762167002.861952:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5284, 88 off425464 00000004:00080000:0.0:1762167002.861961:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623654197124ns, next at 624276085457ns, rc = 0 00000040:00080000:0.0:1762167002.862023:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5293, 88 off426664 00000004:00080000:0.0:1762167002.862029:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623654266258ns, next at 624276043297ns, rc = 0 00000040:00080000:0.0:1762167002.862066:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5294, 88 off426752 00000004:00080000:0.0:1762167002.862070:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623654307489ns, next at 624276043297ns, rc = 0 00000040:00080000:0.0:1762167002.862086:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5285, 88 off425552 00000004:00080000:0.0:1762167002.862090:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623654326949ns, next at 624276085457ns, rc = 0 00000040:00080000:0.0:1762167002.862107:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5295, 88 off426840 00000004:00080000:0.0:1762167002.862112:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623654348584ns, next at 624276043297ns, rc = 0 00000040:00080000:0.0:1762167002.862143:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5286, 88 off425640 00000004:00080000:0.0:1762167002.862150:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623654386614ns, next at 624276085457ns, rc = 0 00000040:00080000:0.0:1762167002.862181:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5296, 88 off426928 00000004:00080000:0.0:1762167002.862185:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623654422539ns, next at 624276043297ns, rc = 0 00000040:00080000:0.0:1762167002.862601:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5287, 88 off425728 00000004:00080000:0.0:1762167002.862608:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623654844889ns, next at 624276085457ns, rc = 0 00000040:00080000:0.0:1762167002.862643:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5288, 88 off425816 00000004:00080000:0.0:1762167002.862647:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623654884809ns, next at 624276085457ns, rc = 0 00000040:00080000:0.0:1762167002.862665:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5297, 88 off427016 00000004:00080000:0.0:1762167002.862668:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623654905142ns, next at 624276043297ns, rc = 0 00000040:00080000:0.0:1762167002.862704:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5289, 88 off425904 00000004:00080000:0.0:1762167002.862708:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623654945610ns, next at 624276085457ns, rc = 0 00000040:00080000:0.0:1762167002.862739:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5298, 88 off427104 00000004:00080000:0.0:1762167002.862744:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623654981022ns, next at 624276043297ns, rc = 0 00000040:00080000:0.0:1762167002.863137:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5299, 88 off427192 00000004:00080000:0.0:1762167002.863143:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 623655380720ns, next at 624276043297ns, rc = 0 00000040:00080000:0.0:1762167002.863448:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5291, 88 off426072 00000004:00080000:0.0:1762167002.863454:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 623655691226ns, next at 624276085457ns, rc = 0 00010000:00010000:0.0:1762167002.881968:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d83 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.881991:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167002.882003:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000001:00080000:1.0:1762167002.882025:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952492 is committed 00010000:00010000:0.0:1762167002.882025:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08ade lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d83 expref: 905 pid: 32138 timeout: 0 lvb_type: 3 00000004:00080000:1.0:1762167002.882031:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3402 committed 00010000:00010000:0.0:1762167002.882045:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d83 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167002.882048:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3415 committed 00000004:00080000:1.0:1762167002.882059:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3414 committed 00000004:00080000:1.0:1762167002.882062:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3401 committed 00000004:00080000:1.0:1762167002.882064:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3413 committed 00000004:00080000:1.0:1762167002.882067:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3400 committed 00000004:00080000:1.0:1762167002.882070:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3399 committed 00000004:00080000:1.0:1762167002.882073:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3412 committed 00000004:00080000:1.0:1762167002.882075:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3398 committed 00000004:00080000:1.0:1762167002.882078:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3411 committed 00010000:00010000:0.0:1762167002.882079:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00000004:00080000:1.0:1762167002.882081:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3397 committed 00010000:00010000:0.0:1762167002.882082:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1762167002.882083:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3410 committed 00010000:00010000:0.0:1762167002.882085:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8600, rc 0) 00000004:00080000:1.0:1762167002.882086:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3409 committed 00000004:00080000:1.0:1762167002.882088:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3396 committed 00000020:00080000:1.0:1762167002.882126:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee350485c00 refcount 2 committed 0 result 0 batchid 4294969171 00000020:00080000:1.0:1762167002.882131:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee343ef4000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36dc36900 00000020:00080000:1.0:1762167002.882134:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f670d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee350485d80 00000020:00080000:1.0:1762167002.882137:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f670e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee372a28400 00000020:00080000:1.0:1762167002.882140:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].39 00000020:00080000:1.0:1762167002.882152:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969170 batchid updated 00000100:00100000:0.0:1762167002.882154:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451640960:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 20896us (21041us total) trans 8589952492 rc 0/0 00000100:00100000:0.0:1762167002.882164:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19433 00000100:00100000:1.0:1762167002.882191:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454354048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.882253:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.882297:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454354432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.882325:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.882336:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454353664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.882352:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454354944:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167002.882384:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.882389:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.882425:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1762167002.882433:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454353920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167002.882473:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454354048 00000100:00100000:1.0:1762167002.882477:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.882480:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454354176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167002.882481:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454354048 00000100:00100000:1.0:1762167002.882505:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454354560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.882517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167002.882533:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454354432 00000100:00100000:0.0:1762167002.882538:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454354432 00000100:00100000:1.0:1762167002.882541:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.882545:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454354688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167002.882562:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454354944 00000100:00100000:0.0:1762167002.882566:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454354944 00000100:00100000:1.0:1762167002.882569:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454355072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.882575:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167002.882585:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454353664 00000100:00100000:0.0:1762167002.882590:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454353664 00000100:00100000:3.0:1762167002.882596:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454355200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.882606:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167002.882609:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454353920 00000100:00100000:0.0:1762167002.882611:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454353920 00000100:00100000:0.0:1762167002.882630:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454354176 00000100:00100000:3.0:1762167002.882631:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167002.882636:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454354176 00000100:00100000:1.0:1762167002.882643:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454354560 00000100:00100000:1.0:1762167002.882646:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454354560 00000100:00100000:0.0:1762167002.882655:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454354688 00000100:00100000:0.0:1762167002.882657:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454354688 00000100:00100000:1.0:1762167002.882664:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454355072 00000100:00100000:3.0:1762167002.882665:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1762167002.882667:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454355072 00000100:00100000:0.0:1762167002.882670:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16282 00000100:00100000:3.0:1762167002.882677:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454353792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167002.882681:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454354048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.882683:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454355200 00000100:00100000:1.0:1762167002.882686:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454355200 00000100:00100000:3.0:1762167002.882709:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167002.882710:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16283 00000100:00100000:3.0:1762167002.882723:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454354304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.882729:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454354432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167002.882750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.882792:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454354816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.882820:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.882834:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454355328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.882855:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167002.882889:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454353792 00000100:00100000:3.0:1762167002.882893:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454353792 00000100:00100000:3.0:1762167002.882920:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454354304 00000100:00100000:3.0:1762167002.882924:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454354304 00002000:00010000:1.0:1762167002.882930:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 167513 -> 167513 00002000:00010000:0.0:1762167002.882930:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167002.882936:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.882936:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00000100:00100000:3.0:1762167002.882938:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454355328 00002000:00010000:1.0:1762167002.882941:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167002.882941:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.882947:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.882947:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167002.882950:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167002.882950:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167002.882956:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454355328 00000100:00100000:3.0:1762167002.882989:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16285 00000100:00100000:1.0:1762167002.882995:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454354432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 269us (668us total) trans 17179875534 rc 0/0 00000100:00100000:3.0:1762167002.883001:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454353664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167002.883006:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16283 00000100:00100000:0.0:1762167002.883007:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454354048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 327us (753us total) trans 17179875533 rc 0/0 00000100:00100000:0.0:1762167002.883013:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16282 00000100:00100000:1.0:1762167002.883027:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16286 00000100:00100000:0.0:1762167002.883032:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16287 00000100:00100000:1.0:1762167002.883036:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454353920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167002.883039:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454354176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167002.883176:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167002.883180:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.883183:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.883186:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167002.883189:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167002.883197:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454353664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (811us total) trans 21474843028 rc 0/0 00000100:00100000:3.0:1762167002.883209:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16285 00000100:00100000:0.0:1762167002.883215:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454354176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 174us (695us total) trans 17179875536 rc 0/0 00000100:00100000:1.0:1762167002.883216:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454353920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (738us total) trans 21474843029 rc 0/0 00000100:00100000:0.0:1762167002.883223:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16287 00000100:00100000:1.0:1762167002.883226:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16286 00000100:00100000:0.0:1762167002.883246:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16289 00000100:00100000:1.0:1762167002.883250:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16290 00000100:00100000:0.0:1762167002.883255:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454354688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167002.883258:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454355072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167002.883360:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16291 00000100:00100000:3.0:1762167002.883373:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454355200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167002.883375:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167002.883380:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.883382:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:0.0:1762167002.883385:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.883388:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167002.883436:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454355072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (829us total) trans 21474843031 rc 0/0 00000100:00100000:0.0:1762167002.883436:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454354688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (859us total) trans 17179875537 rc 0/0 00000100:00100000:1.0:1762167002.883444:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16290 00000100:00100000:0.0:1762167002.883448:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16289 00000100:00100000:0.0:1762167002.883464:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16293 00000100:00100000:1.0:1762167002.883477:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16294 00000100:00100000:0.0:1762167002.883477:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454354304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167002.883481:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 72042 -> 72042 00002000:00010000:3.0:1762167002.883488:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00000100:00100000:1.0:1762167002.883488:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454354816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167002.883493:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.883497:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167002.883505:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:3.0:1762167002.883540:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454355200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (910us total) trans 17179875538 rc 0/0 00000100:00100000:3.0:1762167002.883546:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16291 00000100:00100000:3.0:1762167002.883560:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16295 00000100:00100000:3.0:1762167002.883568:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454355328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167002.883630:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167002.883634:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.883637:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:0.0:1762167002.883643:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167002.883649:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167002.883682:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167002.883684:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454354816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (861us total) trans 21474843033 rc 0/0 00000100:00100000:0.0:1762167002.883684:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454354304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (932us total) trans 21474843032 rc 0/0 00002000:00010000:3.0:1762167002.883686:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.883692:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.883696:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167002.883699:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16293 00002000:00010000:3.0:1762167002.883702:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167002.883708:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16294 00000100:00100000:3.0:1762167002.883740:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454355328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (883us total) trans 21474843034 rc 0/0 00000100:00100000:3.0:1762167002.883747:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16295 00000004:00080000:0.0:1762167002.883758:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb12680/2, rc 0, transno 21474843029 00000100:00100000:0.0:1762167002.883800:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454353920:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167002.883807:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f331c00/2, rc 0, transno 17179875539 00000100:00100000:3.0:1762167002.883814:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454353792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167002.883821:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb11500/2, rc 0, transno 21474843030 00000100:00100000:0.0:1762167002.883827:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454354560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167002.883836:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb13800/2, rc 0, transno 21474843031 00000100:00100000:0.0:1762167002.883840:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454355072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167002.883852:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f333b80/2, rc 0, transno 17179875534 00000100:00100000:0.0:1762167002.883856:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454354432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167002.883869:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348255f80/2, rc 0, transno 17179875535 00000100:00100000:0.0:1762167002.883872:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454354944:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167002.883883:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f330a80/2, rc 0, transno 17179875533 00000100:00100000:0.0:1762167002.883890:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454354048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167002.886130:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.886229:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451641088 00000100:00100000:3.0:1762167002.886239:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451641088 00000100:00100000:3.0:1762167002.886297:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16296 00000100:00100000:3.0:1762167002.886306:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56065:x1847765451641088:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167002.886323:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167002.886344:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08aec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2d8a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167002.886364:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 72042, mtime: 0x690888da, atime: 0x690888da, ctime: 0x690888db, blocks: 0x135 00010000:00010000:3.0:1762167002.886384:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.886386:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.886394:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 208896->262143) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d8a expref: 22 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.886462:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 208896->262143) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d8a expref: 22 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.886477:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2800, rc 0) 00000100:00100000:3.0:1762167002.886536:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56065:x1847765451641088:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 231us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.886544:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16296 00000100:00100000:0.0:1762167002.888664:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.891399:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.893502:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.895684:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.895717:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.895753:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.895804:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451641728 00000100:00100000:1.0:1762167002.895811:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451641728 00002000:00010000:1.0:1762167002.895832:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (130987->18446744073709551615) 00002000:00100000:1.0:1762167002.895840:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24518a680 with x1847765451641728 ext(130987->18446744073709551615) 00002000:00010000:1.0:1762167002.895855:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24518a680. 00000100:00100000:3.0:1762167002.895857:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451641984 00000100:00100000:3.0:1762167002.895863:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451641984 00002000:00010000:3.0:1762167002.895880:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167002.895884:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee245188700 with x1847765451641984 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167002.895890:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee245188700. 00000100:00100000:1.0:1762167002.895907:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2592 00000100:00100000:1.0:1762167002.895921:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451641728:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167002.895935:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2594 00000100:00100000:3.0:1762167002.895949:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451641984:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167002.896213:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 72042 -> 130987 00002000:00010000:1.0:1762167002.896218:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00002000:00010000:3.0:1762167002.896222:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167002.896223:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167002.896230:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167002.896233:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00002000:00010000:1.0:1762167002.896235:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00002000:00010000:3.0:1762167002.896241:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167002.896245:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167002.896247:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167002.896296:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451641728:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 378us (575us total) trans 21474843036 rc 0/0 00000100:00100000:3.0:1762167002.896299:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451641984:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 352us (543us total) trans 21474843035 rc 0/0 00000100:00100000:1.0:1762167002.896315:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2592 00002000:00010000:1.0:1762167002.896319:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (130987->18446744073709551615) 00000100:00100000:3.0:1762167002.896324:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2594 00002000:00100000:1.0:1762167002.896325:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24518a680 with x1847765451641728 ext(130987->18446744073709551615) 00002000:00010000:3.0:1762167002.896330:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:1.0:1762167002.896333:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24518a680. 00002000:00100000:3.0:1762167002.896337:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee245188700 with x1847765451641984 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167002.896345:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee245188700. 00000100:00100000:0.0:1762167002.897640:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.900085:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.902977:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.908504:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.908586:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451642624 00000100:00100000:1.0:1762167002.908596:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451642624 00000100:00100000:1.0:1762167002.908657:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7213 00000100:00100000:1.0:1762167002.908668:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451642624:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167002.908972:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451642624:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 305us (475us total) trans 8589952495 rc 0/0 00000100:00100000:1.0:1762167002.908982:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7213 00000100:00100000:0.0:1762167002.918098:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.920728:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.921045:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.921160:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451643264 00000100:00100000:1.0:1762167002.921171:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451643264 00000100:00100000:1.0:1762167002.921227:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19439 00000100:00100000:1.0:1762167002.921245:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56171:x1847765451643264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.921276:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.921297:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08b40 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2dad expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.921850:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08b47 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x640:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.921863:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08b47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.921873:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08b47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.921883:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x640:0x0]: returning size 0 00010000:00010000:1.0:1762167002.921925:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08b40 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dad expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.921943:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08b47 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dad expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.921951:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x640:0x0].0x0 (ffff9ee345a77d00) 00010000:00010000:1.0:1762167002.921954:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167002.921957:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ac00, rc 0) 00000100:00100000:1.0:1762167002.922013:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56171:x1847765451643264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 777us (971us total) trans 8589952497 rc 0/0 00000100:00100000:1.0:1762167002.922021:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19439 00000100:00100000:0.0:1762167002.923510:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.923563:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451643520 00000100:00100000:1.0:1762167002.923571:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451643520 00000100:00100000:1.0:1762167002.923616:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19440 00000100:00100000:1.0:1762167002.923624:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56171:x1847765451643520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.923641:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.923658:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08b55 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2db4 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.923750:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.923788:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08b47 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dad expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.923798:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.923833:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08b47 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dad expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.923852:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08b47 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dad expref: 898 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.923867:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454355456:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.923949:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167002.924962:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454355456:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.924980:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167002.925144:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167002.925488:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.925498:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.925510:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x640:0x0]: returning size 0 00000004:00080000:1.0:1762167002.925832:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x816:0x0], index 0: 0 00000004:00080000:1.0:1762167002.925842:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x819:0x0], index 1: 0 00010000:00010000:1.0:1762167002.925982:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.925991:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.925998:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.926003:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167002.926007:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.926014:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.926029:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x640:0x0].0x0 (ffff9ee345a77d00) 00010000:00010000:1.0:1762167002.926032:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167002.926035:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.926040:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08b5c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.926094:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08b55 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2db4 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.926104:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:1.0:1762167002.926107:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762167002.926110:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08b55 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2db4 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.926124:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ba00, rc 0) 00000100:00100000:1.0:1762167002.926176:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56171:x1847765451643520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2552us (2668us total) trans 8589952498 rc 301/301 00000100:00100000:1.0:1762167002.926184:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19440 00000100:00100000:0.0:1762167002.927176:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.927259:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451643904 00000100:00100000:1.0:1762167002.927266:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451643904 00000100:00100000:1.0:1762167002.927310:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7214 00000100:00100000:1.0:1762167002.927318:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56171:x1847765451643904:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167002.927591:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56171:x1847765451643904:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 273us (417us total) trans 8589952499 rc 0/0 00000100:00100000:1.0:1762167002.927599:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7214 00000100:00100000:0.0:1762167002.929132:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.929175:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451644032 00000100:00100000:1.0:1762167002.929184:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451644032 00000100:00100000:1.0:1762167002.929245:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19441 00000100:00100000:1.0:1762167002.929256:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56171:x1847765451644032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.929281:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.929303:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08b6a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x640:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2dbb expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.929368:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08b71 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x640:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.929381:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08b71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.929392:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08b71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.929434:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x640:0x0]: returning size 0 00000004:00200000:1.0:1762167002.929439:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167002.929454:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08b71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.929479:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08b6a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dbb expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.929497:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08b71 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dbb expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.929506:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x640:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:1.0:1762167002.929509:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762167002.929513:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7be00, rc 0) 00000100:00100000:1.0:1762167002.929563:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56171:x1847765451644032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 310us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.929570:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19441 00000100:00100000:0.0:1762167002.931158:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.931195:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.931235:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451644160 00000100:00100000:3.0:1762167002.931244:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451644160 00000100:00100000:1.0:1762167002.931254:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451644288 00000100:00100000:1.0:1762167002.931261:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451644288 00000100:00100000:3.0:1762167002.931374:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16297 00000100:00100000:3.0:1762167002.931389:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451644160:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167002.931407:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167002.931435:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08b78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2dc2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167002.931465:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x816:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762167002.931488:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.931493:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.931504:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08b78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc2 expref: 25 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167002.931527:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08b78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc2 expref: 25 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167002.931553:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3e00, rc 0) 00000100:00100000:3.0:1762167002.931609:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451644160:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 225us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.931630:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16297 00000100:00100000:0.0:1762167002.933405:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.933486:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451644544 00000100:00100000:1.0:1762167002.933493:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451644544 00000100:00100000:1.0:1762167002.933542:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19442 00000100:00100000:1.0:1762167002.933552:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56171:x1847765451644544:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.933568:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167002.933584:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08b86 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2dd0 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.933677:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08b8d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.933691:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08b8d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167002.933702:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08b8d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167002.933715:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:1.0:1762167002.933867:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08b86 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dd0 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.933889:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08b8d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dd0 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.933898:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0b00) 00010000:00010000:1.0:1762167002.933900:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167002.933903:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00000100:00100000:1.0:1762167002.933958:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56171:x1847765451644544:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 408us (559us total) trans 8589952500 rc 0/0 00000100:00100000:1.0:1762167002.933965:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19442 00000100:00100000:0.0:1762167002.936256:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.936296:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.936328:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451644672 00000100:00100000:3.0:1762167002.936341:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451644672 00000100:00100000:0.0:1762167002.936375:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.936402:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451644928 00000100:00100000:3.0:1762167002.936424:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451644928 00000100:00100000:3.0:1762167002.936453:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451644800 00000100:00100000:3.0:1762167002.936456:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451644800 00000100:00100000:3.0:1762167002.936477:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16299 00000100:00100000:3.0:1762167002.936485:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451644672:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167002.936523:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.936560:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08aec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->262143) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d8a expref: 26 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.936571:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167002.936573:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167002.936578:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.936634:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->262143) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d8a expref: 26 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.936658:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08aec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->262143) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d8a expref: 26 pid: 6535 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167002.936688:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454355584:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167002.936800:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167002.936876:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16301 00000100:00100000:0.0:1762167002.936886:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451644800:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762167002.936906:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.936917:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.936928:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167002.936930:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167002.936933:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.936952:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.936961:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 26 pid: 12402 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167002.936972:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454355840:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167002.937257:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e39da80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167002.938538:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454355584:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167002.938588:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454355840:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167002.938607:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.938697:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.938812:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.938847:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.938897:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.938902:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451645056 00000100:00100000:3.0:1762167002.938908:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451645056 00010000:00010000:3.0:1762167002.938928:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08a28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d36 expref: 27 pid: 12402 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167002.939184:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7263 00000100:00100000:0.0:1762167002.939195:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7264 00000100:00100000:1.0:1762167002.939199:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451645184:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762167002.939206:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451645056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.939217:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.939217:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762167002.939225:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7265 00000100:00100000:3.0:1762167002.939236:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451645312:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.939240:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 27 pid: 12402 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.939243:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08a28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d36 expref: 28 pid: 12402 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.939252:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167002.939257:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08a28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d36 expref: 28 pid: 12402 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.939269:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08aec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->262143) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d8a expref: 28 pid: 6535 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.939284:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08aec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->262143) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d8a expref: 28 pid: 6535 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.939290:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08a28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d36 expref: 28 pid: 12402 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.939304:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08aec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->262143) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d8a expref: 27 pid: 6535 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.939307:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.939311:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.939317:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08ba2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939324:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.939327:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.939327:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08ba2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939330:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 27 pid: 12402 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167002.939334:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939347:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939351:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08a21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d2f expref: 27 pid: 12402 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167002.939362:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.939368:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.939369:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.939372:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939374:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167002.939381:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939401:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167002.939403:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451645056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 198us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.939406:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451645312:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 170us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.939430:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7264 00000100:00100000:3.0:1762167002.939439:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7265 00000100:00100000:1.0:1762167002.939440:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451645184:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 245us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.939450:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7263 00010000:00010000:3.0:1762167002.939474:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939494:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939501:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939511:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939515:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939534:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939542:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939568:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939569:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939596:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167002.939597:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939607:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939608:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167002.939614:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939635:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939637:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939666:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939668:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.939688:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08ba9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167002.939734:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08b9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167002.939737:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451644800:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2850us (3358us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.939755:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16301 00000100:00100000:3.0:1762167002.939816:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451644672:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3331us (3568us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167002.939823:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16299 00000100:00100000:0.0:1762167002.941709:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.941737:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.941759:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451645440 00000100:00100000:3.0:1762167002.941787:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451645440 00000100:00100000:3.0:1762167002.941822:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451645568 00000100:00100000:0.0:1762167002.941823:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167002.941825:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451645568 00000100:00100000:3.0:1762167002.941847:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451645696 00000100:00100000:3.0:1762167002.941850:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451645696 00000100:00100000:1.0:1762167002.941863:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16302 00000100:00100000:0.0:1762167002.941877:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16303 00000100:00100000:1.0:1762167002.941881:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451645440:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:3.0:1762167002.941887:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16304 00000100:00100000:0.0:1762167002.941891:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451645568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167002.941902:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.941902:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167002.941923:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08bb7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2dde expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.941924:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08bb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2dd7 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167002.941939:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451645696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167002.941953:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1762167002.941954:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888db, atime: 0x690888da, ctime: 0x690888db, blocks: 0x3 00002000:00010000:1.0:1762167002.941958:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888da, ctime: 0x690888db, blocks: 0x135 00010000:00010000:3.0:1762167002.941964:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08bbe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2de5 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.941969:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.941972:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.941973:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.941977:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.941982:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08bb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dde expref: 26 pid: 7858 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1762167002.941986:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888db, atime: 0x690888da, ctime: 0x690888db, blocks: 0x3 00010000:00010000:1.0:1762167002.941988:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08bb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dd7 expref: 25 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167002.941995:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167002.941998:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167002.942002:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08bb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dde expref: 26 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167002.942004:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2de5 expref: 26 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.942010:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08bb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dd7 expref: 26 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167002.942016:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8800, rc 0) 00010000:00010000:3.0:1762167002.942018:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2de5 expref: 26 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167002.942030:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b600, rc 0) 00010000:00010000:3.0:1762167002.942032:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2200, rc 0) 00000100:00100000:3.0:1762167002.942067:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451645696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 130us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.942067:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451645568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 180us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.942069:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451645440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 194us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167002.942080:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16303 00000100:00100000:3.0:1762167002.942084:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16304 00000100:00100000:1.0:1762167002.942091:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16302 00000100:00100000:0.0:1762167002.967115:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167002.969342:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08bc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.969356:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08bc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.969362:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08bc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.969366:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167002.969369:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08bc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.969374:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08bc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.969388:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08bc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167002.969393:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08bc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167002.969464:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451645824:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2141us (2357us total) trans 0 rc 130987/130987 00000100:00100000:0.0:1762167002.969471:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2597 00000100:00100000:0.0:1762167002.972271:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167002.974958:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167002.975026:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451646080 00000100:00100000:1.0:1762167002.975038:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451646080 00010000:00010000:1.0:1762167002.975086:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08b78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc2 expref: 26 pid: 6535 timeout: 723 lvb_type: 1 00000100:00100000:1.0:1762167002.975151:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7266 00000100:00100000:1.0:1762167002.975171:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451646080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167002.975194:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167002.975223:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08b78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc2 expref: 26 pid: 6535 timeout: 723 lvb_type: 1 00010000:00010000:1.0:1762167002.975239:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08b78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc2 expref: 26 pid: 6535 timeout: 723 lvb_type: 1 00010000:00010000:1.0:1762167002.975266:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08b78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc2 expref: 26 pid: 6535 timeout: 723 lvb_type: 1 00010000:00010000:1.0:1762167002.975284:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.975287:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167002.975292:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d08bcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.975303:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d08bcc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167002.975348:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167002.975430:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451646080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 262us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167002.975445:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7266 00000001:00080000:1.0:1762167002.992045:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843032 is committed 00000001:00080000:1.0:1762167002.992063:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843026 is committed 00000001:00080000:1.0:1762167002.992074:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843036 is committed 00000001:00080000:1.0:1762167002.992080:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843033 is committed 00000001:00080000:1.0:1762167002.992097:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843037 is committed 00000001:00080000:1.0:1762167002.992115:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843034 is committed 00000100:00100000:1.0:1762167002.994273:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000001:00080000:1.0:1762167003.012107:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952500 is committed 00000020:00080000:1.0:1762167003.012139:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969171 batchid updated 00000100:00100000:3.0:1762167003.012214:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56171:x1847765451646208:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 17687us (17942us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.012226:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19443 00000100:00100000:0.0:1762167003.014124:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.014166:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.014218:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451646336 00000100:00100000:3.0:1762167003.014226:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451646336 00000100:00100000:1.0:1762167003.014247:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451646464 00000100:00100000:1.0:1762167003.014252:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451646464 00000100:00080000:0.0:1762167003.014299:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762167003.014305:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762167003.014310:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16305 00000100:00100000:1.0:1762167003.014319:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16306 00000100:00100000:3.0:1762167003.014322:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451646336:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762167003.014333:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451646464:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:3.0:1762167003.014431:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451646336:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 111us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.014432:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451646464:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 102us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.014449:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16305 00000100:00100000:1.0:1762167003.014457:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16306 00000100:00100000:0.0:1762167003.021672:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.021712:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.021737:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.021802:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451646592 00000100:00100000:1.0:1762167003.021814:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451646592 00000100:00100000:1.0:1762167003.021878:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451646848 00000100:00100000:1.0:1762167003.021883:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451646848 00000100:00100000:3.0:1762167003.021916:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16308 00000100:00100000:1.0:1762167003.021927:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16309 00000100:00100000:3.0:1762167003.021933:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451646720:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167003.021941:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451646848:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167003.021963:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08bda lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.021967:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08be1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.021989:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.021991:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.021994:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.021995:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.022003:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08bda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.022004:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.022031:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08bda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.022033:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.022077:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08bda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.022079:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.022103:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08bda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.022108:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08be1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.022119:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.022135:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.022138:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167003.022146:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.022159:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ba00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167003.022167:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.022168:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.022194:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.022198:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08bda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.022223:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08bda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.022235:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08be1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.022244:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08be1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.022310:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451646720:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 382us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.022317:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451646848:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 379us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.022325:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16308 00000100:00100000:1.0:1762167003.022335:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16309 00000100:00100000:0.0:1762167003.023722:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.023829:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451647104 00000100:00100000:3.0:1762167003.023837:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451647104 00000100:00080000:0.0:1762167003.023891:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762167003.023916:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19444 00000100:00100000:3.0:1762167003.023925:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56171:x1847765451647104:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167003.023967:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.023987:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08b71 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x640:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dbb expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.024001:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x640:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:3.0:1762167003.024010:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167003.024057:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x640:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.024069:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.024077:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:3.0:1762167003.024212:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fbae1c78 reply state 00000000353983b1 transno 8589952501 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167003.024220:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167003.024298:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56171:x1847765451647104:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 373us (581us total) trans 8589952501 rc 0/0 00000100:00100000:3.0:1762167003.024305:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19444 00010000:00010000:3.0:1762167003.025113:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.025124:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.025131:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.025136:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.025140:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.025147:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.025157:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x640:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:3.0:1762167003.025160:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.025163:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.025168:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08be8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x640:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167003.026010:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.026182:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451647232 00000100:00100000:3.0:1762167003.026189:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451647232 00000100:00100000:3.0:1762167003.026236:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19445 00000100:00100000:3.0:1762167003.026245:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56171:x1847765451647232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.026264:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.026280:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08bef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x640:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2dec expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.026328:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08bef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dec expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.026341:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08bef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dec expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.026357:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x640:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167003.026360:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167003.026363:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3e00, rc 0) 00000100:00100000:3.0:1762167003.026428:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56171:x1847765451647232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 183us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.026438:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19445 00000100:00100000:0.0:1762167003.028488:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.028529:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.028552:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451647360 00000100:00100000:3.0:1762167003.028561:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451647360 00000100:00100000:3.0:1762167003.028616:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16310 00000100:00100000:3.0:1762167003.028627:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451647360:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167003.028984:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451647360:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 358us (499us total) trans 21474843038 rc 0/0 00000100:00100000:3.0:1762167003.029002:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16310 00000100:00100000:0.0:1762167003.030234:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.030273:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451647744 00000100:00100000:3.0:1762167003.030280:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451647744 00000100:00100000:3.0:1762167003.030323:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19446 00000100:00100000:3.0:1762167003.030332:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56171:x1847765451647744:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:3.0:1762167003.030381:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08bf6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x640:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.030397:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.030408:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.030441:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.030448:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08bf6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.030454:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.030460:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.030465:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.030472:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08bf6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.030484:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x640:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167003.030487:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1762167003.030492:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08bf6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x640:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.030502:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08bf6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x640:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167003.030559:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56171:x1847765451647744:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 228us (327us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762167003.030567:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19446 00000100:00100000:0.0:1762167003.031626:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.031666:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451648000 00000100:00100000:3.0:1762167003.031672:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451648000 00000100:00100000:3.0:1762167003.031725:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19447 00000100:00100000:3.0:1762167003.031734:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56171:x1847765451648000:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167003.031791:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.031814:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08b16 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d9f expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.031829:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0b00) 00010000:00010000:3.0:1762167003.031834:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167003.031865:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08bfd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.031876:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08bfd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.031884:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08bfd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:3.0:1762167003.032042:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000604ccfc5 reply state 000000003dc85ce0 transno 8589952502 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08bfd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167003.032057:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167003.032133:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56171:x1847765451648000:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 400us (508us total) trans 8589952502 rc 0/0 00000100:00100000:3.0:1762167003.032140:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19447 00000100:00100000:0.0:1762167003.034214:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.034255:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.034322:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.034375:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451648128 00000100:00100000:3.0:1762167003.034385:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451648128 00000100:00100000:1.0:1762167003.034408:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16312 00000100:00100000:1.0:1762167003.034433:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451648256:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167003.034465:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16314 00000100:00100000:3.0:1762167003.034480:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451648128:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167003.034629:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.034633:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.034636:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167002 -> 1762167003 00002000:00010000:1.0:1762167003.034638:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.034642:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167003.034659:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:3.0:1762167003.034664:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.034670:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167002 -> 1762167003 00002000:00010000:3.0:1762167003.034677:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.034684:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 137 00000100:00100000:1.0:1762167003.034700:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451648256:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 270us (497us total) trans 17179875542 rc 0/0 00000100:00100000:1.0:1762167003.034714:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16312 00000100:00100000:3.0:1762167003.034720:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451648128:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 241us (461us total) trans 21474843039 rc 0/0 00000100:00100000:3.0:1762167003.034739:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16314 00000100:00100000:0.0:1762167003.035914:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.035980:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451648640 00000100:00100000:1.0:1762167003.035986:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451648640 00000100:00100000:1.0:1762167003.036026:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7215 00000100:00100000:1.0:1762167003.036034:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348213c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56171:x1847765451648640:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762167003.036092:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08b8d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dd0 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.036122:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.036133:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d08b08 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d98 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.036141:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.036171:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d08b08 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d98 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.036184:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d08b08 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d98 expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167003.036197:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454356096:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.036270:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.037207:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454356096:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.037225:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167003.037575:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.037811:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451648768 00000100:00100000:1.0:1762167003.037817:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451648768 00010000:00010000:1.0:1762167003.037840:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d08b08 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d98 expref: 895 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167003.037872:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7267 00000100:00100000:1.0:1762167003.037883:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451648768:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.037896:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.037903:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d08b08 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d98 expref: 895 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.037913:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d08b08 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d98 expref: 895 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.037930:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d08b08 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d98 expref: 895 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.037944:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0b00) 00010000:00010000:1.0:1762167003.037949:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.037957:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.037963:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.037991:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167003.038019:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167003.038027:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167003.038034:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451648768:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 151us (457us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167003.038042:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167003.038047:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7267 00010000:00010000:0.0:1762167003.038062:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08bef lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dec expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.038070:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167003.038095:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08bef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dec expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.038107:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08bef lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dec expref: 893 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1762167003.038118:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454356224:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167003.038167:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f300 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.039016:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24786bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454356224:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.039031:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167003.039586:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451648896 00000100:00100000:1.0:1762167003.039592:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451648896 00010000:00010000:1.0:1762167003.039617:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08bef lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dec expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167003.039644:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7268 00000100:00100000:1.0:1762167003.039653:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765451648896:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.039663:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.039668:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08bef lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dec expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.039678:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08bef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dec expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.039693:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08bef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x640:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dec expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.039706:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x640:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:1.0:1762167003.039710:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.039718:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.039724:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.039755:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167003.039822:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2361:x1847765451648896:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 169us (360us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167003.039823:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167003.039836:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7268 00010000:00010000:0.0:1762167003.039837:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167003.040340:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247869f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.040382:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.040424:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f540 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.040439:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454356352 00000100:00100000:1.0:1762167003.040445:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454356352 00000100:00100000:1.0:1762167003.040487:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1762167003.040495:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454356352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.040575:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454356352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.040582:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1762167003.040635:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843034 gen 2 00000004:00080000:0.0:1762167003.040641:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e62ad80, transno 21474843023 00000004:00080000:0.0:1762167003.040658:0:30820:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843027 committed transno 21474843034 00000004:00080000:0.0:1762167003.040675:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb11c00, transno 21474843028 00000004:00080000:0.0:1762167003.040678:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb12680, transno 21474843029 00000004:00080000:0.0:1762167003.040680:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb11500, transno 21474843030 00000004:00080000:0.0:1762167003.040683:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb13800, transno 21474843031 00000004:00080000:0.0:1762167003.040685:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb11f80, transno 21474843032 00000004:00080000:0.0:1762167003.040687:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb12300, transno 21474843033 00000004:00080000:0.0:1762167003.040690:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb12a00, transno 21474843034 00000100:00100000:0.0:1762167003.040696:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247869f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.040734:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247869f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.040782:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.040803:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f540 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.040921:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454356480 00000100:00100000:1.0:1762167003.040926:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454356480 00000100:00100000:1.0:1762167003.040963:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1762167003.040970:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454356480:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.041037:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454356480:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 67us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.041046:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1762167003.041167:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247869f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.041205:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.041223:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.041241:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345742840 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.041264:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454356608 00000100:00100000:1.0:1762167003.041270:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454356608 00000100:00100000:1.0:1762167003.041302:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1762167003.041309:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454356608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.041361:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454356608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.041368:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1762167003.041401:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.041452:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.041478:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.041501:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.041525:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454356736 00000100:00100000:3.0:1762167003.041530:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454356736 00000100:00100000:3.0:1762167003.041564:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1762167003.041571:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454356736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.041625:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454356736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.041631:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1762167003.041657:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.041695:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.041718:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.041738:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36dc36900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.041752:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454356864 00000100:00100000:3.0:1762167003.041757:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454356864 00000100:00100000:3.0:1762167003.041801:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1762167003.041808:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454356864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.041864:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454356864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 57us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.041871:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1762167003.041927:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.041950:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.041966:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.041987:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.042001:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454356992 00000100:00100000:3.0:1762167003.042004:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454356992 00000100:00100000:3.0:1762167003.042034:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1762167003.042045:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454356992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.042090:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454356992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 47us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.042096:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1762167003.042113:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454356992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.042143:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.042162:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.042179:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345742840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.042193:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454357120 00000100:00100000:3.0:1762167003.042196:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454357120 00000100:00100000:3.0:1762167003.042218:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1762167003.042224:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454357120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.042266:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454357120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 42us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.042272:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1762167003.042279:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.042306:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.042325:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.042341:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36dc36900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.042342:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454357248 00000100:00100000:3.0:1762167003.042345:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454357248 00000100:00100000:3.0:1762167003.042367:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1762167003.042373:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454357248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.042427:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454357248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.042433:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1762167003.042437:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.042466:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.042485:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.042501:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.042502:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454357376 00000100:00100000:3.0:1762167003.042506:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454357376 00000100:00100000:3.0:1762167003.042530:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1762167003.042535:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454357376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.042585:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454357376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.042591:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1762167003.042701:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.042726:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.042741:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.042757:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345742840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.042790:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454357504 00000100:00100000:3.0:1762167003.042794:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454357504 00000100:00100000:3.0:1762167003.042815:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1762167003.042820:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454357504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.042860:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454357504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.042866:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1762167003.042871:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.042903:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.042924:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.042940:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36dc36900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.042948:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454357632 00000100:00100000:3.0:1762167003.042952:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454357632 00000100:00100000:3.0:1762167003.042973:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1762167003.042978:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454357632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.043020:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454357632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 41us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.043026:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1762167003.043029:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.043056:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.043075:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.043102:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.043224:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454357760 00000100:00100000:3.0:1762167003.043228:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454357760 00000100:00100000:0.0:1762167003.043385:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1762167003.043396:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454357760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.043468:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454357760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.043474:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1762167003.043511:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.043554:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.043579:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.043600:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.043606:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454357888 00000100:00100000:3.0:1762167003.043612:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454357888 00000100:00100000:3.0:1762167003.043644:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1762167003.043651:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454357888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.043708:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454357888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.043715:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1762167003.043813:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454357888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.043848:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454358016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.043872:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.043893:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.043903:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454358016 00000100:00100000:3.0:1762167003.043909:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454358016 00000100:00100000:3.0:1762167003.043943:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1762167003.043949:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454358016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.044002:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454358016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.044008:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1762167003.044072:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454358016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.044101:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454358144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.044121:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.044142:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.044183:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454358144 00000100:00100000:3.0:1762167003.044187:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454358144 00000100:00100000:3.0:1762167003.044209:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1762167003.044215:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454358144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.044299:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454358144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.044305:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1762167003.044352:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454358144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.044384:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454358272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.044404:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.044436:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.044462:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454358272 00000100:00100000:3.0:1762167003.044468:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454358272 00000100:00100000:3.0:1762167003.044497:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1762167003.044504:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454358272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.044555:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454358272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.044560:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1762167003.044590:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454358272:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:1.0:1762167003.044842:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].40, 912 off55168 00000001:00080000:1.0:1762167003.044851:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952503 00000100:00100000:1.0:1762167003.044907:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454358400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.044927:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.044948:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.044968:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454358400 00000100:00100000:3.0:1762167003.044973:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454358400 00000100:00100000:3.0:1762167003.044996:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1762167003.045000:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454358400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.045278:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454358400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 276us (349us total) trans 21474843041 rc 0/0 00000100:00100000:3.0:1762167003.045286:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1762167003.045329:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454358400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.045355:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454358528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.045380:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.045403:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.045448:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454358528 00000100:00100000:3.0:1762167003.045453:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454358528 00000100:00100000:3.0:1762167003.045486:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1762167003.045494:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454358528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.045657:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454358528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 164us (275us total) trans 17179875543 rc 0/0 00000100:00100000:3.0:1762167003.045665:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1762167003.045700:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454358528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1762167003.045834:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952504 00010000:00010000:1.0:1762167003.045863:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.045873:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.045880:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.045886:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167003.045891:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.045903:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.045918:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x640:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:1.0:1762167003.045921:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167003.045925:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.045931:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08c0b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x640:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.045986:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.045993:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.045998:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.046003:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ba00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167003.046006:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.046011:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.046017:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0b00) 00010000:00010000:1.0:1762167003.046019:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167003.046021:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.046025:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08c04 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.046035:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0b00) 00010000:00010000:1.0:1762167003.046037:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167003.046042:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08b8d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dd0 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.046130:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348213c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56171:x1847765451648640:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 10097us (10219us total) trans 8589952505 rc 0/0 00000100:00100000:1.0:1762167003.046144:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7215 00000020:00080000:1.0:1762167003.046148:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762167003.047582:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451649024 00000100:00100000:3.0:1762167003.047587:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451649024 00000100:00100000:3.0:1762167003.047628:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19448 00000100:00100000:3.0:1762167003.047637:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56171:x1847765451649024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.047654:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.047671:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08c12 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2df3 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.047718:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08c12 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2df3 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.047731:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08c12 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2df3 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.047747:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:3.0:1762167003.047751:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167003.047753:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3a00, rc 0) 00000100:00100000:3.0:1762167003.047842:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56171:x1847765451649024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 196us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.047849:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19448 00000100:00100000:0.0:1762167003.049299:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.049366:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451649280 00000100:00100000:1.0:1762167003.049372:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451649280 00000100:00100000:1.0:1762167003.049429:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7216 00000100:00100000:1.0:1762167003.049439:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56171:x1847765451649280:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167003.049612:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56171:x1847765451649280:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 175us (317us total) trans 8589952506 rc 0/0 00000100:00100000:1.0:1762167003.049620:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7216 00000100:00100000:1.0:1762167003.050710:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451649536 00000100:00100000:1.0:1762167003.050717:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451649536 00000100:00100000:1.0:1762167003.050788:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7217 00000100:00100000:1.0:1762167003.050797:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56171:x1847765451649536:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762167003.051011:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x640:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762167003.051116:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x640:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.051127:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.051134:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.051140:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.051144:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.051150:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.051169:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762167003.051209:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167003.051227:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.051236:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ae00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167003.051240:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.051248:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x640:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167003.051253:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56171:x1847765451649536:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 455us (649us total) trans 8589952507 rc 0/0 00000100:00100000:1.0:1762167003.051264:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7217 00010000:00010000:3.0:1762167003.051266:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x640:0x0].0x0 (ffff9ee345a77400) 00010000:00010000:3.0:1762167003.051271:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762167003.051276:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x640:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.051282:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08c19 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x640:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.051302:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167003.051304:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167003.051306:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167003.061200:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451649664 00000100:00100000:3.0:1762167003.061211:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451649664 00000100:00100000:3.0:1762167003.061282:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19449 00000100:00100000:3.0:1762167003.061291:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56172:x1847765451649664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.061322:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.061344:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08c20 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2dfa expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.061425:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08c27 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061436:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08c27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061445:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08c27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061460:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08c2e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061467:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08c2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061474:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08c2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061568:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061573:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061578:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167003.061605:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:3.0:1762167003.061609:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167003.061624:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061636:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061643:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08c27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061649:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08c27 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061666:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08c27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061672:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.061676:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08c27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061683:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08c27 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061697:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167003.061701:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.061706:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08c27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061717:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08c27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061733:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08c2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061739:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08c2e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061744:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08c2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061750:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.061752:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08c2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061758:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08c2e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061818:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23300) 00010000:00010000:3.0:1762167003.061821:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.061824:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08c2e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061828:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08c2e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.061855:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08c20 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dfa expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.061871:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dfa expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.061878:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:3.0:1762167003.061880:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.061884:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3e00, rc 0) 00000100:00100000:3.0:1762167003.061948:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56172:x1847765451649664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 658us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.061956:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19449 00000100:00100000:0.0:1762167003.064225:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.064279:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451649920 00000100:00100000:3.0:1762167003.064331:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451649920 00000100:00100000:3.0:1762167003.064400:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19450 00000100:00100000:3.0:1762167003.064420:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56172:x1847765451649920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.064439:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.064459:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d08c3c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e01 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.064555:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abda00/0xf915a5bdf3d08c43 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.064569:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abda00/0xf915a5bdf3d08c43 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.064578:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abda00/0xf915a5bdf3d08c43 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167003.064589:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.064731:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d08c3c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e01 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.064749:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abda00/0xf915a5bdf3d08c43 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e01 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.064757:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:3.0:1762167003.064792:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167003.064796:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372abda00, rc 0) 00000100:00100000:3.0:1762167003.064861:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56172:x1847765451649920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 451us (641us total) trans 8589952508 rc 0/0 00000100:00100000:3.0:1762167003.064869:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19450 00000100:00100000:3.0:1762167003.066302:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451650176 00000100:00100000:3.0:1762167003.066309:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451650176 00000100:00100000:3.0:1762167003.066349:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19451 00000100:00100000:3.0:1762167003.066359:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56172:x1847765451650176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.066381:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.066395:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d08c51 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e08 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.066478:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c58 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.066490:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c58 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.066499:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c58 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167003.066511:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.066599:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d08c51 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e08 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.066614:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c58 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e08 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.066622:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:3.0:1762167003.066625:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167003.066628:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28600, rc 0) 00000100:00100000:3.0:1762167003.066678:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56172:x1847765451650176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 320us (430us total) trans 8589952509 rc 0/0 00000100:00100000:3.0:1762167003.066685:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19451 00000100:00100000:0.0:1762167003.092556:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451650304 00000100:00100000:0.0:1762167003.092567:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451650304 00000100:00100000:0.0:1762167003.092642:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2599 00000100:00100000:0.0:1762167003.092654:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451650304:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167003.092690:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08c66 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.092704:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.092706:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.092712:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08c66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.092731:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08c66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.096913:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451650432 00000100:00100000:0.0:1762167003.096927:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451650432 00000100:00100000:0.0:1762167003.096996:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2600 00000100:00100000:0.0:1762167003.097006:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451650432:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:0.0:1762167003.097052:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x816:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888db, ctime: 0x690888db, blocks: 0x103 00010000:00010000:0.0:1762167003.097061:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08c6d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.097073:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.097075:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.097080:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08c6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.097091:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d08c6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.106545:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451650560 00000100:00100000:3.0:1762167003.106554:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451650560 00000100:00100000:3.0:1762167003.106621:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 613 00000100:00100000:3.0:1762167003.106631:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56172:x1847765451650560:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:3.0:1762167003.106648:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.106673:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c58 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e08 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.106689:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:3.0:1762167003.106695:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167003.106755:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56172:x1847765451650560:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 126us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.106802:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 613 00000100:00100000:1.0:1762167003.108072:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.108202:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451650816 00000100:00100000:0.0:1762167003.108216:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451650816 00000100:00100000:0.0:1762167003.108286:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7218 00000100:00100000:0.0:1762167003.108300:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56172:x1847765451650816:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167003.108629:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56172:x1847765451650816:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 333us (558us total) trans 8589952510 rc 0/0 00000100:00100000:0.0:1762167003.108638:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7218 00000100:00100000:0.0:1762167003.111110:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.111156:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451651072 00000100:00100000:3.0:1762167003.111166:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451651072 00000100:00100000:3.0:1762167003.111213:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19452 00000100:00100000:3.0:1762167003.111220:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56065:x1847765451651072:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167003.111239:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.111255:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d08c74 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e0f expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.111335:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08c7b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.111346:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dfa expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.111351:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08c7b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.111375:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dfa expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.111384:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dfa expref: 903 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167003.111393:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454358656:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.111467:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.112338:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454358656:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167003.112358:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08c7b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167003.112568:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.112660:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451651200 00000100:00100000:3.0:1762167003.112666:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451651200 00010000:00010000:3.0:1762167003.112694:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dfa expref: 904 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167003.112731:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7269 00000100:00100000:3.0:1762167003.112739:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2361:x1847765451651200:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167003.112749:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.112755:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dfa expref: 904 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167003.112786:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dfa expref: 904 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167003.112804:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08c35 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dfa expref: 904 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167003.112823:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:3.0:1762167003.112827:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08c7b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.112833:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08c7b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.112840:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08c7b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.112864:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167003.112911:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2361:x1847765451651200:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.112919:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7269 00000100:00100000:0.0:1762167003.114328:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.116219:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.116290:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451651456 00000100:00100000:1.0:1762167003.116297:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451651456 00010000:00010000:1.0:1762167003.116336:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08c7b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e0f expref: 905 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167003.116365:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7270 00000100:00100000:1.0:1762167003.116374:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2360:x1847765451651456:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.116386:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.116392:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08c7b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e0f expref: 905 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.116404:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08c7b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e0f expref: 905 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.116438:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08c7b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e0f expref: 905 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.116452:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23a00) 00010000:00010000:1.0:1762167003.116457:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08c90 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167003.116465:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08c90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167003.116472:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08c90 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167003.116495:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167003.116539:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2360:x1847765451651456:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.116552:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7270 00000100:00100000:0.0:1762167003.118112:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.118186:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.118290:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16316 00000100:00100000:3.0:1762167003.118300:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451651712:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167003.118308:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.118320:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e24 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.118339:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.118341:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.118347:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e24 expref: 29 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.118361:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e24 expref: 29 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.118377:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28600, rc 0) 00000100:00100000:3.0:1762167003.118425:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451651712:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 127us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.118433:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16316 00000100:00100000:0.0:1762167003.119921:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.121508:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.123624:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.125513:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.125864:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451652352 00000100:00100000:1.0:1762167003.125872:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451652352 00000100:00100000:1.0:1762167003.125917:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7219 00000100:00100000:1.0:1762167003.125924:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451652352:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167003.126124:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451652352:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 199us (616us total) trans 8589952512 rc 0/0 00000100:00100000:1.0:1762167003.126132:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7219 00000100:00100000:0.0:1762167003.128555:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000001:00080000:1.0:1762167003.144447:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952510 is committed 00000001:00080000:1.0:1762167003.144467:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952512 is committed 00000020:00080000:1.0:1762167003.144482:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee36e62f540 refcount 2 committed 0 result 0 batchid 4294969172 00000020:00080000:1.0:1762167003.144488:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee348287a80 00000020:00080000:1.0:1762167003.144495:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36e62f6c0 00000020:00080000:1.0:1762167003.144499:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee243168c00 00000020:00080000:1.0:1762167003.144502:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].40 00000001:00080000:1.0:1762167003.144527:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952513 is committed 00000004:00080000:1.0:1762167003.144534:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3423 committed 00000004:00080000:1.0:1762167003.144552:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3410 committed 00000020:00080000:3.0:1762167003.144559:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969172 committed batchid 4294969171 00000004:00080000:1.0:1762167003.144564:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3409 committed 00000004:00080000:1.0:1762167003.144569:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3422 committed 00000004:00080000:1.0:1762167003.144572:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3421 committed 00000004:00080000:1.0:1762167003.144574:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3408 committed 00000004:00080000:1.0:1762167003.144577:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3420 committed 00000004:00080000:1.0:1762167003.144580:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3407 committed 00000004:00080000:1.0:1762167003.144587:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3406 committed 00000004:00080000:1.0:1762167003.144591:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3419 committed 00000004:00080000:1.0:1762167003.144596:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3405 committed 00000004:00080000:1.0:1762167003.144599:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3418 committed 00000004:00080000:1.0:1762167003.144602:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3404 committed 00000004:00080000:1.0:1762167003.144605:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3417 committed 00000004:00080000:1.0:1762167003.144608:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3416 committed 00000004:00080000:1.0:1762167003.144611:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3403 committed 00000100:00100000:0.0:1762167003.144845:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454359424:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1762167003.144861:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969171 00000100:00100000:1.0:1762167003.144880:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454359296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.144891:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.144931:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.144935:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454359936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.144962:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454359808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.144970:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.145000:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.145008:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454360448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.145036:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454360320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.145043:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.145071:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.145077:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762167003.145086:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454360576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.145096:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454360832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.145118:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.145131:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.145155:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454359296 00000100:00100000:0.0:1762167003.145161:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454359296 00000100:00100000:1.0:1762167003.145171:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454359936 00000100:00100000:1.0:1762167003.145177:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454359936 00000100:00100000:0.0:1762167003.145185:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454359808 00000100:00100000:0.0:1762167003.145189:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454359808 00000100:00100000:1.0:1762167003.145205:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454360320 00000100:00100000:0.0:1762167003.145207:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454360576 00000100:00100000:1.0:1762167003.145210:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454360320 00000100:00100000:0.0:1762167003.145212:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454360576 00000100:00100000:1.0:1762167003.145236:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16319 00000100:00100000:1.0:1762167003.145245:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454358912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.145265:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16321 00000100:00100000:0.0:1762167003.145280:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3293:x1847765454359424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.145289:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16322 00000100:00100000:3.0:1762167003.145302:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454359296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167003.145461:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 167513 -> 167513 00002000:00010000:0.0:1762167003.145470:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.145478:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167003.145486:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167003.145490:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.145494:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167003.145496:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167003.145500:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167003.145508:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167003.145511:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167003.145545:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454359424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 268us (656us total) trans 17179875544 rc 0/0 00000100:00100000:1.0:1762167003.145551:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454358912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 307us (827us total) trans 17179875547 rc 0/0 00000100:00100000:0.0:1762167003.145558:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16321 00000100:00100000:1.0:1762167003.145570:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16319 00000100:00100000:0.0:1762167003.145580:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16324 00000100:00100000:1.0:1762167003.145588:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16325 00000100:00100000:0.0:1762167003.145593:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454359936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.145598:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454359808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167003.145728:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.145732:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167003.145735:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:1.0:1762167003.145738:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167003.145740:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167003.145747:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.145752:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.145754:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:0.0:1762167003.145758:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.145787:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167003.145792:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454359808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (797us total) trans 21474843043 rc 0/0 00000100:00100000:1.0:1762167003.145803:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16325 00000100:00100000:1.0:1762167003.145829:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16327 00000100:00100000:0.0:1762167003.145837:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454359936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 246us (864us total) trans 17179875548 rc 0/0 00000100:00100000:1.0:1762167003.145840:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454360320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.145853:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16324 00000100:00100000:3.0:1762167003.145873:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454359296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 573us (940us total) trans 17179875546 rc 0/0 00000100:00100000:0.0:1762167003.145878:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16328 00000100:00100000:3.0:1762167003.145887:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16322 00000100:00100000:0.0:1762167003.145892:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454360832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.146035:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16329 00002000:00010000:0.0:1762167003.146045:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb size from disk: 130987 -> 130987 00000100:00100000:3.0:1762167003.146049:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454360576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167003.146052:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.146057:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.146060:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.146063:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:1.0:1762167003.146069:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454360320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (995us total) trans 21474843044 rc 0/0 00000100:00100000:1.0:1762167003.146078:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16327 00000100:00100000:0.0:1762167003.146107:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454360832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (974us total) trans 21474843045 rc 0/0 00000100:00100000:0.0:1762167003.146116:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16328 00000100:00100000:1.0:1762167003.146125:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454359168 00000100:00100000:1.0:1762167003.146131:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454359168 00000100:00100000:1.0:1762167003.146168:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16330 00000004:00080000:0.0:1762167003.146176:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e471880/2, rc 0, transno 17179875544 00000100:00100000:1.0:1762167003.146181:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454359168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.146186:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454359424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167003.146206:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e470000/2, rc 0, transno 17179875548 00000100:00100000:3.0:1762167003.146215:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454360576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (1094us total) trans 21474843046 rc 0/0 00000100:00100000:0.0:1762167003.146216:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454359936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.146230:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16329 00000004:00080000:0.0:1762167003.146241:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e470700/2, rc 0, transno 17179875549 00000100:00100000:3.0:1762167003.146247:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454359680 00000100:00100000:0.0:1762167003.146249:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454360448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.146252:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454359680 00000004:00080000:0.0:1762167003.146273:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354ed80/2, rc 0, transno 21474843046 00000100:00100000:3.0:1762167003.146281:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454360192 00000100:00100000:0.0:1762167003.146283:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454360576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.146286:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454360192 00002000:00010000:1.0:1762167003.146309:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:1.0:1762167003.146313:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00000100:00100000:3.0:1762167003.146317:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16331 00002000:00010000:1.0:1762167003.146318:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.146322:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.146324:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 137 -> 137 00000100:00100000:3.0:1762167003.146329:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3295:x1847765454359680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.146336:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454360704 00000100:00100000:0.0:1762167003.146341:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454360704 00000100:00100000:1.0:1762167003.146370:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454359168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (267us total) trans 21474843047 rc 0/0 00000100:00100000:0.0:1762167003.146381:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16333 00000100:00100000:0.0:1762167003.146391:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454360704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.146394:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16330 00000004:00080000:1.0:1762167003.146445:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e471180/2, rc 0, transno 17179875546 00000100:00100000:1.0:1762167003.146452:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454359296:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167003.146458:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167003.146462:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167003.146466:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00000004:00080000:1.0:1762167003.146468:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242409880/2, rc 0, transno 21474843043 00002000:00010000:3.0:1762167003.146470:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167003.146475:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167003.146475:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454359808:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167003.146491:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354ea00/2, rc 0, transno 21474843044 00000100:00100000:1.0:1762167003.146495:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454360320:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167003.146511:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354f480/2, rc 0, transno 21474843045 00000100:00100000:3.0:1762167003.146518:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454359680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 190us (341us total) trans 17179875550 rc 0/0 00000100:00100000:1.0:1762167003.146519:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454360832:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.146531:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16331 00002000:00010000:0.0:1762167003.146540:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.146548:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.146556:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.146563:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.146567:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167003.146607:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454360704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (298us total) trans 21474843048 rc 0/0 00000100:00100000:0.0:1762167003.146614:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16333 00000100:00100000:0.0:1762167003.146788:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454360064 00000100:00100000:0.0:1762167003.146794:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454360064 00000100:00100000:0.0:1762167003.146819:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16334 00000100:00100000:0.0:1762167003.146826:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454360064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167003.146915:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.146918:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.146921:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167003.146923:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.146925:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167003.146962:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454360064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (265us total) trans 21474843049 rc 0/0 00000100:00100000:0.0:1762167003.146969:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16334 00000100:00100000:0.0:1762167003.150076:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.151957:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.151999:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451652864 00000100:00100000:1.0:1762167003.152005:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451652864 00010000:00010000:1.0:1762167003.152039:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08bb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dd7 expref: 20 pid: 26444 timeout: 723 lvb_type: 1 00000100:00100000:1.0:1762167003.152068:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7271 00000100:00100000:1.0:1762167003.152077:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451652864:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.152090:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.152110:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08bb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dd7 expref: 20 pid: 26444 timeout: 723 lvb_type: 1 00010000:00010000:1.0:1762167003.152122:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08bb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dd7 expref: 20 pid: 26444 timeout: 723 lvb_type: 1 00010000:00010000:1.0:1762167003.152143:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08bb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dd7 expref: 20 pid: 26444 timeout: 723 lvb_type: 1 00010000:00010000:1.0:1762167003.152154:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.152156:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.152163:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.152172:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.152200:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.152212:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454361088:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167003.152269:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639acb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.155334:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454361088:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167003.155362:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167003.155435:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451652864:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 3358us (3476us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.155449:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7271 00000100:00100000:0.0:1762167003.156156:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.158839:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.161031:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.164377:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.169940:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.170056:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451653632 00000100:00100000:1.0:1762167003.170066:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451653632 00000100:00100000:1.0:1762167003.170124:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7220 00000100:00100000:1.0:1762167003.170134:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451653632:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167003.170423:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451653632:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 280us (479us total) trans 8589952514 rc 0/0 00000100:00100000:1.0:1762167003.170431:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7220 00000100:00100000:0.0:1762167003.179332:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.182635:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.182729:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451653888 00000100:00100000:1.0:1762167003.182737:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451653888 00000100:00100000:1.0:1762167003.182825:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 614 00000100:00100000:1.0:1762167003.182836:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2360:x1847765451653888:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.182858:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.182886:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d08ceb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e4e expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.182903:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:1.0:1762167003.182907:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167003.182947:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.182963:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:2360:x1847765451653888:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 129us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.182969:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 614 00000100:00100000:3.0:1762167003.183011:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451654144 00000100:00100000:3.0:1762167003.183017:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451654144 00000100:00100000:3.0:1762167003.183057:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19457 00000100:00100000:3.0:1762167003.183067:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56173:x1847765451654144:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.183139:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.183155:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08cf2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e55 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.183245:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.183259:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08ccf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e47 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.183268:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.183297:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08ccf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e47 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.183310:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08ccf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e47 expref: 893 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167003.183322:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454361216:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.183384:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.184471:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454361216:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167003.184530:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167003.184734:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.184872:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451654272 00000100:00100000:1.0:1762167003.184878:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451654272 00010000:00010000:1.0:1762167003.184903:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08ccf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e47 expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167003.184941:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7272 00000100:00100000:1.0:1762167003.184950:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765451654272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.184962:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.184968:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08ccf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e47 expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.184979:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08ccf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e47 expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.184997:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08ccf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e47 expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.185010:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:1.0:1762167003.185014:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167003.185022:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167003.185028:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167003.185056:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167003.185094:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167003.185101:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2361:x1847765451654272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 146us (361us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167003.185108:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167003.185115:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7272 00000004:00200000:3.0:1762167003.185128:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00010000:00010000:3.0:1762167003.185256:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08cf2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e55 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.185271:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e55 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.185278:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:3.0:1762167003.185281:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167003.185284:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28800, rc 0) 00000100:00100000:3.0:1762167003.185372:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56173:x1847765451654144:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2260us (2379us total) trans 8589952515 rc 0/0 00000100:00100000:3.0:1762167003.185383:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19457 00000100:00100000:0.0:1762167003.186984:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.187059:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451654400 00000100:00100000:3.0:1762167003.187068:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451654400 00000100:00100000:3.0:1762167003.187128:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19458 00000100:00100000:3.0:1762167003.187141:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56173:x1847765451654400:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.187161:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.187178:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d08d07 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e5c expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.187256:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08d0e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.187270:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e55 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.187278:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08d0e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.187309:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e55 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.187321:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e55 expref: 894 pid: 32138 timeout: 723 lvb_type: 0 00000100:00100000:3.0:1762167003.187334:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454361344:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.187405:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.189469:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451654528 00000100:00100000:1.0:1762167003.189477:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451654528 00000100:00100000:3.0:1762167003.189491:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454361344:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.189508:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e55 expref: 895 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:3.0:1762167003.189512:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08d0e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167003.189544:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7273 00000100:00100000:1.0:1762167003.189553:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451654528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.189568:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.189574:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e55 expref: 895 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.189585:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e55 expref: 895 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.189604:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d08cf9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e55 expref: 895 pid: 32138 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.189619:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:1.0:1762167003.189623:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08d0e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167003.189632:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08d0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167003.189639:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08d0e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167003.189669:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167003.189730:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451654528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 177us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.189738:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7273 00010000:00010000:3.0:1762167003.189745:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08d0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.189752:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08d0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167003.189813:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00000004:00200000:3.0:1762167003.189818:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167003.189837:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08d0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.189866:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d08d07 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e5c expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.189881:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d08d0e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e5c expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.189888:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:3.0:1762167003.189890:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.189893:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29000, rc 0) 00000100:00100000:3.0:1762167003.189928:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56173:x1847765451654400:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2791us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.189936:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19458 00000100:00100000:3.0:1762167003.192289:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451654784 00000100:00100000:3.0:1762167003.192297:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451654784 00000100:00100000:3.0:1762167003.192355:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19459 00000100:00100000:3.0:1762167003.192367:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56173:x1847765451654784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.192385:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.192403:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d08d15 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e63 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.192505:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d08d1c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.192518:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d08d1c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167003.192527:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d08d1c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167003.192540:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00010000:00010000:3.0:1762167003.192636:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d08d15 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e63 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.192648:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d08d1c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e63 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.192653:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:3.0:1762167003.192655:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167003.192657:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee359390a00, rc 0) 00000100:00100000:3.0:1762167003.192702:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56173:x1847765451654784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 340us (530us total) trans 8589952516 rc 0/0 00000100:00100000:3.0:1762167003.192707:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19459 00000100:00100000:0.0:1762167003.194553:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.194603:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.194631:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.194986:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451654912 00000100:00100000:3.0:1762167003.194997:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451654912 00000100:00100000:3.0:1762167003.195045:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451655168 00000100:00100000:3.0:1762167003.195048:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451655168 00000100:00100000:3.0:1762167003.195083:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16336 00000100:00100000:0.0:1762167003.195093:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16337 00000100:00100000:3.0:1762167003.195096:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451654912:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:0.0:1762167003.195109:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451655168:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167003.195136:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.195144:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08d31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.195157:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.195165:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08bbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2de5 expref: 20 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.195177:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167003.195181:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167003.195187:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.195189:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.195191:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.195195:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08d31 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.195234:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.195234:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2de5 expref: 20 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.195269:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 20 pid: 33892 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1762167003.195269:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08bbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2de5 expref: 20 pid: 6535 timeout: 723 lvb_type: 1 00000100:00100000:3.0:1762167003.195306:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454361472:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167003.195308:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454361600:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.195387:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.195388:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.196644:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454361472:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167003.196666:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.196937:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.197024:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.197063:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454361728:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.197065:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167003.197091:0:33892:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.197099:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451655424 00000100:00100000:3.0:1762167003.197104:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451655424 00000100:00100000:1.0:1762167003.197106:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451655552 00000100:00100000:1.0:1762167003.197111:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451655552 00002000:00100000:3.0:1762167003.197147:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (45056->98303) req@ffff9ee37fa98000 x1847765451655424/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:34/0 lens 488/0 e 0 to 0 dl 1762167014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1762167003.197148:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08bb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dde expref: 32 pid: 7858 timeout: 723 lvb_type: 1 00000100:00100000:1.0:1762167003.197188:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7275 00002000:00100000:3.0:1762167003.197192:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98000 with x1847765451655424 ext(45056->98303) 00000100:00100000:1.0:1762167003.197198:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451655552:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167003.197204:0:6539:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 21 pid: 33892 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.197209:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.197221:0:6539:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 21 pid: 33892 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.197227:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08bb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dde expref: 32 pid: 7858 timeout: 723 lvb_type: 1 00002000:00010000:3.0:1762167003.197234:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee37fa98000 00010000:00010000:1.0:1762167003.197245:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08bb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dde expref: 32 pid: 7858 timeout: 723 lvb_type: 1 00010000:00010000:1.0:1762167003.197262:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d08bb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dde expref: 32 pid: 7858 timeout: 723 lvb_type: 1 00000100:00100000:3.0:1762167003.197263:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 23 00000100:00100000:3.0:1762167003.197277:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451655424:12345-192.168.203.35@tcp:4:fsx.0 00010000:00010000:1.0:1762167003.197278:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.197282:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.197286:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.197294:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.197313:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167003.197337:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451655552:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 141us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.197344:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7275 00010000:00010000:1.0:1762167003.197367:0:33892:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.197376:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.197394:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.197401:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.197419:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.197426:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.197429:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.197437:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.197458:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.197470:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08d38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.197516:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451655040:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2337us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.197525:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16338 00000100:00100000:3.0:1762167003.200072:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.200123:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451655680 00000100:00100000:1.0:1762167003.200131:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451655680 00010000:00010000:1.0:1762167003.200165:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 21 pid: 33892 timeout: 723 lvb_type: 0 00000100:00100000:1.0:1762167003.200201:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7276 00000100:00100000:1.0:1762167003.200211:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451655680:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.200225:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.200256:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 21 pid: 33892 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.200270:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 21 pid: 33892 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.200291:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d08cc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->98303) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e40 expref: 21 pid: 33892 timeout: 723 lvb_type: 0 00010000:00010000:1.0:1762167003.200306:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.200308:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.200313:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.200323:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.200359:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167003.200418:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451655680:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 198us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.200425:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7276 00010000:00010000:3.0:1762167003.200514:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.200524:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.200546:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.200554:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.200562:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.200569:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167003.200573:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.200627:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.200639:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.200652:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d08d2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.200711:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451654912:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 5619us (6165us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.200719:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16336 00000100:00100000:3.0:1762167003.201892:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000001:00080000:1.0:1762167003.213193:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952514 is committed 00000001:00080000:1.0:1762167003.213205:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952517 is committed 00000004:00080000:1.0:1762167003.213209:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3431 committed 00000004:00080000:1.0:1762167003.213219:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3418 committed 00000004:00080000:1.0:1762167003.213228:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3417 committed 00000004:00080000:1.0:1762167003.213230:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3430 committed 00000004:00080000:1.0:1762167003.213233:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3429 committed 00000004:00080000:1.0:1762167003.213235:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3416 committed 00000004:00080000:1.0:1762167003.213239:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3428 committed 00000004:00080000:1.0:1762167003.213242:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3415 committed 00000004:00080000:1.0:1762167003.213245:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3414 committed 00000004:00080000:1.0:1762167003.213248:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3427 committed 00000004:00080000:1.0:1762167003.213251:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3413 committed 00000004:00080000:1.0:1762167003.213257:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3426 committed 00000004:00080000:1.0:1762167003.213259:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3412 committed 00000004:00080000:1.0:1762167003.213264:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3425 committed 00000004:00080000:1.0:1762167003.213266:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3424 committed 00000004:00080000:1.0:1762167003.213270:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3411 committed 00000020:00080000:1.0:1762167003.213290:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969172 batchid updated 00000100:00100000:1.0:1762167003.213354:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454362240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.213431:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.213477:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454362880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.213502:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454361856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.213512:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.213537:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454363264:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1762167003.213542:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969172 00000100:00100000:0.0:1762167003.213563:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.213582:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454362240 00000100:00100000:1.0:1762167003.213591:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454362240 00000100:00100000:0.0:1762167003.213597:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454362368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.213626:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.213639:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454362880 00000100:00100000:1.0:1762167003.213645:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454362880 00000100:00100000:0.0:1762167003.213652:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454362752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.213680:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454361856 00000100:00100000:1.0:1762167003.213686:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454361856 00000100:00100000:0.0:1762167003.213688:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.213709:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454361984 00000100:00100000:1.0:1762167003.213713:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454361984 00000100:00100000:0.0:1762167003.213721:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454363392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.213736:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454362368 00000100:00100000:1.0:1762167003.213742:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454362368 00000100:00100000:0.0:1762167003.213751:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.213789:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454362496 00000100:00100000:1.0:1762167003.213794:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454362496 00000020:00080000:3.0:1762167003.213801:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969172 cancel update log [0x200000bd0:0x1:0x0].40: rc = 0 00000020:00080000:3.0:1762167003.213810:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969172 00000100:00100000:1.0:1762167003.213817:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454362752 00000100:00100000:1.0:1762167003.213821:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454362752 00000100:00100000:3.0:1762167003.213826:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454363008 00000100:00100000:3.0:1762167003.213832:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454363008 00000100:00100000:1.0:1762167003.213838:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454363392 00000100:00100000:1.0:1762167003.213842:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454363392 00000100:00100000:3.0:1762167003.213855:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454363648 00000100:00100000:3.0:1762167003.213859:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454363648 00000100:00100000:1.0:1762167003.213871:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454362112 00000100:00100000:1.0:1762167003.213877:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454362112 00000100:00100000:3.0:1762167003.213886:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16339 00000100:00100000:0.0:1762167003.213895:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16340 00000100:00100000:3.0:1762167003.213900:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454362240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.213912:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3296:x1847765454362880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.213913:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454362624 00000100:00100000:1.0:1762167003.213919:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454362624 00000100:00100000:1.0:1762167003.213948:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16341 00000100:00100000:1.0:1762167003.213961:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3293:x1847765454361856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167003.214095:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 167513 -> 167513 00002000:00010000:0.0:1762167003.214101:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.214105:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167003.214110:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.214114:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167003.214134:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.214139:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167003.214142:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167003.214144:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000100:00100000:0.0:1762167003.214148:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3296:x1847765454362880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 240us (637us total) trans 17179875552 rc 0/0 00002000:00010000:1.0:1762167003.214149:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167003.214159:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16340 00000100:00100000:0.0:1762167003.214180:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16343 00000100:00100000:0.0:1762167003.214191:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454362368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.214210:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454362240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (686us total) trans 21474843051 rc 0/0 00000100:00100000:1.0:1762167003.214216:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3293:x1847765454361856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 249us (645us total) trans 17179875553 rc 0/0 00000100:00100000:3.0:1762167003.214222:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16339 00000100:00100000:1.0:1762167003.214230:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16341 00000100:00100000:3.0:1762167003.214244:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16344 00000100:00100000:3.0:1762167003.214254:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3294:x1847765454362496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.214258:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16345 00002000:00010000:0.0:1762167003.214321:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.214325:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.214327:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:0.0:1762167003.214330:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.214332:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167003.214351:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454362752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.214369:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454362368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (741us total) trans 21474843053 rc 0/0 00002000:00010000:3.0:1762167003.214370:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167003.214377:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167003.214381:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00000100:00100000:0.0:1762167003.214382:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16343 00002000:00010000:3.0:1762167003.214385:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167003.214390:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167003.214404:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16347 00000100:00100000:0.0:1762167003.214428:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3293:x1847765454363392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.214485:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454362496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (835us total) trans 21474843054 rc 0/0 00000100:00100000:3.0:1762167003.214493:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16344 00000100:00100000:3.0:1762167003.214511:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16348 00000100:00100000:3.0:1762167003.214521:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3294:x1847765454363648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.214530:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454362752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 261us (843us total) trans 21474843056 rc 0/0 00002000:00010000:0.0:1762167003.214534:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.214539:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.214541:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00000100:00100000:1.0:1762167003.214543:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16345 00002000:00010000:0.0:1762167003.214545:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.214548:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167003.214567:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16350 00000100:00100000:1.0:1762167003.214578:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454362624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.214584:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3293:x1847765454363392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (830us total) trans 17179875554 rc 0/0 00000100:00100000:0.0:1762167003.214592:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16347 00000100:00100000:0.0:1762167003.214612:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16351 00000100:00100000:0.0:1762167003.214622:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3295:x1847765454363136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167003.214634:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 72042 -> 72042 00002000:00010000:3.0:1762167003.214639:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167003.214641:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167003.214644:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.214647:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:3.0:1762167003.214672:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454363648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (877us total) trans 17179875555 rc 0/0 00000100:00100000:3.0:1762167003.214678:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16348 00000100:00100000:3.0:1762167003.214702:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16353 00000100:00100000:3.0:1762167003.214711:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3295:x1847765454363520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.214752:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3295:x1847765454362624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (850us total) trans 17179875557 rc 0/0 00000100:00100000:1.0:1762167003.214787:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16350 00002000:00010000:0.0:1762167003.214788:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.214792:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.214794:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:0.0:1762167003.214796:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.214797:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167003.214830:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3295:x1847765454363136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (881us total) trans 17179875558 rc 0/0 00000100:00100000:0.0:1762167003.214835:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16351 00002000:00010000:3.0:1762167003.214837:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:3.0:1762167003.214842:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.214846:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000004:00080000:1.0:1762167003.214848:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb6d80/2, rc 0, transno 17179875553 00002000:00010000:3.0:1762167003.214850:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.214856:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:1.0:1762167003.214859:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454361856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.214859:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167003.214877:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258700/2, rc 0, transno 21474843053 00000100:00100000:1.0:1762167003.214882:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454362368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167003.214904:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348259f80/2, rc 0, transno 21474843051 00000004:00080000:1.0:1762167003.214905:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825a680/2, rc 0, transno 21474843056 00000100:00100000:3.0:1762167003.214906:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454363520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (866us total) trans 21474843057 rc 0/0 00000100:00100000:0.0:1762167003.214913:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454362240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.214914:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454362752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.214921:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16353 00000004:00080000:1.0:1762167003.214937:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb5c00/2, rc 0, transno 17179875554 00000004:00080000:0.0:1762167003.214945:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb7100/2, rc 0, transno 17179875552 00000100:00100000:1.0:1762167003.214946:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454363392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.214955:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454362880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.215086:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.215129:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451656064 00000004:00080000:0.0:1762167003.215154:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348259500/2, rc 0, transno 21474843058 00000100:00100000:0.0:1762167003.215161:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454363264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.215177:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451656064 00000100:00100000:3.0:1762167003.215210:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19461 00000100:00100000:3.0:1762167003.215217:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56173:x1847765451656064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.215230:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.215244:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08d46 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e6a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.215285:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08d46 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e6a expref: 891 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.215299:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08d46 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e6a expref: 891 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.215315:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:3.0:1762167003.215318:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167003.215321:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3a00, rc 0) 00000100:00100000:3.0:1762167003.215359:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56173:x1847765451656064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 142us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.215365:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19461 00000100:00100000:3.0:1762167003.216905:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451656192 00000100:00100000:3.0:1762167003.216913:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451656192 00000100:00100000:3.0:1762167003.216951:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19462 00000100:00100000:3.0:1762167003.216958:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56173:x1847765451656192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.216969:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.216981:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08d4d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e71 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.217037:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08d54 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.217048:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08d54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.217055:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08d54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.217074:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00000004:00200000:3.0:1762167003.217077:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167003.217088:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08d54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.217104:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08d4d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e71 expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.217114:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08d54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e71 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.217120:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:3.0:1762167003.217122:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.217124:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2800, rc 0) 00000100:00100000:3.0:1762167003.217161:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56173:x1847765451656192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 204us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.217166:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19462 00000100:00100000:0.0:1762167003.218600:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.218646:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.218800:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16355 00000100:00100000:0.0:1762167003.218816:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451656320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167003.218832:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167003.218854:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08d5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e78 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167003.218880:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888db, ctime: 0x690888db, blocks: 0x89 00010000:00010000:0.0:1762167003.218903:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.218907:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.218919:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08d5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e78 expref: 20 pid: 12400 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167003.218930:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167003.218951:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08d5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e78 expref: 20 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167003.218967:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:0.0:1762167003.219024:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451656320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 213us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.219039:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16355 00000100:00100000:0.0:1762167003.219062:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451656576 00000100:00100000:0.0:1762167003.219067:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451656576 00000100:00100000:0.0:1762167003.219102:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16357 00000100:00100000:0.0:1762167003.219111:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451656576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167003.219119:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167003.219129:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08d69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e86 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167003.219144:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888db, atime: 0x690888db, ctime: 0x690888db, blocks: 0x3 00010000:00010000:0.0:1762167003.219153:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.219156:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.219161:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08d69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e86 expref: 21 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167003.219174:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08d69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e86 expref: 21 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167003.219182:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9800, rc 0) 00000100:00100000:0.0:1762167003.219224:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451656576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 114us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.219232:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16357 00000100:00100000:1.0:1762167003.244517:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.248303:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000001:00080000:3.0:1762167003.259151:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875558 is committed 00000001:00080000:1.0:1762167003.259151:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875557 is committed 00000001:00080000:1.0:1762167003.259182:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875542 is committed 00000001:00080000:3.0:1762167003.259212:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875560 is committed 00000001:00080000:3.0:1762167003.259224:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875559 is committed 00002000:00010000:0.0:1762167003.259259:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00002000:00010000:0.0:1762167003.259265:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb ctime from disk: 1762167002 -> 1762167003 00010000:00010000:0.0:1762167003.259278:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08d77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.259289:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08d77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.259297:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08d77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.259304:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167003.259308:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08d77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.259316:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08d77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.259334:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08d77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.259341:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08d77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.259433:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451656832:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 10983us (11132us total) trans 17179875560 rc 0/0 00000100:00100000:0.0:1762167003.259442:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2606 00000100:00100000:3.0:1762167003.261389:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.261446:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451656960 00000100:00100000:0.0:1762167003.261454:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451656960 00000100:00100000:0.0:1762167003.261503:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2607 00000100:00100000:0.0:1762167003.261511:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451656960:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762167003.261534:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.261546:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08757 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c2c expref: 26 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167003.261552:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.261553:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.261556:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.261579:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c2c expref: 26 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167003.261589:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08757 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c2c expref: 26 pid: 33894 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1762167003.261603:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454363904:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167003.261671:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.262614:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454363904:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167003.262635:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.262752:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.262831:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451657088 00000100:00100000:1.0:1762167003.262837:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451657088 00010000:00010000:1.0:1762167003.262859:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08757 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c2c expref: 27 pid: 33894 timeout: 724 lvb_type: 1 00000100:00100000:1.0:1762167003.262886:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7277 00000100:00100000:1.0:1762167003.262896:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451657088:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.262907:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.262926:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08757 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c2c expref: 27 pid: 33894 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.262938:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c2c expref: 27 pid: 33894 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.262962:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08757 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2c2c expref: 27 pid: 33894 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.262976:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.262977:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.262980:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.262988:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.263019:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167003.263039:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.263047:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.263061:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451657088:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 166us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.263069:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7277 00000001:00080000:1.0:1762167003.274691:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875561 is committed 00002000:00010000:0.0:1762167003.274855:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00002000:00010000:0.0:1762167003.274859:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167002 -> 1762167003 00010000:00010000:0.0:1762167003.274872:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.274881:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.274890:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.274896:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167003.274900:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.274908:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.274926:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.274933:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.275033:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451656960:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13515us (13644us total) trans 17179875561 rc 0/0 00000100:00100000:0.0:1762167003.275044:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2607 00000100:00100000:1.0:1762167003.276965:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.277009:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451657216 00000100:00100000:0.0:1762167003.277017:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451657216 00000100:00100000:0.0:1762167003.277067:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2608 00000100:00100000:0.0:1762167003.277074:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451657216:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167003.277120:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x812:0x0] initial LVB size: 167513, mtime: 0x690888da, atime: 0x690888d7, ctime: 0x690888da, blocks: 0x203 00010000:00010000:0.0:1762167003.277128:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08d85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.277145:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.277147:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.277153:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.277163:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167003.289916:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00002000:00010000:3.0:1762167003.289922:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb ctime from disk: 1762167002 -> 1762167003 00010000:00010000:3.0:1762167003.289933:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.289943:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.289951:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.289958:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167003.289961:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.289969:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08d85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.289987:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08d85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.289994:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d08d85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.290082:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765451657216:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13003us (13117us total) trans 21474843059 rc 0/0 00000100:00100000:3.0:1762167003.290092:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2608 00000100:00100000:3.0:1762167003.292225:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.292293:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451657344 00000100:00100000:0.0:1762167003.292303:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451657344 00000100:00100000:0.0:1762167003.292375:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2609 00000100:00100000:0.0:1762167003.292386:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451657344:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167003.292442:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 167513, mtime: 0x690888da, atime: 0x690888d9, ctime: 0x690888da, blocks: 0x203 00010000:00010000:0.0:1762167003.292449:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.292461:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.292463:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.292468:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.292482:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167003.304836:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00002000:00010000:0.0:1762167003.304843:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167002 -> 1762167003 00010000:00010000:0.0:1762167003.304859:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.304873:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.304883:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.304890:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167003.304895:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.304903:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.304920:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.304925:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.305024:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451657344:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 12636us (12799us total) trans 21474843060 rc 0/0 00000100:00100000:0.0:1762167003.305033:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2609 00000100:00100000:0.0:1762167003.307733:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451657472 00000100:00100000:0.0:1762167003.307749:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451657472 00000100:00100000:0.0:1762167003.307853:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2610 00000100:00100000:0.0:1762167003.307865:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765451657472:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762167003.307901:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.307921:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d08ad0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d75 expref: 25 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167003.307929:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.307931:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.307935:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.307969:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d08ad0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d75 expref: 25 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167003.307983:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d08ad0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d75 expref: 25 pid: 6532 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1762167003.307997:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454364032:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167003.308087:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.309274:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454364032:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167003.309296:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.309680:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451657600 00000100:00100000:1.0:1762167003.309688:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451657600 00010000:00010000:1.0:1762167003.309722:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d08ad0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d75 expref: 26 pid: 6532 timeout: 724 lvb_type: 1 00000100:00100000:1.0:1762167003.309760:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7278 00000100:00100000:1.0:1762167003.309798:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451657600:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.309813:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.309837:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d08ad0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d75 expref: 26 pid: 6532 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.309852:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d08ad0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d75 expref: 26 pid: 6532 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.309874:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d08ad0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d75 expref: 26 pid: 6532 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.309888:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.309889:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.309893:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.309902:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.309934:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167003.309961:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.309973:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.309989:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451657600:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 192us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.309999:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7278 00000001:00080000:3.0:1762167003.322234:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875562 is committed 00002000:00010000:0.0:1762167003.322283:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 72042 -> 131072 00002000:00010000:0.0:1762167003.322289:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00010000:00010000:0.0:1762167003.322301:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.322309:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.322315:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.322319:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167003.322323:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.322336:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.322356:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.322362:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d08d93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.322465:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451657472:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14599us (14812us total) trans 17179875562 rc 0/0 00000100:00100000:0.0:1762167003.322476:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2610 00000100:00100000:3.0:1762167003.324867:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.324926:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451657728 00000100:00100000:0.0:1762167003.324937:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451657728 00000100:00100000:0.0:1762167003.325007:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2611 00000100:00100000:0.0:1762167003.325019:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451657728:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762167003.325055:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.325074:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d08c9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e1d expref: 16 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167003.325081:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.325083:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.325086:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.325120:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d08c9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e1d expref: 16 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167003.325133:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d08c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e1d expref: 16 pid: 6535 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1762167003.325147:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454364160:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167003.325233:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.326266:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454364160:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167003.326288:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.326443:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.326501:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451657856 00000100:00100000:1.0:1762167003.326507:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451657856 00010000:00010000:1.0:1762167003.326538:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d08c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e1d expref: 17 pid: 6535 timeout: 724 lvb_type: 1 00000100:00100000:1.0:1762167003.326576:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7279 00000100:00100000:1.0:1762167003.326585:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451657856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.326598:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.326622:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d08c9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e1d expref: 17 pid: 6535 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.326634:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d08c9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e1d expref: 17 pid: 6535 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.326656:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d08c9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e1d expref: 17 pid: 6535 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.326688:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.326690:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.326694:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.326703:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.326734:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167003.326752:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.326787:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.326805:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451657856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 219us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.326814:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7279 00002000:00010000:3.0:1762167003.342157:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb size from disk: 130987 -> 131072 00010000:00010000:3.0:1762167003.342172:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.342184:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.342192:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.342197:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167003.342200:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.342206:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.342219:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.342223:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d08d9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.342303:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451657728:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 17285us (17441us total) trans 21474843061 rc 0/0 00000100:00100000:3.0:1762167003.342311:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2611 00000100:00100000:3.0:1762167003.351081:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451658112 00000100:00100000:3.0:1762167003.351094:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451658112 00000100:00100000:3.0:1762167003.351153:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19463 00000100:00100000:3.0:1762167003.351164:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56173:x1847765451658112:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167003.351228:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.351254:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08d54 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e71 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.351277:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:3.0:1762167003.351282:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167003.351554:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08da1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.351564:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08da1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.351571:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08da1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:3.0:1762167003.351629:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952518 00000004:00010000:3.0:1762167003.351654:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f452c3b2 reply state 0000000036eac4d9 transno 8589952519 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08da1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167003.351663:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167003.351820:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56173:x1847765451658112:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 657us (845us total) trans 8589952519 rc 0/0 00000100:00100000:3.0:1762167003.351832:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19463 00000020:00080000:3.0:1762167003.351837:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762167003.354152:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451658240 00000100:00100000:0.0:1762167003.354161:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451658240 00000100:00100000:0.0:1762167003.354208:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16358 00000100:00100000:0.0:1762167003.354218:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56173:x1847765451658240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167003.354235:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167003.354254:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08da8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e8d expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167003.354277:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x810:0x0] initial LVB size: 167513, mtime: 0x690888db, atime: 0x690888d3, ctime: 0x690888db, blocks: 0x203 00010000:00010000:0.0:1762167003.354298:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.354300:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.354307:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e8d expref: 25 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.354322:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e8d expref: 25 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.354333:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:0.0:1762167003.354386:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56173:x1847765451658240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 168us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.354393:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16358 00000100:00100000:0.0:1762167003.356015:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.356052:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451658368 00000100:00100000:0.0:1762167003.356058:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.356059:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451658368 00002000:00010000:3.0:1762167003.356087:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2064 (130987->18446744073709551615) 00002000:00100000:3.0:1762167003.356091:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b2d80 with x1847765451658368 ext(130987->18446744073709551615) 00002000:00010000:3.0:1762167003.356099:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b2d80. 00000100:00100000:3.0:1762167003.356129:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451658496 00000100:00100000:3.0:1762167003.356135:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451658496 00002000:00010000:3.0:1762167003.356148:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2061 (0->18446744073709551615) 00002000:00100000:3.0:1762167003.356151:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0700 with x1847765451658496 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167003.356157:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b0700. 00000100:00100000:1.0:1762167003.356162:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2612 00000100:00100000:1.0:1762167003.356177:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451658368:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167003.356583:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb size from disk: 167513 -> 130987 00002000:00010000:1.0:1762167003.356588:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.356591:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:1.0:1762167003.356594:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.356596:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167003.356686:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451658368:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 508us (673us total) trans 17179875563 rc 0/0 00000100:00100000:1.0:1762167003.356899:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2612 00002000:00010000:1.0:1762167003.356903:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2064 (130987->18446744073709551615) 00002000:00100000:1.0:1762167003.356906:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b2d80 with x1847765451658368 ext(130987->18446744073709551615) 00002000:00010000:1.0:1762167003.356912:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b2d80. 00000100:00100000:3.0:1762167003.358219:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451658624 00000100:00100000:3.0:1762167003.358230:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451658624 00000100:00100000:3.0:1762167003.358274:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19464 00000100:00100000:3.0:1762167003.358285:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56173:x1847765451658624:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.358303:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.358321:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08daf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e94 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.358397:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08db6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.358421:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08db6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.358433:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08db6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.358465:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:3.0:1762167003.358470:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167003.358499:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08db6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.358524:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08daf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e94 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.358540:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08db6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e94 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.358548:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:3.0:1762167003.358551:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.358553:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2800, rc 0) 00000100:00100000:3.0:1762167003.358608:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56173:x1847765451658624:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 326us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.358615:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19464 00000100:00100000:3.0:1762167003.360406:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.360554:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451658880 00000100:00100000:0.0:1762167003.360563:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451658880 00000100:00100000:0.0:1762167003.360607:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19465 00000100:00100000:0.0:1762167003.360613:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56173:x1847765451658880:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167003.360653:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167003.360674:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08db6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e94 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.360693:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.360697:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167003.360949:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d08dbd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.360962:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d08dbd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.360971:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d08dbd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167003.361022:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952520 00000004:00010000:0.0:1762167003.361044:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ff974e07 reply state 00000000a7f3d0ac transno 8589952521 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d08dbd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.361050:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167003.361124:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56173:x1847765451658880:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 509us (722us total) trans 8589952521 rc 0/0 00000100:00100000:0.0:1762167003.361131:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19465 00000020:00080000:0.0:1762167003.361136:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762167003.362159:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.362224:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451659008 00000100:00100000:1.0:1762167003.362232:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451659008 00000100:00100000:1.0:1762167003.362278:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16359 00000100:00100000:1.0:1762167003.362293:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56173:x1847765451659008:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167003.362307:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167003.362326:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08dc4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2e9b expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167003.362349:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 167513, mtime: 0x690888db, atime: 0x690888d5, ctime: 0x690888db, blocks: 0x203 00010000:00010000:1.0:1762167003.362373:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.362375:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.362385:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08dc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e9b expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.362399:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08dc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e9b expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.362422:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b800, rc 0) 00000100:00100000:1.0:1762167003.362470:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56173:x1847765451659008:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 184us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.362477:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16359 00000100:00100000:1.0:1762167003.363735:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451659136 00000100:00100000:1.0:1762167003.363741:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451659136 00002000:00010000:1.0:1762167003.363798:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (130987->18446744073709551615) 00002000:00100000:1.0:1762167003.363803:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ceb100 with x1847765451659136 ext(130987->18446744073709551615) 00000100:00100000:0.0:1762167003.363806:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451659264 00000100:00100000:0.0:1762167003.363812:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451659264 00002000:00010000:1.0:1762167003.363813:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242ceb100. 00002000:00010000:0.0:1762167003.363830:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:0.0:1762167003.363835:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce9880 with x1847765451659264 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167003.363846:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ce9880. 00000100:00100000:1.0:1762167003.363852:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2614 00000100:00100000:1.0:1762167003.363862:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451659136:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167003.363891:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2615 00000100:00100000:0.0:1762167003.363903:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451659264:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167003.364135:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.364138:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 167513 -> 130987 00002000:00010000:0.0:1762167003.364140:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00002000:00010000:1.0:1762167003.364143:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.364144:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167003.364149:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167002 -> 1762167003 00002000:00010000:1.0:1762167003.364151:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167003.364154:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167003.364155:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.364160:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167003.364213:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451659136:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 349us (528us total) trans 17179875564 rc 0/0 00000100:00100000:0.0:1762167003.364213:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451659264:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 310us (462us total) trans 21474843063 rc 0/0 00000100:00100000:0.0:1762167003.364228:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2615 00002000:00010000:0.0:1762167003.364233:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00000100:00100000:1.0:1762167003.364237:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2614 00002000:00100000:0.0:1762167003.364239:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce9880 with x1847765451659264 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167003.364243:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (130987->18446744073709551615) 00002000:00010000:0.0:1762167003.364246:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ce9880. 00002000:00100000:1.0:1762167003.364253:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ceb100 with x1847765451659136 ext(130987->18446744073709551615) 00002000:00010000:1.0:1762167003.364259:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242ceb100. 00000100:00100000:3.0:1762167003.365851:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.365900:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451659392 00000100:00100000:0.0:1762167003.365909:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451659392 00000100:00100000:0.0:1762167003.365983:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19466 00000100:00100000:0.0:1762167003.365996:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56173:x1847765451659392:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167003.366025:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167003.366047:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08dcb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ea2 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.366132:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08dd2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.366148:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.366161:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167003.366190:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:0.0:1762167003.366195:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167003.366210:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.366237:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08dcb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea2 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.366255:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea2 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.366264:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.366267:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167003.366270:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9400, rc 0) 00000100:00100000:0.0:1762167003.366323:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56173:x1847765451659392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 330us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.366331:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19466 00000100:00100000:3.0:1762167003.368187:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.368241:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451659648 00000100:00100000:0.0:1762167003.368249:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451659648 00000100:00100000:0.0:1762167003.368301:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19467 00000100:00100000:0.0:1762167003.368311:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56173:x1847765451659648:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167003.368355:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167003.368380:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08dd2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea2 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.368397:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.368402:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167003.368616:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.368629:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.368637:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167003.368694:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952522 00000004:00010000:0.0:1762167003.368718:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000017860344 reply state 00000000922eee99 transno 8589952523 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.368726:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167003.368856:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56173:x1847765451659648:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 546us (675us total) trans 8589952523 rc 0/0 00000100:00100000:0.0:1762167003.368869:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19467 00000020:00080000:0.0:1762167003.368873:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167003.369836:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.369848:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.369856:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.369862:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167003.369867:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.369876:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.369888:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.369892:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167003.369897:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.369903:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08dd9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167003.370183:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.370243:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451659776 00000100:00100000:1.0:1762167003.370250:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451659776 00000100:00100000:1.0:1762167003.370298:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16360 00000100:00100000:1.0:1762167003.370308:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56173:x1847765451659776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167003.370322:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167003.370339:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08de0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ea9 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167003.370361:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x812:0x0] initial LVB size: 167513, mtime: 0x690888db, atime: 0x690888d7, ctime: 0x690888db, blocks: 0x203 00010000:00010000:1.0:1762167003.370377:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.370380:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.370387:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08de0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea9 expref: 18 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.370401:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08de0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea9 expref: 18 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.370422:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b400, rc 0) 00000100:00100000:1.0:1762167003.370470:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56173:x1847765451659776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 164us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.370477:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16360 00000100:00100000:1.0:1762167003.371691:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451659904 00000100:00100000:1.0:1762167003.371698:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451659904 00000100:00100000:0.0:1762167003.371708:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451660032 00000100:00100000:0.0:1762167003.371714:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451660032 00002000:00010000:1.0:1762167003.371725:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2066 (130987->18446744073709551615) 00002000:00100000:1.0:1762167003.371732:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ceb480 with x1847765451659904 ext(130987->18446744073709551615) 00002000:00010000:0.0:1762167003.371734:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2069 (0->18446744073709551615) 00002000:00100000:0.0:1762167003.371740:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce8000 with x1847765451660032 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167003.371741:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ceb480. 00002000:00010000:0.0:1762167003.371750:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242ce8000. 00000100:00100000:1.0:1762167003.371792:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2616 00000100:00100000:1.0:1762167003.371804:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451659904:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167003.371811:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2617 00000100:00100000:0.0:1762167003.371823:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451660032:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167003.372108:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.372109:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb size from disk: 167513 -> 130987 00002000:00010000:0.0:1762167003.372115:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00002000:00010000:1.0:1762167003.372116:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.372120:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:0.0:1762167003.372123:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167002 -> 1762167003 00002000:00010000:1.0:1762167003.372127:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:0.0:1762167003.372127:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167003.372134:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.372137:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167003.372193:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451659904:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 389us (562us total) trans 21474843064 rc 0/0 00000100:00100000:0.0:1762167003.372194:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451660032:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 369us (530us total) trans 17179875565 rc 0/0 00000100:00100000:1.0:1762167003.372208:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2616 00002000:00010000:1.0:1762167003.372212:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2066 (130987->18446744073709551615) 00002000:00100000:1.0:1762167003.372214:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ceb480 with x1847765451659904 ext(130987->18446744073709551615) 00002000:00010000:1.0:1762167003.372219:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ceb480. 00000100:00100000:0.0:1762167003.372231:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2617 00002000:00010000:0.0:1762167003.372236:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2069 (0->18446744073709551615) 00002000:00100000:0.0:1762167003.372240:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce8000 with x1847765451660032 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167003.372246:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242ce8000. 00000100:00100000:0.0:1762167003.373873:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451660160 00000100:00100000:0.0:1762167003.373880:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451660160 00000100:00100000:0.0:1762167003.373934:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19468 00000100:00100000:0.0:1762167003.373954:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56173:x1847765451660160:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167003.373976:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167003.373999:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08de7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2eb0 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.374084:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08dee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.374098:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08dee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.374109:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08dee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167003.374130:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:0.0:1762167003.374133:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167003.374145:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08dee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.374164:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08de7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb0 expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.374177:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08dee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb0 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.374184:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.374187:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167003.374195:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:0.0:1762167003.374243:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56173:x1847765451660160:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 300us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.374250:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19468 00000100:00100000:3.0:1762167003.376443:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.376524:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451660416 00000100:00100000:0.0:1762167003.376537:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451660416 00000100:00100000:0.0:1762167003.376597:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19469 00000100:00100000:0.0:1762167003.376606:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56173:x1847765451660416:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167003.376656:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167003.376685:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08dee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb0 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.376704:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.376708:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167003.376937:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.376951:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.376960:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167003.377008:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952524 00000004:00010000:0.0:1762167003.377029:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d9d387d4 reply state 0000000070d58235 transno 8589952525 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.377035:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167003.377107:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56173:x1847765451660416:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 503us (673us total) trans 8589952525 rc 0/0 00000100:00100000:0.0:1762167003.377112:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19469 00000020:00080000:0.0:1762167003.377116:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167003.378043:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.378052:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.378057:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.378062:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.378066:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.378072:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.378080:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:3.0:1762167003.378083:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.378086:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.378090:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d08df5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.378112:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.378172:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451660544 00000100:00100000:1.0:1762167003.378178:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451660544 00000100:00100000:1.0:1762167003.378212:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16361 00000100:00100000:1.0:1762167003.378222:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:56173:x1847765451660544:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167003.378238:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167003.378256:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08dfc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2eb7 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167003.378279:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 167513, mtime: 0x690888db, atime: 0x690888d9, ctime: 0x690888db, blocks: 0x203 00010000:00010000:1.0:1762167003.378296:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.378299:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.378306:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08dfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb7 expref: 20 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.378321:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08dfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb7 expref: 20 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.378333:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a800, rc 0) 00000100:00100000:1.0:1762167003.378374:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56173:x1847765451660544:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 155us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.378378:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16361 00000100:00100000:0.0:1762167003.379443:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451660672 00000100:00100000:0.0:1762167003.379450:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451660672 00002000:00010000:0.0:1762167003.379479:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (130987->18446744073709551615) 00002000:00100000:0.0:1762167003.379484:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce8700 with x1847765451660672 ext(130987->18446744073709551615) 00002000:00010000:0.0:1762167003.379493:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ce8700. 00000100:00100000:3.0:1762167003.379511:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.379535:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451660800 00000100:00100000:0.0:1762167003.379540:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451660800 00002000:00010000:0.0:1762167003.379555:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167003.379559:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240b480 with x1847765451660800 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167003.379561:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2618 00002000:00010000:0.0:1762167003.379565:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240b480. 00000100:00100000:1.0:1762167003.379575:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451660672:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167003.379587:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2619 00000100:00100000:0.0:1762167003.379596:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451660800:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167003.379888:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.379893:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00002000:00010000:0.0:1762167003.379897:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:0.0:1762167003.379899:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167002 -> 1762167003 00002000:00010000:0.0:1762167003.379902:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167003.379913:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 167513 -> 130987 00002000:00010000:1.0:1762167003.379918:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.379921:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:1.0:1762167003.379924:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.379926:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167003.379953:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451660800:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 358us (442us total) trans 17179875566 rc 0/0 00000100:00100000:1.0:1762167003.379958:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451660672:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 385us (590us total) trans 21474843065 rc 0/0 00000100:00100000:0.0:1762167003.379966:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2619 00002000:00010000:0.0:1762167003.379973:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00000100:00100000:1.0:1762167003.379978:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2618 00002000:00100000:0.0:1762167003.379979:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240b480 with x1847765451660800 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167003.379985:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (130987->18446744073709551615) 00002000:00010000:0.0:1762167003.379987:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240b480. 00002000:00100000:1.0:1762167003.379991:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ce8700 with x1847765451660672 ext(130987->18446744073709551615) 00002000:00010000:1.0:1762167003.379999:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ce8700. 00000100:00100000:0.0:1762167003.381262:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451660928 00000100:00100000:0.0:1762167003.381270:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451660928 00000100:00100000:0.0:1762167003.381316:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19470 00000100:00100000:0.0:1762167003.381326:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56173:x1847765451660928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167003.381343:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167003.381360:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08e03 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ebe expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.381452:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08e0a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.381467:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08e0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.381477:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08e0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167003.381503:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:0.0:1762167003.381507:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167003.381522:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08e0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.381545:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08e03 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ebe expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.381563:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08e0a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ebe expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.381572:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.381575:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167003.381579:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9c00, rc 0) 00000100:00100000:0.0:1762167003.381622:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56173:x1847765451660928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 297us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.381629:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19470 00000100:00100000:0.0:1762167003.383469:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451661184 00000100:00100000:0.0:1762167003.383476:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451661184 00000100:00100000:0.0:1762167003.383527:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19471 00000100:00100000:0.0:1762167003.383536:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56173:x1847765451661184:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167003.383584:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167003.383606:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08e0a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ebe expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.383623:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.383627:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167003.383861:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.383873:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.383881:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167003.383934:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952526 00000004:00010000:0.0:1762167003.383959:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000091125f54 reply state 00000000a51da15f transno 8589952527 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.383967:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167003.384044:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56173:x1847765451661184:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 508us (677us total) trans 8589952527 rc 0/0 00000100:00100000:0.0:1762167003.384052:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19471 00000020:00080000:0.0:1762167003.384057:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167003.384812:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.384823:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.384830:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.384836:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167003.384841:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.384848:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.384859:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.384862:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167003.384865:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.384870:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d08e11 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167003.385104:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451661312 00000100:00100000:1.0:1762167003.385110:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451661312 00000100:00100000:1.0:1762167003.385160:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16362 00000100:00100000:1.0:1762167003.385170:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:56173:x1847765451661312:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167003.385184:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167003.385200:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08e18 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ec5 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167003.385220:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 131072, mtime: 0x690888db, atime: 0x690888da, ctime: 0x690888db, blocks: 0x103 00010000:00010000:1.0:1762167003.385238:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.385240:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.385247:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08e18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ec5 expref: 31 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.385260:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08e18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ec5 expref: 31 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.385268:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7aa00, rc 0) 00000100:00100000:1.0:1762167003.385302:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56173:x1847765451661312:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 135us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.385308:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16362 00000100:00100000:3.0:1762167003.386232:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.386279:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451661440 00000100:00100000:1.0:1762167003.386285:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451661440 00000100:00100000:1.0:1762167003.386317:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16363 00000100:00100000:1.0:1762167003.386323:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56173:x1847765451661440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167003.386331:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167003.386340:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ecc expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.386356:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.386362:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.386363:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.386366:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 22 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.386391:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.386404:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 22 pid: 12402 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.386428:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454364288:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.386500:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.387563:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454364288:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.387590:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 22 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.387611:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a200, rc 0) 00000100:00100000:1.0:1762167003.387650:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56173:x1847765451661440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1325us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.387664:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16363 00000100:00100000:3.0:1762167003.387898:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.387945:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451661568 00000100:00100000:1.0:1762167003.387951:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451661568 00010000:00010000:1.0:1762167003.387974:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 22 pid: 12402 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.388005:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7280 00000100:00100000:1.0:1762167003.388015:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451661568:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.388029:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167003.388048:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 22 pid: 12402 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167003.388059:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 22 pid: 12402 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167003.388077:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08a05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2d21 expref: 22 pid: 12402 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167003.388086:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.388087:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.388091:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 21 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.388101:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 21 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.388119:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 21 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.388128:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454364416:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167003.388177:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.389211:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454364416:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167003.389230:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167003.389263:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451661568:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1250us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.389277:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7280 00000100:00100000:1.0:1762167003.389519:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451661824 00000100:00100000:1.0:1762167003.389526:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451661824 00002000:00010000:1.0:1762167003.389551:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2069 (0->18446744073709551615) 00002000:00100000:1.0:1762167003.389556:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242cea680 with x1847765451661824 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167003.389564:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451661696 00002000:00010000:1.0:1762167003.389569:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242cea680. 00000100:00100000:0.0:1762167003.389571:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451661696 00002000:00010000:0.0:1762167003.389591:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2072 (130987->18446744073709551615) 00002000:00100000:0.0:1762167003.389595:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242cead80 with x1847765451661696 ext(130987->18446744073709551615) 00000100:00100000:1.0:1762167003.389600:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2620 00002000:00010000:0.0:1762167003.389605:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242cead80. 00000100:00100000:1.0:1762167003.389614:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451661824:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167003.389638:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2621 00000100:00100000:0.0:1762167003.389648:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451661696:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167003.389932:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 131072 -> 130987 00002000:00010000:0.0:1762167003.389936:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.389939:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.389942:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.389945:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00002000:00010000:1.0:1762167003.389960:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.389964:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167002 -> 1762167003 00002000:00010000:1.0:1762167003.389967:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167003.389969:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.389972:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167003.389984:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451661696:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 337us (465us total) trans 17179875567 rc 0/0 00000100:00100000:0.0:1762167003.389993:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2621 00002000:00010000:0.0:1762167003.389997:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2072 (130987->18446744073709551615) 00000100:00100000:1.0:1762167003.390001:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451661824:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 389us (524us total) trans 21474843066 rc 0/0 00002000:00100000:0.0:1762167003.390003:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242cead80 with x1847765451661696 ext(130987->18446744073709551615) 00002000:00010000:0.0:1762167003.390013:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242cead80. 00000100:00100000:1.0:1762167003.390017:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2620 00002000:00010000:1.0:1762167003.390022:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2069 (0->18446744073709551615) 00002000:00100000:1.0:1762167003.390025:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242cea680 with x1847765451661824 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167003.390031:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242cea680. 00000100:00100000:3.0:1762167003.391069:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.391144:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451661952 00000100:00100000:0.0:1762167003.391150:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451661952 00000100:00100000:0.0:1762167003.391189:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19472 00000100:00100000:0.0:1762167003.391196:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56173:x1847765451661952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167003.391212:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167003.391228:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08e26 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ed3 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.391294:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08e2d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.391306:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08e2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.391316:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08e2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167003.391338:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:0.0:1762167003.391342:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167003.391355:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08e2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.391392:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d08e26 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ed3 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.391406:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08e2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ed3 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.391427:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.391430:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167003.391434:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8000, rc 0) 00000100:00100000:0.0:1762167003.391477:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56173:x1847765451661952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 281us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.391483:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19472 00000100:00100000:0.0:1762167003.393610:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451662208 00000100:00100000:0.0:1762167003.393618:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451662208 00000100:00100000:0.0:1762167003.393663:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19473 00000100:00100000:0.0:1762167003.393673:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56173:x1847765451662208:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167003.393717:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167003.393747:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d08e2d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ed3 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.393805:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.393810:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167003.394032:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.394045:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.394054:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167003.394104:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952528 00000004:00010000:0.0:1762167003.394129:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ff70ee95 reply state 00000000328e0cdd transno 8589952529 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.394142:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167003.394222:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56173:x1847765451662208:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 549us (673us total) trans 8589952529 rc 0/0 00000100:00100000:0.0:1762167003.394229:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19473 00000020:00080000:0.0:1762167003.394235:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167003.394963:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.394974:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.394980:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.394986:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.394990:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.395000:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.395011:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:3.0:1762167003.395014:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.395018:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.395023:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d08e34 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167003.395447:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451662336 00000100:00100000:1.0:1762167003.395454:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451662336 00000100:00100000:1.0:1762167003.395498:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16364 00000100:00100000:1.0:1762167003.395508:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56173:x1847765451662336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167003.395523:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167003.395539:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08e3b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2eda expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167003.395560:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x816:0x0] initial LVB size: 131072, mtime: 0x690888db, atime: 0x690888db, ctime: 0x690888db, blocks: 0x103 00010000:00010000:1.0:1762167003.395578:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.395581:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.395588:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08e3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eda expref: 23 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.395602:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08e3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eda expref: 23 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.395613:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b000, rc 0) 00000100:00100000:1.0:1762167003.395652:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56173:x1847765451662336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 146us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.395663:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16364 00000100:00100000:1.0:1762167003.396795:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451662464 00000100:00100000:1.0:1762167003.396802:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451662464 00000100:00100000:1.0:1762167003.396836:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16365 00000100:00100000:1.0:1762167003.396845:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56173:x1847765451662464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167003.396855:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167003.396866:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ee1 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.396885:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d08b7f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc9 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.396891:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d08cac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e32 expref: 33 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.396895:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08ca5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e2b expref: 33 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.396900:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e24 expref: 33 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.396903:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.396904:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.396907:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 33 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.396934:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e24 expref: 33 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.396943:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e24 expref: 33 pid: 33892 timeout: 724 lvb_type: 1 00000100:00100000:1.0:1762167003.396953:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454364544:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.397018:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08ca5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e2b expref: 33 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.397027:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08ca5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e2b expref: 33 pid: 6535 timeout: 724 lvb_type: 1 00000100:00100000:1.0:1762167003.397037:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454364672:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.397065:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d08cac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e32 expref: 33 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.397073:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d08cac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e32 expref: 33 pid: 6535 timeout: 724 lvb_type: 1 00000100:00100000:1.0:1762167003.397083:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454364800:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.397116:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d08b7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc9 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.397131:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d08b7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc9 expref: 33 pid: 6532 timeout: 724 lvb_type: 1 00000100:00100000:1.0:1762167003.397140:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454364928:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.397164:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.398241:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454364544:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.398255:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454364672:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.398263:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454364800:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.398269:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454364928:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.398294:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 33 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.398309:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ac00, rc 0) 00000100:00100000:1.0:1762167003.398357:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:56173:x1847765451662464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1513us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.398374:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16365 00000100:00100000:1.0:1762167003.398673:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451662592 00000100:00100000:1.0:1762167003.398679:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451662592 00010000:00010000:1.0:1762167003.398704:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08ca5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e2b expref: 33 pid: 6535 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1762167003.398745:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451662848 00000100:00100000:1.0:1762167003.398746:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451662720 00000100:00100000:0.0:1762167003.398751:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451662848 00000100:00100000:1.0:1762167003.398752:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451662720 00010000:00010000:1.0:1762167003.398795:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e24 expref: 36 pid: 33892 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1762167003.398801:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d08cac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e32 expref: 36 pid: 6535 timeout: 724 lvb_type: 1 00000100:00100000:3.0:1762167003.398807:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7281 00000100:00100000:3.0:1762167003.398827:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765451662592:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762167003.398838:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7282 00010000:00010000:3.0:1762167003.398842:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762167003.398851:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451662720:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762167003.398856:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7284 00000100:00100000:0.0:1762167003.398866:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451662976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167003.398867:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167003.398875:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.398883:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08ca5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e2b expref: 36 pid: 6535 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.398884:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e24 expref: 36 pid: 33892 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1762167003.398886:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d08b7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc9 expref: 36 pid: 6532 timeout: 724 lvb_type: 1 00010000:00010000:3.0:1762167003.398916:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08ca5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e2b expref: 36 pid: 6535 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.398932:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e24 expref: 36 pid: 33892 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1762167003.398955:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d08b7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x819:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc9 expref: 36 pid: 6532 timeout: 724 lvb_type: 1 00010000:00010000:3.0:1762167003.398974:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d08ca5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x819:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e2b expref: 36 pid: 6535 timeout: 724 lvb_type: 1 00010000:00010000:1.0:1762167003.398981:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d08c97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x819:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e24 expref: 36 pid: 33892 timeout: 724 lvb_type: 1 00010000:00010000:3.0:1762167003.398992:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167003.398992:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d08b7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x819:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2dc9 expref: 35 pid: 6532 timeout: 724 lvb_type: 1 00010000:00010000:3.0:1762167003.398997:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.399006:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.399024:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.399033:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167003.399035:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167003.399065:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.399073:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451662720:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 224us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.399074:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451662976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 205us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.399094:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5741:1847765454365056:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167003.399094:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7282 00000100:00100000:0.0:1762167003.399106:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7284 00000100:00100000:3.0:1762167003.399150:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.400506:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.400547:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451663104 00000100:00100000:1.0:1762167003.400553:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451663104 00000100:00100000:0.0:1762167003.400558:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:1.0:1762167003.400576:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2070 (130987->18446744073709551615) 00002000:00100000:1.0:1762167003.400582:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0000 with x1847765451663104 ext(130987->18446744073709551615) 00002000:00010000:1.0:1762167003.400592:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b0000. 00000100:00100000:1.0:1762167003.400630:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2622 00000100:00100000:1.0:1762167003.400643:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451663104:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167003.401022:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb size from disk: 131072 -> 130987 00002000:00010000:1.0:1762167003.401031:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.401038:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.401044:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.401048:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:1.0:1762167003.401091:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451663104:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 451us (584us total) trans 21474843067 rc 0/0 00000100:00100000:1.0:1762167003.401111:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2622 00002000:00010000:1.0:1762167003.401118:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2070 (130987->18446744073709551615) 00002000:00100000:1.0:1762167003.401123:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0000 with x1847765451663104 ext(130987->18446744073709551615) 00002000:00010000:1.0:1762167003.401128:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b0000. 00000100:00100000:0.0:1762167003.402237:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.402289:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451663488 00000100:00100000:3.0:1762167003.402296:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451663488 00000100:00100000:3.0:1762167003.402340:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19474 00000100:00100000:3.0:1762167003.402349:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56173:x1847765451663488:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167003.402441:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.402456:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.402467:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:3.0:1762167003.402577:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ca457674 reply state 00000000ca9efe98 transno 8589952530 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167003.402586:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167003.402674:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56173:x1847765451663488:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 325us (438us total) trans 8589952530 rc 0/0 00000100:00100000:3.0:1762167003.402685:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19474 00010000:00010000:0.0:1762167003.403613:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.403632:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.403641:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.403647:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167003.403653:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.403662:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.403680:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:0.0:1762167003.403684:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167003.403690:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.403694:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08e49 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.403882:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.403923:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.403954:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451663616 00000100:00100000:1.0:1762167003.403965:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451663616 00000100:00100000:1.0:1762167003.404028:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16366 00000100:00100000:1.0:1762167003.404040:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451663616:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:0.0:1762167003.404132:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.404158:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451663872 00000100:00100000:3.0:1762167003.404166:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451663872 00000100:00100000:3.0:1762167003.404213:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16368 00000100:00100000:3.0:1762167003.404222:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765451663872:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167003.404340:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:1.0:1762167003.404350:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.404356:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.404359:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.404362:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.404363:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 137 -> 185 00002000:00010000:3.0:1762167003.404374:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.404378:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.404380:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.404383:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167003.404429:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451663616:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 386us (546us total) trans 21474843068 rc 0/0 00000100:00100000:3.0:1762167003.404439:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451663872:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 215us (305us total) trans 21474843069 rc 0/0 00000100:00100000:1.0:1762167003.404452:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16366 00000100:00100000:3.0:1762167003.404468:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16368 00000100:00100000:0.0:1762167003.405924:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.405991:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451664128 00000100:00100000:1.0:1762167003.405997:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451664128 00000100:00100000:1.0:1762167003.406030:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7221 00000100:00100000:1.0:1762167003.406039:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348212c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56173:x1847765451664128:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762167003.406090:0:30820:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d08d1c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e63 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.406134:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.406147:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08d46 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e6a expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.406155:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.406189:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08d46 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e6a expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.406202:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08d46 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e6a expref: 904 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.406229:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454365184:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.406297:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.407544:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454365184:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.407569:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167003.407735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167003.408010:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.408020:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000040:00080000:1.0:1762167003.408711:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5308, 88 off427568 00000004:00080000:1.0:1762167003.408721:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624200957071ns, next at 624276085457ns, rc = 0 00000040:00080000:1.0:1762167003.408821:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5316, 88 off428688 00000004:00080000:1.0:1762167003.408828:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624201064959ns, next at 624276043297ns, rc = 0 00000040:00080000:1.0:1762167003.408876:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5317, 88 off428776 00000004:00080000:1.0:1762167003.408883:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624201119209ns, next at 624276043297ns, rc = 0 00000040:00080000:1.0:1762167003.408909:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5309, 88 off427656 00000004:00080000:1.0:1762167003.408914:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624201150936ns, next at 624276085457ns, rc = 0 00000040:00080000:1.0:1762167003.409020:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5318, 88 off428864 00000004:00080000:1.0:1762167003.409026:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624201263590ns, next at 624276043297ns, rc = 0 00000040:00080000:1.0:1762167003.409064:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5310, 88 off427744 00000004:00080000:1.0:1762167003.409070:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624201306962ns, next at 624276085457ns, rc = 0 00000040:00080000:1.0:1762167003.409103:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5319, 88 off428952 00000004:00080000:1.0:1762167003.409108:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624201345136ns, next at 624276043297ns, rc = 0 00000040:00080000:1.0:1762167003.409147:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5311, 88 off427832 00000004:00080000:1.0:1762167003.409151:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624201388591ns, next at 624276085457ns, rc = 0 00000040:00080000:1.0:1762167003.409180:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5312, 88 off427920 00000004:00080000:1.0:1762167003.409185:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624201422177ns, next at 624276085457ns, rc = 0 00000040:00080000:1.0:1762167003.409214:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5320, 88 off429040 00000004:00080000:1.0:1762167003.409219:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624201456456ns, next at 624276043297ns, rc = 0 00000040:00080000:1.0:1762167003.409238:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5313, 88 off428008 00000004:00080000:1.0:1762167003.409242:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624201479711ns, next at 624276085457ns, rc = 0 00000040:00080000:1.0:1762167003.409272:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5321, 88 off429128 00000004:00080000:1.0:1762167003.409276:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624201513187ns, next at 624276043297ns, rc = 0 00000040:00080000:1.0:1762167003.409306:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5322, 88 off429216 00000004:00080000:1.0:1762167003.409310:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624201547642ns, next at 624276043297ns, rc = 0 00000040:00080000:1.0:1762167003.409326:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5314, 88 off428096 00000004:00080000:1.0:1762167003.409330:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624201566837ns, next at 624276085457ns, rc = 0 00000040:00080000:1.0:1762167003.409355:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5315, 88 off428184 00000004:00080000:1.0:1762167003.409360:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624201596862ns, next at 624276085457ns, rc = 0 00000040:00080000:1.0:1762167003.409384:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5323, 88 off429304 00000004:00080000:1.0:1762167003.409388:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624201625561ns, next at 624276043297ns, rc = 0 00000001:00080000:3.0:1762167003.420657:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952529 is committed 00000001:00080000:3.0:1762167003.420696:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952531 is committed 00000004:00080000:3.0:1762167003.420701:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3439 committed 00000004:00080000:3.0:1762167003.420721:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3426 committed 00000004:00080000:3.0:1762167003.420739:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3425 committed 00000004:00080000:3.0:1762167003.420742:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3438 committed 00000004:00080000:3.0:1762167003.420745:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3437 committed 00000004:00080000:3.0:1762167003.420747:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3424 committed 00000004:00080000:3.0:1762167003.420749:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3436 committed 00000004:00080000:3.0:1762167003.420751:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3423 committed 00000004:00080000:3.0:1762167003.420754:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3422 committed 00000004:00080000:3.0:1762167003.420756:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3435 committed 00000004:00080000:3.0:1762167003.420759:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3421 committed 00000004:00080000:3.0:1762167003.420800:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3434 committed 00000004:00080000:3.0:1762167003.420804:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3420 committed 00000004:00080000:3.0:1762167003.420807:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3433 committed 00000004:00080000:3.0:1762167003.420810:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3432 committed 00000004:00080000:3.0:1762167003.420812:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3419 committed 00010000:00010000:3.0:1762167003.420872:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.420889:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.420897:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.420904:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.420910:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.420920:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.420936:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:3.0:1762167003.420940:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167003.420944:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.420949:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d08e50 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167003.420956:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454365440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.421000:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454365568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.421010:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.421072:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454365312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.421085:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454365952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.421100:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.421107:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454365696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.421137:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454365824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.421142:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.421156:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.421161:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454366208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.421181:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.421190:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454365312 00000100:00100000:1.0:1762167003.421194:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454365312 00000100:00100000:3.0:1762167003.421206:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.421241:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454365824 00000100:00100000:0.0:1762167003.421241:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454366208 00000100:00100000:1.0:1762167003.421246:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454365824 00000100:00100000:0.0:1762167003.421246:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454366208 00000100:00100000:3.0:1762167003.421247:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454366080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.421279:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.421283:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16369 00000100:00100000:1.0:1762167003.421289:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16370 00000100:00100000:0.0:1762167003.421294:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454365440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.421297:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454365312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.421329:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16371 00000100:00100000:3.0:1762167003.421343:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454365696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167003.421524:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:3.0:1762167003.421529:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.421532:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167003.421535:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.421539:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.421539:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167003.421541:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167003.421548:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167003.421548:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.421553:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.421554:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167003.421559:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167003.421559:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.421564:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167003.421564:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167003.421593:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454365696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 254us (449us total) trans 17179875570 rc 0/0 00000100:00100000:3.0:1762167003.421602:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16371 00000100:00100000:0.0:1762167003.421609:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454365440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 316us (599us total) trans 17179875572 rc 0/0 00000100:00100000:0.0:1762167003.421617:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16369 00000100:00100000:1.0:1762167003.421623:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454365312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 324us (519us total) trans 17179875571 rc 0/0 00000100:00100000:3.0:1762167003.421630:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16373 00000100:00100000:0.0:1762167003.421639:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16374 00000100:00100000:3.0:1762167003.421644:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454366208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.421646:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16370 00000100:00100000:0.0:1762167003.421650:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454365568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.421666:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16375 00000100:00100000:1.0:1762167003.421676:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454366080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167003.421802:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:0.0:1762167003.421802:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:1.0:1762167003.421807:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.421807:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.421812:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167003.421812:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00002000:00010000:1.0:1762167003.421816:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.421816:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.421819:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00002000:00010000:0.0:1762167003.421819:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x810:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167003.421854:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454366080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (576us total) trans 17179875574 rc 0/0 00000100:00100000:0.0:1762167003.421855:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454365568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (650us total) trans 17179875575 rc 0/0 00000100:00100000:0.0:1762167003.421865:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16374 00000100:00100000:1.0:1762167003.421872:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16375 00002000:00010000:3.0:1762167003.421888:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167003.421894:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x819:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.421898:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x819:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.421903:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x819:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.421906:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x819:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167003.421996:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454366208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 295us (755us total) trans 17179875576 rc 0/0 00000100:00100000:3.0:1762167003.422006:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16373 00000100:00100000:3.0:1762167003.422045:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454366720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.422059:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454366336 00000100:00100000:1.0:1762167003.422064:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454366336 00000100:00100000:3.0:1762167003.422094:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.422099:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16376 00000100:00100000:1.0:1762167003.422108:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765454366336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.422114:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454366720 00000100:00100000:0.0:1762167003.422117:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454366720 00000100:00100000:3.0:1762167003.422137:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454367232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.422149:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16377 00000100:00100000:0.0:1762167003.422158:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765454366720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.422173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167003.422209:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b3100/2, rc 0, transno 17179875570 00000100:00100000:3.0:1762167003.422214:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454365696:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167003.422224:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc29f80/2, rc 0, transno 17179875576 00000100:00100000:3.0:1762167003.422227:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454366208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.422236:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1762167003.422244:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454366592:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167003.422262:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:0.0:1762167003.422263:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.422267:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.422267:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.422271:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.422271:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00000100:00100000:3.0:1762167003.422276:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167003.422277:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.422277:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.422282:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 185 -> 185 00002000:00010000:0.0:1762167003.422282:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167003.422303:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454367104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.422315:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765454366336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (285us total) trans 21474843070 rc 0/0 00000100:00100000:0.0:1762167003.422315:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454366720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (225us total) trans 21474843071 rc 0/0 00000100:00100000:1.0:1762167003.422323:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16376 00000100:00100000:0.0:1762167003.422327:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16377 00000100:00100000:3.0:1762167003.422333:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.422343:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454367232 00000100:00100000:0.0:1762167003.422343:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454366592 00000100:00100000:1.0:1762167003.422347:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454367232 00000100:00100000:0.0:1762167003.422347:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454366592 00000100:00100000:1.0:1762167003.422372:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454367104 00000100:00100000:1.0:1762167003.422375:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454367104 00000100:00100000:0.0:1762167003.422379:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16378 00000100:00100000:0.0:1762167003.422386:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454366592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.422391:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16379 00000100:00100000:1.0:1762167003.422399:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454367232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.422435:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843058 gen 2 00000004:00080000:3.0:1762167003.422440:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843041 committed transno 21474843058 00000004:00080000:3.0:1762167003.422452:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242409c00, transno 21474843042 00000004:00080000:3.0:1762167003.422463:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242409880, transno 21474843043 00000004:00080000:3.0:1762167003.422467:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354ea00, transno 21474843044 00000004:00080000:3.0:1762167003.422469:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354f480, transno 21474843045 00000004:00080000:3.0:1762167003.422471:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354ed80, transno 21474843046 00000004:00080000:3.0:1762167003.422474:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24518aa00, transno 21474843047 00000004:00080000:3.0:1762167003.422476:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354e300, transno 21474843048 00000004:00080000:3.0:1762167003.422477:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240b100, transno 21474843049 00000004:00080000:3.0:1762167003.422480:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259f80, transno 21474843051 00000004:00080000:3.0:1762167003.422482:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825b800, transno 21474843052 00000004:00080000:3.0:1762167003.422486:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258700, transno 21474843053 00000004:00080000:3.0:1762167003.422491:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825aa00, transno 21474843054 00000004:00080000:3.0:1762167003.422495:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259880, transno 21474843055 00000004:00080000:3.0:1762167003.422499:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825a680, transno 21474843056 00000004:00080000:3.0:1762167003.422503:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258000, transno 21474843057 00002000:00010000:0.0:1762167003.422505:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:3.0:1762167003.422508:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259500, transno 21474843058 00002000:00010000:1.0:1762167003.422508:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:0.0:1762167003.422510:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.422515:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.422518:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.422518:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb atime from disk: 1762166995 -> 1762166995 00000100:00100000:3.0:1762167003.422519:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37fa98380 x1847765454366720/t21474843071(21474843071) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167019 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00010000:1.0:1762167003.422521:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.422521:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.422527:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x816:0x0] updating lvb blocks from disk: 259 -> 259 00002000:00010000:0.0:1762167003.422527:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x80d:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:3.0:1762167003.422536:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa98380/2, rc 0, transno 21474843071 00000100:00100000:3.0:1762167003.422542:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454366720:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167003.422564:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb6300/2, rc 0, transno 21474843072 00000100:00100000:1.0:1762167003.422565:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454367232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (392us total) trans 21474843072 rc 0/0 00000100:00100000:0.0:1762167003.422565:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454366592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (291us total) trans 21474843073 rc 0/0 00000100:00100000:3.0:1762167003.422574:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454367232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.422579:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16379 00000100:00100000:0.0:1762167003.422584:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16378 00000004:00080000:3.0:1762167003.422597:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa9b100/2, rc 0, transno 21474843073 00000100:00100000:1.0:1762167003.422602:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16380 00000100:00100000:3.0:1762167003.422605:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454366592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.422614:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454367104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.422635:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167003.422658:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454366464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.422694:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.422694:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.422725:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454366976:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167003.422737:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.422741:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.422744:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167003.422746:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.422749:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167003.422813:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.422823:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454367104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 212us (490us total) trans 21474843074 rc 0/0 00000100:00100000:1.0:1762167003.422831:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16380 00000004:00080000:0.0:1762167003.422832:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b3480/2, rc 0, transno 17179875575 00000100:00100000:0.0:1762167003.422837:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454365568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.422848:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454365952 00000100:00100000:1.0:1762167003.422851:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454365952 00000004:00080000:3.0:1762167003.422854:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b0e00/2, rc 0, transno 17179875572 00000004:00080000:0.0:1762167003.422856:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28700/2, rc 0, transno 17179875574 00000100:00100000:3.0:1762167003.422865:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454365440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.422866:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454366080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.422870:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454366464 00000100:00100000:1.0:1762167003.422875:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454366464 00000100:00100000:1.0:1762167003.422899:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454366976 00000100:00100000:1.0:1762167003.422902:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454366976 00000100:00100000:0.0:1762167003.422906:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16381 00000100:00100000:0.0:1762167003.422913:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454365952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.422919:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16382 00000100:00100000:3.0:1762167003.422931:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454366464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167003.423033:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.423037:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.423040:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167001 -> 1762167001 00002000:00010000:0.0:1762167003.423042:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.423044:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167003.423087:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167003.423093:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167003.423093:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454365952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (455us total) trans 17179875577 rc 0/0 00002000:00010000:3.0:1762167003.423100:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.423107:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167003.423107:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16381 00002000:00010000:3.0:1762167003.423114:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:1.0:1762167003.423125:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28e00/2, rc 0, transno 17179875577 00000100:00100000:1.0:1762167003.423131:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454365952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.423138:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167003.423161:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa98e00/2, rc 0, transno 21474843075 00000100:00100000:3.0:1762167003.423163:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454366464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 234us (471us total) trans 21474843075 rc 0/0 00000100:00100000:1.0:1762167003.423171:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454366464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.423179:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16382 00000004:00080000:0.0:1762167003.423179:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa98a80/2, rc 0, transno 21474843070 00000100:00100000:0.0:1762167003.423187:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454366336:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167003.423188:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb6680/2, rc 0, transno 21474843076 00000100:00100000:1.0:1762167003.423195:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454366976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.423201:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454366848 00000100:00100000:3.0:1762167003.423207:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454366848 00000100:00100000:3.0:1762167003.423232:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16384 00000100:00100000:3.0:1762167003.423240:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454366848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167003.423311:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:3.0:1762167003.423314:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.423316:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:3.0:1762167003.423319:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.423321:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167003.423354:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454366848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (217us total) trans 21474843077 rc 0/0 00000100:00100000:3.0:1762167003.423360:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16384 00000004:00080000:0.0:1762167003.423396:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa99880/2, rc 0, transno 21474843077 00000100:00100000:0.0:1762167003.423403:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454366848:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167003.423405:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb4700/2, rc 0, transno 21474843074 00000100:00100000:3.0:1762167003.423425:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454367104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.423452:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451664384 00000100:00100000:3.0:1762167003.423456:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451664384 00000100:00100000:3.0:1762167003.423489:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19475 00000100:00100000:3.0:1762167003.423496:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56173:x1847765451664384:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.423511:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.423529:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08e57 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2ee8 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.423576:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08e57 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee8 expref: 890 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.423589:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d08e57 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee8 expref: 890 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.423610:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167003.423614:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167003.423617:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3c00, rc 0) 00000100:00100000:3.0:1762167003.423655:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56173:x1847765451664384:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 159us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.423661:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19475 00000100:00100000:0.0:1762167003.425419:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.435559:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451664768 00000100:00100000:3.0:1762167003.435574:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451664768 00000100:00100000:3.0:1762167003.435651:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19476 00000100:00100000:3.0:1762167003.435664:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56174:x1847765451664768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.435698:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.435726:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08e5e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2eef expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.438589:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.440577:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.465340:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.465433:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451665408 00000100:00100000:1.0:1762167003.465442:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451665408 00000100:00100000:1.0:1762167003.465502:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2624 00000100:00100000:1.0:1762167003.465510:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451665408:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.465540:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ea4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.465552:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.465553:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.465557:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ea4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.465566:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ea4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.467301:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ea4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.467312:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ea4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.467318:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.467323:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.467328:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.467335:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ea4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.467353:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ea4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.467361:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ea4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.467433:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451665408:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1921us (2099us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.467441:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2624 00000100:00100000:0.0:1762167003.469440:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.469508:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451665536 00000100:00100000:1.0:1762167003.469515:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451665536 00000100:00100000:1.0:1762167003.469574:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2625 00000100:00100000:1.0:1762167003.469583:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765451665536:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.469613:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 3/1,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.469628:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08da8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e8d expref: 31 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.469635:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.469637:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.469640:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 4/1,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.469677:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08da8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e8d expref: 31 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.469690:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d08da8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e8d expref: 31 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.469704:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454367360:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.469786:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.470686:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454367360:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.470707:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 3/1,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.471111:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.471424:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.471439:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.472540:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.472552:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.472560:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.472567:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167003.472571:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.472579:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.472592:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.472598:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d08eab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.472652:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2358:x1847765451665536:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3070us (3216us total) trans 0 rc 130987/130987 00000100:00100000:3.0:1762167003.472659:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2625 00000100:00100000:0.0:1762167003.474501:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.474554:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451665792 00000100:00100000:3.0:1762167003.474561:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451665792 00000100:00100000:3.0:1762167003.474623:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2626 00000100:00100000:3.0:1762167003.474633:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451665792:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167003.474676:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.474692:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08dc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e9b expref: 30 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.474705:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167003.474707:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167003.474711:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.474741:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08dc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e9b expref: 30 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.474754:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08dc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e9b expref: 30 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.474800:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454367488:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.474887:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.475813:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454367488:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167003.475902:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.476049:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451665920 00000100:00100000:3.0:1762167003.476054:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451665920 00010000:00010000:3.0:1762167003.476078:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08dc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e9b expref: 31 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.476109:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7287 00000100:00100000:3.0:1762167003.476118:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451665920:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167003.476130:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.476148:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08dc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e9b expref: 31 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.476157:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08dc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e9b expref: 31 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.476170:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d08dc4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e9b expref: 31 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.476180:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.476181:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.476184:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.476191:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.476210:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167003.476237:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451665920:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 122us (270us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167003.476242:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.476245:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7287 00010000:00010000:1.0:1762167003.476254:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.477290:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.477299:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.477304:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.477313:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.477316:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.477322:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.477331:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.477335:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08eb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.477392:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451665792:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2760us (2894us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.477401:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2626 00000100:00100000:0.0:1762167003.479193:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.479249:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451666048 00000100:00100000:1.0:1762167003.479257:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451666048 00000100:00100000:1.0:1762167003.479325:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2627 00000100:00100000:1.0:1762167003.479336:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451666048:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.479366:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.479383:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea9 expref: 26 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.479397:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.479404:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.479417:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.479449:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08de0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea9 expref: 26 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.479462:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08de0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea9 expref: 26 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.479477:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454367616:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.479543:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.480495:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454367616:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.480515:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.480706:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.480893:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451666176 00000100:00100000:3.0:1762167003.480899:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451666176 00010000:00010000:3.0:1762167003.480924:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08de0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea9 expref: 27 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.481021:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7288 00000100:00100000:3.0:1762167003.481031:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451666176:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167003.481051:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.481073:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08de0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea9 expref: 27 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.481086:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08de0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea9 expref: 27 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.481106:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d08de0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ea9 expref: 27 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.481118:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.481120:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.481123:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.481129:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.481154:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167003.481192:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451666176:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 163us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.481199:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7288 00010000:00010000:1.0:1762167003.481259:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.481266:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.482855:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.482878:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.482886:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.482891:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.482894:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.482901:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.482912:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.482916:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08eb9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.482974:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451666048:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3640us (3785us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.482984:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2627 00000100:00100000:0.0:1762167003.485240:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.485284:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451666304 00000100:00100000:1.0:1762167003.485293:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451666304 00000100:00100000:1.0:1762167003.485358:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2628 00000100:00100000:1.0:1762167003.485370:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451666304:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.485399:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.485424:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08dfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb7 expref: 25 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.485430:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.485431:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.485434:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.485459:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08dfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb7 expref: 25 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.485469:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08dfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb7 expref: 25 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.485480:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454367744:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.485548:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.486741:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454367744:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.486760:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.487062:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.487142:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451666432 00000100:00100000:3.0:1762167003.487153:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451666432 00010000:00010000:3.0:1762167003.487200:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08dfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb7 expref: 26 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.487244:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7289 00000100:00100000:3.0:1762167003.487254:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451666432:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167003.487273:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.487301:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08dfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb7 expref: 26 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.487315:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08dfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb7 expref: 26 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.487341:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d08dfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eb7 expref: 26 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.487357:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.487359:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.487364:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.487373:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.487406:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167003.487448:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.487460:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.487484:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451666432:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 229us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.487492:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7289 00010000:00010000:1.0:1762167003.488928:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.488947:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.488957:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.488964:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ae00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.488969:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.488979:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.488998:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.489006:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08ec0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.489108:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451666304:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3737us (3871us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.489120:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2628 00000100:00100000:1.0:1762167003.491145:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451666560 00000100:00100000:1.0:1762167003.491160:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451666560 00000100:00100000:1.0:1762167003.491257:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2629 00000100:00100000:1.0:1762167003.491271:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451666560:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.491311:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.491333:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08e18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ec5 expref: 29 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.491342:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.491344:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.491349:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.491391:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08e18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ec5 expref: 29 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.491421:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08e18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ec5 expref: 29 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.491439:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454367872:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.491534:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.492667:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454367872:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.492696:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.493001:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451666688 00000100:00100000:3.0:1762167003.493009:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451666688 00010000:00010000:3.0:1762167003.493048:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08e18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ec5 expref: 30 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.493095:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7290 00000100:00100000:3.0:1762167003.493104:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451666688:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167003.493120:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.493140:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08e18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ec5 expref: 30 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.493155:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08e18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ec5 expref: 30 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.493178:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d08e18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ec5 expref: 30 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.493194:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.493196:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.493199:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.493206:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.493233:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167003.493267:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.493283:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.493290:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451666688:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 184us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.493300:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7290 00010000:00010000:1.0:1762167003.494350:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.494362:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.494370:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.494377:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.494381:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.494389:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.494404:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.494423:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d08ec7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.494484:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451666560:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3217us (3435us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.494492:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2629 00000100:00100000:0.0:1762167003.496169:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.496213:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451666816 00000100:00100000:1.0:1762167003.496222:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451666816 00000100:00100000:1.0:1762167003.496280:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2630 00000100:00100000:1.0:1762167003.496290:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451666816:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.496320:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 3/1,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.496338:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08e3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eda expref: 24 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.496345:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.496348:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.496351:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 4/1,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.496383:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08e3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eda expref: 24 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.496396:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08e3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eda expref: 24 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.496423:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454368000:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.496486:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.497404:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454368000:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.497440:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 3/1,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.497839:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.497880:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451666944 00000100:00100000:3.0:1762167003.497887:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451666944 00010000:00010000:3.0:1762167003.497957:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08e3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eda expref: 25 pid: 12400 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.497994:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7291 00000100:00100000:3.0:1762167003.498003:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451666944:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167003.498015:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.498034:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08e3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eda expref: 25 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.498046:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08e3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eda expref: 25 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.498067:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d08e3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eda expref: 25 pid: 12400 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.498080:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.498082:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.498086:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.498094:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.498118:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167003.498148:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.498158:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.498167:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451666944:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 163us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.498176:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7291 00010000:00010000:1.0:1762167003.499280:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.499292:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.499301:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.499308:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.499313:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.499321:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.499335:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 2/0,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.499343:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d08ece lrc: 0/0,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.499423:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451666816:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3134us (3256us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.499433:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2630 00000100:00100000:0.0:1762167003.506835:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.506893:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451667072 00000100:00100000:3.0:1762167003.506903:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451667072 00000100:00100000:3.0:1762167003.506964:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 615 00000100:00100000:3.0:1762167003.506975:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56174:x1847765451667072:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:3.0:1762167003.506997:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.507023:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d08e96 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2efd expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.507039:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167003.507044:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167003.507090:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56174:x1847765451667072:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 119us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.507096:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 615 00000100:00100000:1.0:1762167003.508161:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451667328 00000100:00100000:1.0:1762167003.508168:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451667328 00000100:00100000:1.0:1762167003.508212:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7223 00000100:00100000:1.0:1762167003.508222:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56174:x1847765451667328:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167003.508451:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56174:x1847765451667328:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 230us (346us total) trans 8589952535 rc 0/0 00000100:00100000:1.0:1762167003.508459:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7223 00000100:00100000:0.0:1762167003.510508:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.512062:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.512182:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451667712 00000100:00100000:3.0:1762167003.512196:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451667712 00010000:00010000:3.0:1762167003.512233:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08e73 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eef expref: 898 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.512287:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7292 00000100:00100000:3.0:1762167003.512295:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451667712:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167003.512323:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.512329:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08e73 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eef expref: 898 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.512339:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08e73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eef expref: 898 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.512368:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d08e73 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2eef expref: 898 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.512395:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167003.512400:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08edc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.512427:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08edc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.512434:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08edc lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.512454:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167003.512527:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451667712:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 232us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.512536:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7292 00000100:00100000:0.0:1762167003.514702:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.516581:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.516629:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451667968 00000100:00100000:3.0:1762167003.516636:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451667968 00010000:00010000:3.0:1762167003.516663:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08edc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f04 expref: 899 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.517398:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.517418:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.517460:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:3.0:1762167003.517464:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167003.517483:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.517512:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d08eea lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f0b expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.517528:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f0b expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.517536:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167003.517539:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.517542:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:3.0:1762167003.517580:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451667840:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2723us (2885us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.517588:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19480 00000100:00100000:0.0:1762167003.519255:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.519299:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451668096 00000100:00100000:3.0:1762167003.519307:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451668096 00000100:00100000:3.0:1762167003.519353:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16385 00000100:00100000:3.0:1762167003.519361:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451668096:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167003.519374:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.519389:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08ef8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f12 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167003.519420:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888d9, ctime: 0x690888db, blocks: 0x203 00010000:00010000:3.0:1762167003.519437:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.519440:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.519448:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f12 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.519463:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f12 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.519475:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2800, rc 0) 00000100:00100000:3.0:1762167003.519507:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451668096:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 148us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.519512:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16385 00000100:00100000:0.0:1762167003.520957:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.521041:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451668352 00000100:00100000:1.0:1762167003.521049:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451668352 00000100:00100000:1.0:1762167003.521095:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7224 00000100:00100000:1.0:1762167003.521105:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451668352:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167003.521336:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451668352:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 232us (394us total) trans 8589952537 rc 0/0 00000100:00100000:1.0:1762167003.521344:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7224 00000100:00100000:0.0:1762167003.530885:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.530977:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451668608 00000100:00100000:3.0:1762167003.530987:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451668608 00000100:00100000:3.0:1762167003.531046:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19481 00000100:00100000:3.0:1762167003.531056:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56175:x1847765451668608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.531080:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.531100:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08eff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f19 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.531170:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08f06 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531184:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08f06 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531195:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08f06 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531207:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08f0d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531211:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08f0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531215:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08f0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531334:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08f14 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531342:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08f14 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531349:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08f14 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.531359:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.531467:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08f06 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531475:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08f06 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531481:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08f06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531486:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.531490:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08f06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531496:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08f06 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531507:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167003.531509:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.531512:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08f06 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531516:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d08f06 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531530:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08f0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531533:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08f0d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531537:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08f0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531539:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.531541:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08f0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531544:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08f0d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531547:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23c00) 00010000:00010000:3.0:1762167003.531548:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.531550:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08f0d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531553:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d08f0d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.531589:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d08eff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f19 expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.531600:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d08f14 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f19 expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.531607:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167003.531609:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.531612:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3a00, rc 0) 00000100:00100000:3.0:1762167003.531672:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56175:x1847765451668608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 615us (861us total) trans 8589952538 rc 0/0 00000100:00100000:3.0:1762167003.531680:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19481 00000100:00100000:0.0:1762167003.533257:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.533569:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.533749:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451668992 00000100:00100000:3.0:1762167003.533755:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451668992 00000100:00100000:3.0:1762167003.533810:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19482 00000100:00100000:3.0:1762167003.533819:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56175:x1847765451668992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.533837:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.533852:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d08f22 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f20 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.534401:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d08f29 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x641:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.534430:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d08f29 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.534439:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d08f29 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.534449:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x641:0x0]: returning size 0 00010000:00010000:3.0:1762167003.534492:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f1ee800/0xf915a5bdf3d08f22 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f20 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.534506:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d08f29 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f20 expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.534514:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x641:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:3.0:1762167003.534517:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.534520:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ee8c00, rc 0) 00000100:00100000:3.0:1762167003.534566:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56175:x1847765451668992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 749us (997us total) trans 8589952539 rc 0/0 00000100:00100000:3.0:1762167003.534573:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19482 00000100:00100000:1.0:1762167003.536309:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.536393:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451669248 00000100:00100000:3.0:1762167003.536401:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451669248 00000100:00100000:3.0:1762167003.536512:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19483 00000100:00100000:3.0:1762167003.536522:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56175:x1847765451669248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.536543:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.536561:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d08f37 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f27 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.536668:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x641:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.536683:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d08f29 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f20 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.536692:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 4/0,1 mode: --/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.536725:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d08f29 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f20 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.536738:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d08f29 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f20 expref: 902 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.536752:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454368384:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.536854:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.538043:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454368384:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167003.538066:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167003.538120:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.538468:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.538476:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.538490:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x641:0x0]: returning size 0 00000004:00080000:3.0:1762167003.538877:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81a:0x0], index 1: 0 00000004:00080000:3.0:1762167003.538891:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x817:0x0], index 0: 0 00010000:00010000:3.0:1762167003.539027:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.539035:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.539041:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.539046:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.539050:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.539062:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.539075:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x641:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:3.0:1762167003.539078:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167003.539082:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.539088:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f3e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.539142:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d08f37 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f27 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.539152:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167003.539155:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762167003.539159:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d08f37 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f27 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.539167:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ee8000, rc 0) 00000100:00100000:3.0:1762167003.539215:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56175:x1847765451669248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2695us (2913us total) trans 8589952540 rc 301/301 00000100:00100000:3.0:1762167003.539222:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19483 00000100:00100000:1.0:1762167003.540537:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.542251:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.542297:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451669760 00000100:00100000:3.0:1762167003.542304:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451669760 00000100:00100000:3.0:1762167003.542351:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19484 00000100:00100000:3.0:1762167003.542360:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56175:x1847765451669760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.542375:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.542394:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08f4c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x641:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f2e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.542462:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08f53 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x641:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.542473:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08f53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.542484:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08f53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.542511:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x641:0x0]: returning size 0 00000004:00200000:3.0:1762167003.542516:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167003.542531:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08f53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.542553:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08f4c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f2e expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.542568:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08f53 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f2e expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.542574:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x641:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:3.0:1762167003.542576:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762167003.542578:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167003.542616:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56175:x1847765451669760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 259us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.542621:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19484 00000100:00100000:0.0:1762167003.543997:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.544034:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.544049:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451669888 00000100:00100000:3.0:1762167003.544055:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451669888 00000100:00100000:3.0:1762167003.544095:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451670016 00000100:00100000:3.0:1762167003.544099:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451670016 00000100:00100000:1.0:1762167003.544105:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16386 00000100:00100000:1.0:1762167003.544116:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451669888:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167003.544127:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167003.544131:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16387 00000100:00100000:3.0:1762167003.544143:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2358:x1847765451670016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167003.544143:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08f5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f35 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.544162:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1762167003.544166:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762167003.544178:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d08f61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f3c expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.544179:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.544182:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.544191:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f35 expref: 29 pid: 12400 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1762167003.544201:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x817:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167003.544202:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f35 expref: 29 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.544214:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ae00, rc 0) 00010000:00010000:3.0:1762167003.544215:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.544218:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.544224:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d08f61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f3c expref: 25 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.544238:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d08f61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f3c expref: 25 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.544247:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:1.0:1762167003.544269:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451669888:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.544276:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765451670016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 133us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.544283:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16386 00000100:00100000:3.0:1762167003.544291:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16387 00000100:00100000:1.0:1762167003.545749:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.545816:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451670272 00000100:00100000:3.0:1762167003.545824:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451670272 00000100:00100000:3.0:1762167003.545877:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19485 00000100:00100000:3.0:1762167003.545886:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56175:x1847765451670272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.545903:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.545921:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d08f68 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f43 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.547926:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.547969:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.547987:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451670400 00000100:00100000:3.0:1762167003.547996:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451670400 00000100:00100000:1.0:1762167003.548044:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451670528 00000100:00100000:3.0:1762167003.548050:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16388 00000100:00100000:1.0:1762167003.548051:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451670528 00000100:00100000:3.0:1762167003.548068:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451670400:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167003.548094:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16389 00000100:00100000:1.0:1762167003.548105:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451670528:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167003.548143:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f7d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.548144:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.548171:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.548174:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.548176:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d08693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2be6 expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.548179:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.548195:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167003.548200:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.548200:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167003.548205:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.548228:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.548235:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.548240:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.548243:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d08693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2be6 expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.548247:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167003.548253:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.548260:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.548264:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d08693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2be6 expref: 29 pid: 33894 timeout: 724 lvb_type: 0 00010000:00010000:3.0:1762167003.548270:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.548280:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08f7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.548286:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454368512:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.548352:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451670400:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 292us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.548358:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16388 00000100:00100000:1.0:1762167003.548367:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.549471:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454368512:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.549496:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.549757:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167003.550203:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.550212:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.550232:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.550240:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.550253:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.550260:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ba00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.550264:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.550272:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.550280:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.550285:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.550330:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451670528:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2228us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.550337:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16389 00010000:00010000:0.0:1762167003.559939:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167003.574682:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.574756:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451670784 00000100:00100000:1.0:1762167003.574797:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451670784 00000100:00100000:1.0:1762167003.574861:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16390 00000100:00100000:1.0:1762167003.574872:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451670784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167003.574889:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167003.574909:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f4a expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167003.574935:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x817:0x0] initial LVB size: 0, mtime: 0x690888db, atime: 0x690888d9, ctime: 0x690888db, blocks: 0x3 00010000:00010000:1.0:1762167003.574954:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.574957:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.574965:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f4a expref: 29 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.574981:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f4a expref: 29 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.574995:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ba00, rc 0) 00000100:00100000:1.0:1762167003.575053:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451670784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 183us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.575061:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16390 00000100:00100000:0.0:1762167003.576973:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.577034:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451670912 00000100:00100000:1.0:1762167003.577042:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451670912 00000100:00100000:1.0:1762167003.577101:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2631 00000100:00100000:1.0:1762167003.577111:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451670912:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.577155:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08f92 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.577167:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.577168:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.577173:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08f92 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.577185:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08f92 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.578612:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08f92 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.578626:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08f92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.578634:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.578641:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7bc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.578645:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.578653:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08f92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.578669:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08f92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.578677:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d08f92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.578742:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451670912:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1630us (1773us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.578751:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2631 00000100:00100000:0.0:1762167003.580448:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.580494:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451671040 00000100:00100000:1.0:1762167003.580502:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451671040 00000100:00100000:1.0:1762167003.580555:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2632 00000100:00100000:1.0:1762167003.580565:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451671040:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762167003.580597:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.580615:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08f5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f35 expref: 29 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.580623:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.580625:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.580629:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.580658:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f35 expref: 29 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.580670:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d08f5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f35 expref: 29 pid: 12400 timeout: 724 lvb_type: 1 00000100:00100000:1.0:1762167003.580680:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454368640:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.580753:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.581752:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454368640:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.581796:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.581930:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167003.582264:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.582282:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167003.594853:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875577 is committed 00000001:00080000:3.0:1762167003.594859:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875578 is committed 00002000:00010000:0.0:1762167003.594885:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 0 -> 130987 00002000:00010000:0.0:1762167003.594891:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 0 -> 1762167003 00002000:00010000:0.0:1762167003.594896:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 0 -> 1762167003 00002000:00010000:0.0:1762167003.594899:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 1 -> 259 00010000:00010000:0.0:1762167003.594912:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.594924:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.594934:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.594942:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167003.594946:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.594954:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.594976:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167003.594984:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08f99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.595085:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451671040:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14517us (14639us total) trans 17179875578 rc 0/0 00000100:00100000:0.0:1762167003.595100:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2632 00000100:00100000:0.0:1762167003.596463:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000001:00080000:1.0:1762167003.608159:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952537 is committed 00000001:00080000:1.0:1762167003.608182:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952542 is committed 00000100:00100000:3.0:1762167003.608301:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56175:x1847765451671296:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 11704us (11836us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.608314:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19486 00000100:00100000:1.0:1762167003.609681:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.609718:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.609742:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451671424 00000100:00100000:0.0:1762167003.609752:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451671424 00000100:00100000:3.0:1762167003.609784:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451671552 00000100:00100000:3.0:1762167003.609791:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451671552 00000100:00100000:0.0:1762167003.609832:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16391 00000100:00100000:3.0:1762167003.609845:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16392 00000100:00100000:0.0:1762167003.609851:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451671424:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:3.0:1762167003.609861:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451671552:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:3.0:1762167003.609952:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451671552:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.609960:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451671424:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 113us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.609964:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16392 00000100:00100000:0.0:1762167003.609975:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16391 00000100:00100000:0.0:1762167003.616967:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.617013:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.617043:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451671680 00000100:00100000:1.0:1762167003.617054:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451671680 00000100:00100000:3.0:1762167003.617071:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451671808 00000100:00100000:3.0:1762167003.617079:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451671808 00000100:00100000:1.0:1762167003.617103:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16393 00000100:00100000:1.0:1762167003.617113:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765451671680:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167003.617122:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16394 00000100:00100000:3.0:1762167003.617133:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451671808:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167003.617155:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fa0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.617158:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d08fa7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.617182:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.617183:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.617186:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.617187:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.617193:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d08fa7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.617194:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fa0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.617221:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d08fa7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.617221:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fa0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.617267:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d08fa7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.617267:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fa0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.617289:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d08fa7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.617296:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fa0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.617298:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d08fa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.617314:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.617321:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.617328:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.617330:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167003.617336:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d08fa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.617343:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.617347:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d08fa7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.617358:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fa0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.617362:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d08fa7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.617371:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fa0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.617376:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d08fa7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.617469:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765451671680:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 357us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.617471:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451671808:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 339us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.617480:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16393 00000100:00100000:3.0:1762167003.617487:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16394 00000100:00100000:3.0:1762167003.618883:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451672064 00000100:00100000:3.0:1762167003.618891:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451672064 00000100:00100000:3.0:1762167003.618936:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19487 00000100:00100000:3.0:1762167003.618948:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56175:x1847765451672064:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167003.618993:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.619014:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08f53 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x641:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f2e expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.619035:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x641:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:3.0:1762167003.619045:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167003.619091:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 3/0,1 mode: --/PW res: [0x200000404:0x641:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.619103:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.619110:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:3.0:1762167003.619247:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000abdf8821 reply state 00000000bd7b1655 transno 8589952543 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167003.619253:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167003.619325:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56175:x1847765451672064:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 382us (519us total) trans 8589952543 rc 0/0 00000100:00100000:3.0:1762167003.619339:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19487 00010000:00010000:3.0:1762167003.620077:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.620087:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.620092:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.620098:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.620100:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.620106:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.620114:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x641:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167003.620115:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.620118:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 2/0,0 mode: --/PW res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.620124:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fae lrc: 0/0,0 mode: --/PW res: [0x200000404:0x641:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167003.620318:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451672192 00000100:00100000:3.0:1762167003.620323:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451672192 00000100:00100000:3.0:1762167003.620420:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19488 00000100:00100000:3.0:1762167003.620430:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56175:x1847765451672192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.620447:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.620459:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d08fb5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x641:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f51 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.620499:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d08fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f51 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.620511:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d08fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f51 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.620527:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x641:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:3.0:1762167003.620530:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167003.620532:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167003.620576:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56175:x1847765451672192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 148us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.620583:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19488 00000100:00100000:0.0:1762167003.621757:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.621871:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451672320 00000100:00100000:3.0:1762167003.621878:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451672320 00000100:00100000:3.0:1762167003.621926:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16395 00000100:00100000:3.0:1762167003.621940:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451672320:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167003.621945:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451672448 00000100:00100000:1.0:1762167003.621952:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451672448 00000100:00100000:1.0:1762167003.621984:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16396 00000100:00100000:1.0:1762167003.621992:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451672448:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167003.622243:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.622247:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 0 -> 1762167003 00002000:00010000:1.0:1762167003.622251:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 0 -> 1762167003 00002000:00010000:1.0:1762167003.622254:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 0 -> 1762167003 00002000:00010000:1.0:1762167003.622257:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167003.622278:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451672320:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 342us (524us total) trans 17179875579 rc 0/0 00000100:00100000:1.0:1762167003.622287:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451672448:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 293us (360us total) trans 21474843078 rc 0/0 00000100:00100000:3.0:1762167003.622292:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16395 00000100:00100000:1.0:1762167003.622303:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16396 00000100:00100000:0.0:1762167003.623108:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.623139:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451672704 00000100:00100000:3.0:1762167003.623144:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451672704 00000100:00100000:3.0:1762167003.623174:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19489 00000100:00100000:3.0:1762167003.623180:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56175:x1847765451672704:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:3.0:1762167003.623218:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fbc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x641:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.623235:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fbc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.623245:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fbc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.623265:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fbc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.623271:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fbc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.623277:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fbc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.623284:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.623288:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fbc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.623294:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fbc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.623304:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x641:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:3.0:1762167003.623307:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1762167003.623309:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fbc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x641:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.623313:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fbc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x641:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167003.623354:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56175:x1847765451672704:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 173us (246us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762167003.623362:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19489 00000100:00100000:0.0:1762167003.624193:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.624228:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451672960 00000100:00100000:3.0:1762167003.624234:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451672960 00000100:00100000:3.0:1762167003.624269:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19490 00000100:00100000:3.0:1762167003.624278:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56175:x1847765451672960:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167003.624311:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167003.624329:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d08ef1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f0b expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.624342:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167003.624347:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167003.624373:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.624390:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.624398:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:3.0:1762167003.624516:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cc4b4b3e reply state 00000000105c5e49 transno 8589952544 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167003.624526:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167003.624598:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56175:x1847765451672960:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 321us (406us total) trans 8589952544 rc 0/0 00000100:00100000:3.0:1762167003.624605:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19490 00010000:00010000:0.0:1762167003.625236:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.625246:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.625256:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.625261:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167003.625265:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.625270:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.625278:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:0.0:1762167003.625280:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167003.625282:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167003.625286:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d08fc3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.625471:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.625512:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451673216 00000100:00100000:1.0:1762167003.625518:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451673216 00000100:00100000:1.0:1762167003.625554:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16397 00000100:00100000:1.0:1762167003.625561:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451673216:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:0.0:1762167003.625639:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.625677:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451673088 00000100:00100000:3.0:1762167003.625683:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451673088 00002000:00010000:1.0:1762167003.625693:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.625698:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.625700:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167001 -> 1762167003 00002000:00010000:1.0:1762167003.625702:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.625704:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167003.625717:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16398 00000100:00100000:3.0:1762167003.625728:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451673088:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167003.625744:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451673216:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 181us (273us total) trans 17179875580 rc 0/0 00000100:00100000:1.0:1762167003.625756:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16397 00002000:00010000:3.0:1762167003.625945:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:3.0:1762167003.625949:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.625951:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167001 -> 1762167003 00002000:00010000:3.0:1762167003.625953:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.625955:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167003.625990:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451673088:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 265us (354us total) trans 21474843079 rc 0/0 00000100:00100000:3.0:1762167003.625997:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16398 00000100:00100000:0.0:1762167003.626903:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.628384:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.628430:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.628483:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451673728 00000100:00100000:3.0:1762167003.628490:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451673728 00000100:00100000:3.0:1762167003.628524:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7227 00000100:00100000:3.0:1762167003.628531:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:37762:x1847765451673728:12345-192.168.203.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1762167003.628669:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:37762:x1847765451673728:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 137us (285us total) trans 8589952545 rc 0/0 00000100:00100000:3.0:1762167003.628683:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7227 00000100:00100000:0.0:1762167003.629596:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167003.629844:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08fca lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.629852:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08fca lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.629870:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x641:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.629880:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d08fb5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f51 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.629892:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.629919:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d08fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f51 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.629928:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d08fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x641:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f51 expref: 894 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.629937:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454369024:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.629985:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.630755:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454369024:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.630810:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167003.630922:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167003.631135:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.631144:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167003.631555:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.631590:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.631617:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee342ae9840 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.631636:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454369152 00000100:00100000:0.0:1762167003.631640:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454369152 00000100:00100000:0.0:1762167003.631667:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1762167003.631672:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454369152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.631724:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454369152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.631729:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1762167003.631789:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.631830:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.631849:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.631866:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3507b6600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.631883:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454369280 00000100:00100000:0.0:1762167003.631887:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454369280 00000100:00100000:0.0:1762167003.631911:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1762167003.631917:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454369280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.631977:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454369280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 60us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.631987:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1762167003.632010:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875577 gen 2 00000004:00080000:1.0:1762167003.632016:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b3100, transno 17179875570 00000004:00080000:1.0:1762167003.632033:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b1500, transno 17179875571 00000004:00080000:1.0:1762167003.632036:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b0e00, transno 17179875572 00000004:00080000:1.0:1762167003.632039:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b2680, transno 17179875573 00000004:00080000:1.0:1762167003.632041:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28700, transno 17179875574 00000004:00080000:1.0:1762167003.632043:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b3480, transno 17179875575 00000004:00080000:1.0:1762167003.632046:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc29f80, transno 17179875576 00000004:00080000:1.0:1762167003.632048:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28e00, transno 17179875577 00000100:00100000:1.0:1762167003.632054:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.632105:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.632131:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.632158:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.632196:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454369408 00000100:00100000:0.0:1762167003.632201:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454369408 00000100:00100000:0.0:1762167003.632236:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1762167003.632245:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454369408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.632299:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454369408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.632306:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1762167003.632332:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.632359:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.632379:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.632399:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f000 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.632429:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454369536 00000100:00100000:0.0:1762167003.632433:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454369536 00000100:00100000:0.0:1762167003.632460:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1762167003.632467:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454369536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.632517:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454369536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 50us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.632525:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1762167003.632538:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.632567:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.632582:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.632595:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.632611:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454369664 00000100:00100000:0.0:1762167003.632615:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454369664 00000100:00100000:0.0:1762167003.632641:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1762167003.632647:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454369664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.632702:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454369664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.632710:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1762167003.632713:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.632749:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.632803:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.632824:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.632832:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454369792 00000100:00100000:0.0:1762167003.632836:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454369792 00000100:00100000:0.0:1762167003.632855:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1762167003.632859:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454369792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.632896:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454369792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 37us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.632902:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1762167003.632919:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.632953:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.632977:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.632997:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454369920 00000100:00100000:1.0:1762167003.632998:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.633001:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454369920 00000100:00100000:0.0:1762167003.633028:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1762167003.633032:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454369920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167003.633064:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454369920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167003.633069:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1762167003.633087:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454369920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.633111:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa9bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.633143:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.633163:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.633180:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454370048 00000100:00100000:3.0:1762167003.633185:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454370048 00000100:00100000:3.0:1762167003.633216:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1762167003.633221:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454370048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.633261:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454370048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 41us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.633267:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1762167003.633286:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa9bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.633320:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.633343:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.633365:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.633389:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454370176 00000100:00100000:3.0:1762167003.633394:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454370176 00000100:00100000:3.0:1762167003.633424:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1762167003.633430:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454370176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.633476:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454370176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 44us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.633484:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1762167003.633496:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.633529:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.633551:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.633574:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.633594:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454370304 00000100:00100000:3.0:1762167003.633598:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454370304 00000100:00100000:3.0:1762167003.633618:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1762167003.633622:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454370304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.633662:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454370304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 39us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.633666:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1762167003.633688:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.633715:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.633732:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.633755:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.633794:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454370432 00000100:00100000:3.0:1762167003.633799:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454370432 00000100:00100000:3.0:1762167003.633823:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1762167003.633830:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454370432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.633868:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454370432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 39us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.633873:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1762167003.633891:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.633918:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.633937:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.633957:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.633964:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454370560 00000100:00100000:3.0:1762167003.633969:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454370560 00000100:00100000:3.0:1762167003.633996:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1762167003.634002:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454370560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.634058:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454370560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.634065:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1762167003.634068:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.634097:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.634111:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.634125:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.634137:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454370688 00000100:00100000:3.0:1762167003.634142:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454370688 00000100:00100000:3.0:1762167003.634166:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1762167003.634173:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454370688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.634223:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454370688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 51us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.634231:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1762167003.634241:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.634272:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.634287:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.634300:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.634315:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454370816 00000100:00100000:3.0:1762167003.634320:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454370816 00000100:00100000:3.0:1762167003.634344:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1762167003.634351:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454370816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.634426:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454370816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.634433:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1762167003.634438:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.634464:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.634478:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.634491:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.634506:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454370944 00000100:00100000:3.0:1762167003.634510:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454370944 00000100:00100000:3.0:1762167003.634538:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1762167003.634545:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454370944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.634603:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454370944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 59us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.634611:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1762167003.634617:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454370944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.634648:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454371072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.634668:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167003.634689:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454371072 00000100:00100000:1.0:1762167003.634690:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.634693:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454371072 00000100:00100000:3.0:1762167003.634712:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1762167003.634716:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454371072:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.634750:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454371072:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 33us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.634754:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1762167003.634800:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454371072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.634835:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454371200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.634855:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.634874:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.634885:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454371200 00000100:00100000:3.0:1762167003.634891:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454371200 00000100:00100000:3.0:1762167003.634914:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:3.0:1762167003.634920:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454371200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.634956:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454371200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.634960:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1762167003.634980:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454371200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.635014:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454371328:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.635037:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167003.635057:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454371328 00000100:00100000:1.0:1762167003.635058:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.635060:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454371328 00000100:00100000:3.0:1762167003.635078:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1762167003.635084:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454371328:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.635129:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454371328:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 45us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.635135:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1762167003.635147:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454371328:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:1.0:1762167003.635426:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].41, 1000 off56168 00000001:00080000:1.0:1762167003.635435:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952546 00000100:00100000:1.0:1762167003.635496:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454371456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.635521:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.635543:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.635557:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454371456 00000100:00100000:3.0:1762167003.635561:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454371456 00000100:00100000:3.0:1762167003.635580:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1762167003.635583:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454371456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.635841:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454371456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 255us (318us total) trans 21474843080 rc 0/0 00000100:00100000:3.0:1762167003.635849:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1762167003.635873:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454371456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.635897:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454371584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.635922:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.635944:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.635964:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454371584 00000100:00100000:3.0:1762167003.635969:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454371584 00000100:00100000:3.0:1762167003.635999:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1762167003.636005:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454371584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.636230:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454371584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 224us (306us total) trans 17179875581 rc 0/0 00000100:00100000:3.0:1762167003.636240:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:1.0:1762167003.636256:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454371584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1762167003.636340:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952547 00010000:00010000:1.0:1762167003.636365:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636375:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636381:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636387:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167003.636390:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636401:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636432:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x641:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:1.0:1762167003.636435:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167003.636440:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636446:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d08fd1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x641:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636466:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08fca lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636471:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08fca lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636476:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08fca lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636480:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167003.636483:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08fca lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636489:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08fca lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636495:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:1.0:1762167003.636498:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167003.636501:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08fca lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636505:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d08fca lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.636515:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:1.0:1762167003.636516:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167003.636521:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d08f6f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f43 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.636597:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348211450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56175:x1847765451673472:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 9584us (9695us total) trans 8589952548 rc 0/0 00000100:00100000:1.0:1762167003.636609:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7226 00000020:00080000:1.0:1762167003.636613:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762167003.637871:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.637927:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451674240 00000100:00100000:3.0:1762167003.637933:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451674240 00000100:00100000:3.0:1762167003.637978:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19491 00000100:00100000:3.0:1762167003.637987:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56175:x1847765451674240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.638006:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.638027:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fd8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f58 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.638076:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f58 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.638090:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f58 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.638112:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167003.638115:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167003.638117:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922a00, rc 0) 00000100:00100000:3.0:1762167003.638157:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56175:x1847765451674240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 171us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.638163:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19491 00000100:00100000:0.0:1762167003.639613:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.639671:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451674496 00000100:00100000:1.0:1762167003.639678:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451674496 00000100:00100000:1.0:1762167003.639724:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7228 00000100:00100000:1.0:1762167003.639741:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56175:x1847765451674496:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167003.639933:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56175:x1847765451674496:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 200us (324us total) trans 8589952549 rc 0/0 00000100:00100000:1.0:1762167003.639943:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7228 00000100:00100000:0.0:1762167003.640904:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.640937:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451674752 00000100:00100000:1.0:1762167003.640943:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451674752 00000100:00100000:1.0:1762167003.640982:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7229 00000100:00100000:1.0:1762167003.640990:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56175:x1847765451674752:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762167003.641171:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x641:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762167003.641245:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x641:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.641256:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.641266:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.641271:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.641275:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.641278:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.641296:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762167003.641323:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167003.641328:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167003.641334:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167003.641338:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167003.641345:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x641:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167003.641356:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x641:0x0].0x0 (ffff9ee345a77000) 00010000:00010000:0.0:1762167003.641358:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762167003.641362:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 1/0,0 mode: --/PW res: [0x200000404:0x641:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167003.641367:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d08fdf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x641:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167003.641380:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56175:x1847765451674752:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 390us (477us total) trans 8589952550 rc 0/0 00010000:00010000:0.0:1762167003.641385:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167003.641387:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167003.641389:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167003.641390:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7229 00000100:00100000:0.0:1762167003.650555:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.650619:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451674880 00000100:00100000:3.0:1762167003.650630:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451674880 00000100:00100000:3.0:1762167003.650698:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19492 00000100:00100000:3.0:1762167003.650709:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56176:x1847765451674880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.650732:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.650751:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fe6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f5f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.650831:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08fed lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.650845:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08fed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.650858:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08fed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.650878:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08ff4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.650886:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.650893:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.650990:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d08ffb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.650999:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d08ffb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651005:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d08ffb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.651036:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:3.0:1762167003.651040:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167003.651055:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d08ffb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651066:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d08ffb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651073:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08fed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651079:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08fed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651084:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08fed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651089:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.651093:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08fed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651099:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08fed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651109:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167003.651112:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.651115:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08fed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651121:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d08fed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651130:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651135:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651140:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651144:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.651147:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651151:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651158:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23c00) 00010000:00010000:3.0:1762167003.651160:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.651163:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08ff4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651168:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d08ff4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.651196:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d08fe6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f5f expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.651207:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d08ffb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f5f expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.651226:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167003.651229:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.651232:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167003.651298:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56176:x1847765451674880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 591us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.651306:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19492 00000100:00100000:3.0:1762167003.653075:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451675136 00000100:00100000:3.0:1762167003.653083:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451675136 00000100:00100000:3.0:1762167003.653129:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19493 00000100:00100000:3.0:1762167003.653138:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56176:x1847765451675136:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.653157:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.653173:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09002 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f66 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.653277:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09009 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.653288:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09009 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.653296:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09009 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.653307:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.653444:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09002 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f66 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.653462:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09009 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f66 expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.653469:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167003.653472:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167003.653475:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167003.653522:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56176:x1847765451675136:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 385us (550us total) trans 8589952551 rc 0/0 00000100:00100000:3.0:1762167003.653529:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19493 00000100:00100000:0.0:1762167003.654910:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.679661:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.679740:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451675520 00000100:00100000:1.0:1762167003.679751:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451675520 00000100:00100000:1.0:1762167003.679864:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2633 00000100:00100000:1.0:1762167003.679876:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451675520:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.679912:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0902c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.679926:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.679928:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.679934:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0902c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.679954:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0902c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.681327:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0902c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.681342:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0902c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.681356:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0902c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.681363:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.681367:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0902c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.681376:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0902c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.681392:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0902c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.681400:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0902c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.681477:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451675520:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1602us (1823us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.681487:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2633 00000100:00100000:0.0:1762167003.683749:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.683827:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451675648 00000100:00100000:1.0:1762167003.683837:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451675648 00000100:00100000:1.0:1762167003.683894:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2634 00000100:00100000:1.0:1762167003.683904:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451675648:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167003.683945:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x810:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888d3, ctime: 0x690888db, blocks: 0x203 00010000:00010000:1.0:1762167003.683951:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09033 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.683961:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.683963:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.683966:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09033 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.683975:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09033 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.685195:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09033 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.685206:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09033 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.685212:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09033 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.685217:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7bc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.685220:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09033 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.685225:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09033 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.685245:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09033 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.685252:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09033 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.685334:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451675648:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1426us (1585us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.685344:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2634 00000100:00100000:0.0:1762167003.687081:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.687116:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451675776 00000100:00100000:1.0:1762167003.687124:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451675776 00000100:00100000:1.0:1762167003.687170:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2635 00000100:00100000:1.0:1762167003.687176:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451675776:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167003.687212:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888d5, ctime: 0x690888db, blocks: 0x203 00010000:00010000:1.0:1762167003.687220:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0903a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.687231:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.687233:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.687238:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0903a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.687249:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0903a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.688463:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0903a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.688483:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0903a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.688492:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0903a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.688499:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.688503:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0903a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.688512:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0903a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.688526:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0903a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.688534:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0903a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.688601:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451675776:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1422us (1523us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.688611:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2635 00000100:00100000:0.0:1762167003.690347:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.690387:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451675904 00000100:00100000:1.0:1762167003.690394:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451675904 00000100:00100000:1.0:1762167003.690454:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2636 00000100:00100000:1.0:1762167003.690463:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451675904:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167003.690505:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x812:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888d7, ctime: 0x690888db, blocks: 0x203 00010000:00010000:1.0:1762167003.690514:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09041 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.690527:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.690528:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.690532:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09041 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.690542:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09041 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.691742:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09041 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.691754:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09041 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.691781:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.691788:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ae00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.691792:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09041 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.691799:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09041 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.691813:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09041 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.691823:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09041 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.691900:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451675904:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1436us (1558us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.691908:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2636 00000100:00100000:0.0:1762167003.693634:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.693680:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451676032 00000100:00100000:1.0:1762167003.693689:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451676032 00000100:00100000:1.0:1762167003.693753:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2637 00000100:00100000:1.0:1762167003.693785:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451676032:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.693815:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09048 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.693828:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.693830:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.693839:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09048 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.693849:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09048 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.694891:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09048 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.694900:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09048 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.694906:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09048 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.694911:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.694914:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09048 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.694920:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09048 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.694929:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09048 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.694934:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09048 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.694990:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451676032:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1228us (1358us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.694999:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2637 00000100:00100000:0.0:1762167003.696824:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.696859:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451676160 00000100:00100000:1.0:1762167003.696867:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451676160 00000100:00100000:1.0:1762167003.696909:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2638 00000100:00100000:1.0:1762167003.696917:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451676160:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167003.696964:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888da, ctime: 0x690888db, blocks: 0x103 00010000:00010000:1.0:1762167003.696972:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0904f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.696984:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.696986:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.696990:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0904f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.697002:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0904f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.698332:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0904f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.698346:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0904f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.698360:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0904f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.698367:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7bc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.698372:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0904f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.698381:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0904f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.698395:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0904f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.698402:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0904f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.698494:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451676160:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1573us (1673us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.698504:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2638 00000100:00100000:0.0:1762167003.700133:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.700172:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451676288 00000100:00100000:1.0:1762167003.700180:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451676288 00000100:00100000:1.0:1762167003.700225:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2639 00000100:00100000:1.0:1762167003.700231:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451676288:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167003.700275:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x816:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888db, ctime: 0x690888db, blocks: 0x103 00010000:00010000:1.0:1762167003.700283:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09056 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.700295:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.700298:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.700302:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09056 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.700326:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09056 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.701381:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09056 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.701391:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09056 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.701396:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09056 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.701400:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.701403:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09056 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.701419:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09056 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.701430:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09056 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.701435:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09056 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.701507:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451676288:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1274us (1375us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.701515:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2639 00000100:00100000:0.0:1762167003.703221:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.703261:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451676416 00000100:00100000:1.0:1762167003.703267:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451676416 00000100:00100000:1.0:1762167003.703312:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2640 00000100:00100000:1.0:1762167003.703318:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451676416:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167003.703349:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888db, ctime: 0x690888db, blocks: 0x103 00010000:00010000:1.0:1762167003.703355:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0905d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.703364:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.703365:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.703368:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0905d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.703377:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0905d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.704513:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0905d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.704527:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0905d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.704534:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0905d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.704540:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.704544:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0905d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.704552:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0905d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.704567:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0905d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.704574:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0905d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.704644:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451676416:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1323us (1424us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.704654:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2640 00000100:00100000:0.0:1762167003.711058:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.712366:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.712875:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451676800 00000100:00100000:1.0:1762167003.712883:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451676800 00000100:00100000:1.0:1762167003.712928:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7230 00000100:00100000:1.0:1762167003.712937:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56176:x1847765451676800:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167003.713144:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56176:x1847765451676800:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 207us (781us total) trans 8589952553 rc 0/0 00000100:00100000:1.0:1762167003.713149:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7230 00000100:00100000:0.0:1762167003.715455:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.717155:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.717455:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0906b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.717467:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0906b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.717487:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.717680:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09064 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f74 expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.717694:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0906b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f74 expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.717701:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167003.717704:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167003.717706:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:3.0:1762167003.717744:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451677056:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2162us (2296us total) trans 8589952554 rc 0/0 00000100:00100000:3.0:1762167003.717751:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19495 00000100:00100000:0.0:1762167003.719183:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.719232:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451677312 00000100:00100000:3.0:1762167003.719239:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451677312 00000100:00100000:3.0:1762167003.719287:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19496 00000100:00100000:3.0:1762167003.719296:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451677312:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167003.719316:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.719331:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09079 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f7b expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.719395:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09080 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.719422:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0906b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f74 expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.719429:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09080 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.719458:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0906b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f74 expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.719471:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0906b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f74 expref: 905 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.719483:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454371840:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.719564:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167003.721184:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.721208:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454371840:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167003.721230:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09080 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.721569:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09080 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.721580:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09080 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.721624:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:3.0:1762167003.721629:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167003.721647:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09080 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.721676:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09079 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f7b expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.721689:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09080 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f7b expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.721701:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167003.721704:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.721707:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167003.721827:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451677312:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2532us (2649us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.721832:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19496 00000100:00100000:0.0:1762167003.723200:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.723242:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451677568 00000100:00100000:3.0:1762167003.723247:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451677568 00000100:00100000:3.0:1762167003.723298:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16399 00000100:00100000:3.0:1762167003.723307:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451677568:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167003.723320:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.723337:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09087 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f82 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167003.723356:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x812:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888d7, ctime: 0x690888db, blocks: 0x203 00010000:00010000:3.0:1762167003.723368:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.723369:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.723375:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09087 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f82 expref: 28 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.723385:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09087 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f82 expref: 28 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.723393:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:3.0:1762167003.723446:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451677568:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 140us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.723453:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16399 00000100:00100000:0.0:1762167003.725103:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.725151:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451677824 00000100:00100000:1.0:1762167003.725158:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451677824 00000100:00100000:1.0:1762167003.725192:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7231 00000100:00100000:1.0:1762167003.725198:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451677824:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167003.725400:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451677824:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 201us (302us total) trans 8589952555 rc 0/0 00000100:00100000:1.0:1762167003.725420:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7231 00000100:00100000:0.0:1762167003.734190:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.734277:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451678080 00000100:00100000:3.0:1762167003.734286:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451678080 00000100:00100000:3.0:1762167003.734338:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19497 00000100:00100000:3.0:1762167003.734349:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56177:x1847765451678080:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.734372:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.734391:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0908e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f89 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.734473:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09095 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734491:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09095 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734501:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09095 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734515:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0909c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734522:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0909c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734529:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0909c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734648:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d090a3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734657:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d090a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734664:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d090a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.734675:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.734797:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09095 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734805:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09095 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734813:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09095 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734819:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.734823:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09095 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734830:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09095 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734841:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167003.734844:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.734849:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09095 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734854:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09095 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734865:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0909c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734871:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0909c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734881:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0909c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734885:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.734888:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0909c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734893:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0909c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734900:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167003.734902:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.734905:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0909c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734910:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0909c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.734950:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0908e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f89 expref: 908 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.734963:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d090a3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f89 expref: 907 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.734970:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167003.734973:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.734975:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:3.0:1762167003.735035:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56177:x1847765451678080:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 688us (851us total) trans 8589952556 rc 0/0 00000100:00100000:3.0:1762167003.735042:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19497 00000100:00100000:0.0:1762167003.736670:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.736702:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.736792:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451678464 00000100:00100000:1.0:1762167003.736797:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451678464 00000100:00100000:1.0:1762167003.736842:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7232 00000100:00100000:1.0:1762167003.736854:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348210050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56177:x1847765451678464:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167003.737013:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348210050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56177:x1847765451678464:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 163us (309us total) trans 8589952557 rc 0/0 00000100:00100000:1.0:1762167003.737018:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7232 00000100:00100000:0.0:1762167003.739070:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.739160:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451678720 00000100:00100000:3.0:1762167003.739167:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451678720 00000100:00100000:3.0:1762167003.739203:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19498 00000100:00100000:3.0:1762167003.739209:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56177:x1847765451678720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.739224:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.739238:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d090b1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f90 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.739322:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d090b8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.739336:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09080 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f7b expref: 908 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.739343:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d090b8 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.739373:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09080 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f7b expref: 908 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.739385:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09080 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f7b expref: 908 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.739397:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454371968:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.739477:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.740304:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454371968:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167003.740324:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d090b8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.741158:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.741534:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d090b8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.741544:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d090b8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.741562:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.741734:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d090b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f90 expref: 909 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.741751:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d090b8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f90 expref: 908 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.741758:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167003.741799:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167003.741802:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:3.0:1762167003.741832:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56177:x1847765451678720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2622us (2767us total) trans 8589952558 rc 0/0 00000100:00100000:3.0:1762167003.741839:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19498 00000100:00100000:0.0:1762167003.743280:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.743336:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451678976 00000100:00100000:1.0:1762167003.743345:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451678976 00000100:00100000:1.0:1762167003.743384:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7233 00000100:00100000:1.0:1762167003.743391:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56177:x1847765451678976:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:1.0:1762167003.743517:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56177:x1847765451678976:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 126us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.743530:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7233 00000100:00100000:0.0:1762167003.744575:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.744626:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451679232 00000100:00100000:1.0:1762167003.744633:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451679232 00000100:00100000:1.0:1762167003.744670:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7234 00000100:00100000:1.0:1762167003.744678:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56177:x1847765451679232:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167003.744894:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56177:x1847765451679232:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 216us (320us total) trans 8589952559 rc 0/0 00000100:00100000:1.0:1762167003.744904:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7234 00000100:00100000:0.0:1762167003.746179:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.746228:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451679488 00000100:00100000:3.0:1762167003.746239:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451679488 00000100:00100000:3.0:1762167003.746305:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19499 00000100:00100000:3.0:1762167003.746318:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56177:x1847765451679488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.746348:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.746352:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762167003.746396:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d090b8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f90 expref: 909 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.746443:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09009 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f66 expref: 908 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.746461:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167003.746466:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167003.746481:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d090c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f97 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.746616:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d090cd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.746631:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d090cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.746642:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d090cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.746654:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.746827:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d090c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f97 expref: 910 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.746844:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d090cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f97 expref: 909 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.746852:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:3.0:1762167003.746856:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167003.746859:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167003.746925:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56177:x1847765451679488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 610us (757us total) trans 8589952560 rc 0/0 00000100:00100000:3.0:1762167003.746933:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19499 00000100:00100000:0.0:1762167003.748268:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.748319:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451679744 00000100:00100000:1.0:1762167003.748326:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451679744 00000100:00100000:1.0:1762167003.748374:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7235 00000100:00100000:1.0:1762167003.748385:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56177:x1847765451679744:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762167003.748517:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d090cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f97 expref: 909 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.748550:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.748563:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f58 expref: 909 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.748578:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.748614:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f58 expref: 909 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.748625:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d08fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f58 expref: 909 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.748638:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454372096:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.748710:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.750004:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454372096:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.750039:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167003.750277:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167003.750610:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.750622:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.751149:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.751159:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.751166:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.751172:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167003.751177:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.751185:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.751199:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:1.0:1762167003.751203:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167003.751209:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.751215:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d090db lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.751227:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23100) 00010000:00010000:1.0:1762167003.751228:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167003.751232:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d090cd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f97 expref: 908 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.751418:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56177:x1847765451679744:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 3024us (3145us total) trans 8589952561 rc -22/-22 00000100:00100000:1.0:1762167003.751427:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7235 00000100:00100000:0.0:1762167003.752521:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.752571:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451680000 00000100:00100000:3.0:1762167003.752581:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451680000 00000100:00100000:3.0:1762167003.752636:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19500 00000100:00100000:3.0:1762167003.752648:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56177:x1847765451680000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.752673:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.752698:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d090e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2f9e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.752758:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d090e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f9e expref: 909 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.752798:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d090e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f9e expref: 909 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.752821:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167003.752826:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167003.752832:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922200, rc 0) 00000100:00100000:3.0:1762167003.752877:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56177:x1847765451680000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 232us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.752885:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19500 00000100:00100000:0.0:1762167003.754633:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.754706:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451680256 00000100:00100000:3.0:1762167003.754721:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451680256 00000100:00100000:3.0:1762167003.754813:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19501 00000100:00100000:3.0:1762167003.754828:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56177:x1847765451680256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.754849:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.754868:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d090e9 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2fa5 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.755325:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d090f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x642:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.755340:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d090f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x642:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.755351:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d090f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x642:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.755361:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x642:0x0]: returning size 0 00010000:00010000:3.0:1762167003.755400:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d090e9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fa5 expref: 912 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.755426:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d090f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x642:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fa5 expref: 911 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.755432:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x642:0x0].0x0 (ffff9ee342c23d00) 00010000:00010000:3.0:1762167003.755434:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.755436:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167003.755497:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56177:x1847765451680256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 673us (872us total) trans 8589952562 rc 0/0 00000100:00100000:3.0:1762167003.755504:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19501 00000100:00100000:0.0:1762167003.757006:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.757083:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451680512 00000100:00100000:3.0:1762167003.757091:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451680512 00000100:00100000:3.0:1762167003.757135:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19502 00000100:00100000:3.0:1762167003.757145:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56177:x1847765451680512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.757166:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.757180:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d090fe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2fac expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.757257:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09105 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.757270:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09105 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.757278:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09105 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.757290:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.757381:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d090fe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fac expref: 914 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.757399:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09105 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fac expref: 913 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.757422:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167003.757425:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167003.757428:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:3.0:1762167003.757474:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56177:x1847765451680512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 330us (471us total) trans 8589952563 rc 0/0 00000100:00100000:3.0:1762167003.757482:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19502 00000100:00100000:0.0:1762167003.758440:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.758511:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451680768 00000100:00100000:1.0:1762167003.758525:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451680768 00000100:00100000:1.0:1762167003.758596:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7236 00000100:00100000:1.0:1762167003.758611:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56177:x1847765451680768:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762167003.758696:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09105 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fac expref: 913 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.758735:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.758748:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d090e2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f9e expref: 913 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.758757:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.758832:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d090e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f9e expref: 913 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.758847:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d090e2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f9e expref: 913 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.758863:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454372224:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.758956:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f300 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.759916:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454372224:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.759945:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167003.760061:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167003.760353:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.760364:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.760387:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x642:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.760420:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d090f0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x642:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fa5 expref: 913 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.760427:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.760453:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d090f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x642:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fa5 expref: 912 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.760463:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d090f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x642:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fa5 expref: 912 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.760484:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454372352:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.760553:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f300 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.761464:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454372352:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.761489:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167003.761601:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167003.761887:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.761898:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167003.762512:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454372480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.762548:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.762572:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee342ae9840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.762588:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454372480 00000100:00100000:3.0:1762167003.762594:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454372480 00000100:00100000:3.0:1762167003.762639:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1762167003.762647:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454372480:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.762714:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454372480:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.762720:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1762167003.762751:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454372480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.762804:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454372608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.762829:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.762851:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3457d30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.762871:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454372608 00000100:00100000:3.0:1762167003.762875:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454372608 00000100:00100000:3.0:1762167003.762907:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1762167003.762916:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454372608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.762986:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454372608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.762993:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1762167003.763020:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454372608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763060:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454372736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763083:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.763104:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee342ae9840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.763115:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454372736 00000100:00100000:3.0:1762167003.763119:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454372736 00000100:00100000:3.0:1762167003.763145:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1762167003.763151:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454372736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.763203:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454372736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.763210:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1762167003.763229:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454372736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763263:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454372864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763286:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.763308:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.763323:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454372864 00000100:00100000:3.0:1762167003.763327:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454372864 00000100:00100000:3.0:1762167003.763348:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1762167003.763353:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454372864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.763398:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454372864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 44us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.763403:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1762167003.763430:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454372864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763465:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454372992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763486:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167003.763503:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454372992 00000100:00100000:1.0:1762167003.763504:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f300 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.763507:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454372992 00000100:00100000:3.0:1762167003.763527:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:3.0:1762167003.763531:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454372992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.763585:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454372992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.763593:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1762167003.763595:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454372992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763620:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763633:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.763645:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.763651:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454373120 00000100:00100000:3.0:1762167003.763657:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454373120 00000100:00100000:3.0:1762167003.763685:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1762167003.763692:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454373120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.763788:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454373120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.763791:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.763801:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1762167003.763820:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763834:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.763852:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee342ae9840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.763855:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454373248 00000100:00100000:3.0:1762167003.763860:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454373248 00000100:00100000:3.0:1762167003.763884:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1762167003.763889:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454373248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.763926:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454373248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 37us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.763930:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1762167003.763949:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763979:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.763995:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.764008:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f300 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.764017:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454373376 00000100:00100000:3.0:1762167003.764022:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454373376 00000100:00100000:3.0:1762167003.764049:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1762167003.764054:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454373376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.764094:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454373376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.764099:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1762167003.764105:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.764129:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.764142:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.764155:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.764163:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454373504 00000100:00100000:3.0:1762167003.764168:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454373504 00000100:00100000:3.0:1762167003.764191:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1762167003.764196:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454373504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.764237:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454373504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 39us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.764243:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.764253:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1762167003.764269:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.764282:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.764293:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee342ae9840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.764302:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454373632 00000100:00100000:3.0:1762167003.764307:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454373632 00000100:00100000:3.0:1762167003.764328:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1762167003.764343:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454373632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.764419:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454373632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.764425:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1762167003.764432:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.764463:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.764484:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167003.764502:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454373760 00000100:00100000:1.0:1762167003.764505:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f300 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.764507:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454373760 00000100:00100000:3.0:1762167003.764541:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1762167003.764547:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454373760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.764592:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454373760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 46us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.764598:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1762167003.764615:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.764646:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.764668:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.764687:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.764688:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454373888 00000100:00100000:3.0:1762167003.764693:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454373888 00000100:00100000:3.0:1762167003.764718:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1762167003.764726:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454373888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.764792:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454373888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 67us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.764799:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1762167003.764826:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454373888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.764856:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.764876:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.764893:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee342ae9840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.764897:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454374016 00000100:00100000:3.0:1762167003.764901:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454374016 00000100:00100000:3.0:1762167003.764921:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1762167003.764926:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454374016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.764974:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454374016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 47us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.764982:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1762167003.764990:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.765020:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.765037:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.765050:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f300 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.765059:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454374144 00000100:00100000:3.0:1762167003.765064:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454374144 00000100:00100000:3.0:1762167003.765089:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1762167003.765095:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454374144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.765151:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454374144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 55us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.765158:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1762167003.765166:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.765199:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.765221:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.765239:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.765240:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454374272 00000100:00100000:3.0:1762167003.765245:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454374272 00000100:00100000:3.0:1762167003.765271:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1762167003.765279:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454374272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.765326:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454374272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.765333:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1762167003.765344:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.765372:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.765393:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.765420:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee342ae9840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.765424:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454374400 00000100:00100000:3.0:1762167003.765430:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454374400 00000100:00100000:3.0:1762167003.765450:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1762167003.765454:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454374400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.765490:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454374400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.765495:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1762167003.765513:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374400:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:1.0:1762167003.765734:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].42, 816 off56984 00000001:00080000:1.0:1762167003.765742:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952564 00000100:00100000:1.0:1762167003.765849:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.765870:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.765891:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.765919:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454374528 00000100:00100000:3.0:1762167003.765923:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454374528 00000100:00100000:3.0:1762167003.765953:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1762167003.765960:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:30820:x1847765454374528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.766149:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454374528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 189us (276us total) trans 21474843081 rc 0/0 00000100:00100000:3.0:1762167003.766158:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1762167003.766177:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.766198:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e472680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167003.766228:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.766245:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.766268:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454374656 00000100:00100000:3.0:1762167003.766273:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454374656 00000100:00100000:3.0:1762167003.766301:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1762167003.766307:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454374656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167003.766477:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:30820:x1847765454374656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 170us (249us total) trans 17179875582 rc 0/0 00000100:00100000:3.0:1762167003.766482:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1762167003.766508:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e472680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454374656:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1762167003.766568:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952565 00010000:00010000:1.0:1762167003.766586:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766592:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766598:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766608:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167003.766612:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766619:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766632:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x642:0x0].0x0 (ffff9ee342c23d00) 00010000:00010000:1.0:1762167003.766635:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167003.766639:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766645:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0911a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x642:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766664:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766671:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766677:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766681:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167003.766683:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766689:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766696:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167003.766699:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167003.766701:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766706:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09113 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.766717:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167003.766719:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167003.766726:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09105 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fac expref: 914 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.766821:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56177:x1847765451680768:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 8215us (8383us total) trans 8589952566 rc 0/0 00000100:00100000:1.0:1762167003.766830:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7236 00000020:00080000:1.0:1762167003.766835:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762167003.768105:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.768152:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451681152 00000100:00100000:3.0:1762167003.768159:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451681152 00000100:00100000:3.0:1762167003.768201:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19503 00000100:00100000:3.0:1762167003.768211:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56177:x1847765451681152:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.768226:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.768243:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09121 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2fb3 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.768289:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09121 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fb3 expref: 914 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.768302:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09121 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fb3 expref: 914 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.768318:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167003.768321:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167003.768324:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:3.0:1762167003.768363:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56177:x1847765451681152:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.768369:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19503 00000100:00100000:0.0:1762167003.770042:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.770084:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451681408 00000100:00100000:1.0:1762167003.770089:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451681408 00000100:00100000:1.0:1762167003.770128:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7237 00000100:00100000:1.0:1762167003.770138:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348213850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56177:x1847765451681408:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762167003.770559:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x642:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762167003.770633:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5324, 64 off429368 00000004:00080000:1.0:1762167003.770638:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624562875642ns, next at 625562874244ns, rc = 0 00000040:00080000:1.0:1762167003.770669:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5316, 64 off428248 00000004:00080000:1.0:1762167003.770673:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624562910513ns, next at 625562909088ns, rc = 0 00000001:00080000:1.0:1762167003.770679:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952567 00010000:00010000:1.0:1762167003.770723:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x642:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.770733:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x642:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.770747:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x642:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.770755:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x642:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.770783:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x642:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.770790:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x642:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167003.770808:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762167003.770850:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167003.770858:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x642:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.770867:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7bc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167003.770871:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x642:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.770878:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x642:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.770891:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x642:0x0].0x0 (ffff9ee345a77c00) 00010000:00010000:3.0:1762167003.770894:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762167003.770897:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x642:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167003.770904:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09128 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x642:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167003.770906:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348213850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56177:x1847765451681408:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 768us (866us total) trans 8589952568 rc 0/0 00000100:00100000:1.0:1762167003.770922:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7237 00000020:00080000:1.0:1762167003.770927:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167003.770934:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167003.770938:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167003.770941:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167003.772178:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.772239:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451681664 00000100:00100000:1.0:1762167003.772249:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451681664 00000100:00100000:1.0:1762167003.772304:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7238 00000100:00100000:1.0:1762167003.772316:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56177:x1847765451681664:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167003.772617:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:56177:x1847765451681664:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 303us (448us total) trans 8589952569 rc 0/0 00000100:00100000:1.0:1762167003.772625:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7238 00000100:00100000:0.0:1762167003.782206:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.782282:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451681792 00000100:00100000:3.0:1762167003.782295:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451681792 00000100:00100000:3.0:1762167003.782354:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19504 00000100:00100000:3.0:1762167003.782365:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:56178:x1847765451681792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.782391:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.782435:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0912f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2fba expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.782498:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09136 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782511:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09136 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782520:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09136 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782533:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0913d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782539:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0913d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782544:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0913d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782635:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09144 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782641:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09144 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782645:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09144 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.782673:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:3.0:1762167003.782677:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167003.782693:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09144 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782706:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09144 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782714:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09136 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782721:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09136 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782728:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09136 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782734:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.782738:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09136 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782745:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09136 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782755:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167003.782758:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.782796:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09136 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782804:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09136 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782820:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0913d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782826:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0913d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782831:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0913d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782837:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.782840:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0913d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782846:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0913d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782854:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167003.782856:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.782859:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0913d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782864:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0913d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.782893:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0912f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fba expref: 919 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.782907:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09144 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fba expref: 918 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.782914:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167003.782916:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.782919:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167003.782982:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56178:x1847765451681792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 619us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.782989:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19504 00000100:00100000:0.0:1762167003.784448:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.784508:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451681920 00000100:00100000:3.0:1762167003.784515:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451681920 00000100:00100000:3.0:1762167003.784560:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16400 00000100:00100000:3.0:1762167003.784570:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451681920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.784583:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.784599:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0914b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2fc1 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167003.784623:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888da, ctime: 0x690888db, blocks: 0x103 00010000:00010000:3.0:1762167003.784637:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.784640:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.784647:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0914b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc1 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.784663:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0914b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc1 expref: 24 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.784673:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:3.0:1762167003.784718:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451681920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 150us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.784725:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16400 00000100:00100000:0.0:1762167003.785979:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.786019:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451682176 00000100:00100000:3.0:1762167003.786025:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451682176 00000100:00100000:3.0:1762167003.786065:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19505 00000100:00100000:3.0:1762167003.786076:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56178:x1847765451682176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.786090:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.786103:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09152 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2fc8 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.786190:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09159 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.786203:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09159 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.786212:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09159 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.786222:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.786339:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09152 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc8 expref: 921 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.786355:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09159 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc8 expref: 920 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.786363:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167003.786367:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167003.786370:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:3.0:1762167003.786421:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56178:x1847765451682176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 348us (443us total) trans 8589952570 rc 0/0 00000100:00100000:3.0:1762167003.786429:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19505 00000100:00100000:0.0:1762167003.787551:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.787595:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451682432 00000100:00100000:3.0:1762167003.787606:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451682432 00000100:00100000:3.0:1762167003.787646:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19506 00000100:00100000:3.0:1762167003.787655:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56178:x1847765451682432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167003.787669:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.787681:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09167 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2fcf expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.787732:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0916e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.787740:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0916e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.787746:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0916e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.787753:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.787856:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09167 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fcf expref: 923 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.787871:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0916e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fcf expref: 922 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.787879:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167003.787882:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167003.787884:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922200, rc 0) 00000100:00100000:3.0:1762167003.787926:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:56178:x1847765451682432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 273us (379us total) trans 8589952571 rc 0/0 00000100:00100000:3.0:1762167003.787932:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19506 00000100:00100000:0.0:1762167003.811980:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.812087:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451682560 00000100:00100000:1.0:1762167003.812097:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451682560 00000100:00100000:1.0:1762167003.812173:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2641 00000100:00100000:1.0:1762167003.812184:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451682560:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.812223:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0917c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.812239:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.812241:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.812246:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0917c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.812260:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0917c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.813725:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0917c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.813740:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0917c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.813748:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0917c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.813754:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.813759:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0917c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.813794:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0917c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.813809:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0917c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.813821:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0917c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.813886:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451682560:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1701us (1913us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.813900:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2641 00000100:00100000:0.0:1762167003.815859:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.815896:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451682688 00000100:00100000:1.0:1762167003.815904:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451682688 00000100:00100000:1.0:1762167003.815957:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2642 00000100:00100000:1.0:1762167003.815967:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451682688:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167003.816008:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888d5, ctime: 0x690888db, blocks: 0x203 00010000:00010000:1.0:1762167003.816014:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09183 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.816023:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.816025:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.816029:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09183 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.816038:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09183 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.817089:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09183 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.817099:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09183 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.817109:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09183 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.817115:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.817119:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09183 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.817126:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09183 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.817140:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09183 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.817148:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d09183 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.817218:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451682688:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1251us (1364us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.817226:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2642 00000100:00100000:0.0:1762167003.819095:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.819138:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451682816 00000100:00100000:1.0:1762167003.819146:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451682816 00000100:00100000:1.0:1762167003.819201:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2643 00000100:00100000:1.0:1762167003.819212:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451682816:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.819243:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0918a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.819255:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.819256:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.819260:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0918a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.819269:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0918a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.820310:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0918a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.820319:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0918a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.820324:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0918a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.820328:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.820331:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0918a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.820336:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0918a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.820347:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0918a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.820351:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0918a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.820403:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451682816:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1192us (1312us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.820425:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2643 00000100:00100000:0.0:1762167003.822314:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.822355:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451682944 00000100:00100000:1.0:1762167003.822364:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451682944 00000100:00100000:1.0:1762167003.822427:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2644 00000100:00100000:1.0:1762167003.822440:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451682944:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.822469:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09191 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.822478:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.822480:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.822483:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09191 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.822492:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09191 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.823610:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09191 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.823625:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09191 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.823633:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09191 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.823640:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.823645:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09191 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.823664:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09191 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.823676:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09191 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.823681:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09191 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.823728:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451682944:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1293us (1420us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.823734:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2644 00000100:00100000:0.0:1762167003.825630:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.825684:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451683072 00000100:00100000:1.0:1762167003.825693:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451683072 00000100:00100000:1.0:1762167003.825781:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2645 00000100:00100000:1.0:1762167003.825793:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451683072:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167003.825826:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09198 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.825841:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.825843:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.825848:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09198 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.825871:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09198 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.827125:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09198 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.827138:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09198 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.827151:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09198 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.827157:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ae00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.827162:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09198 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.827168:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09198 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.827184:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09198 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.827191:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d09198 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.827253:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451683072:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1461us (1627us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.827262:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2645 00000100:00100000:0.0:1762167003.829237:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.829285:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451683200 00000100:00100000:1.0:1762167003.829294:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451683200 00000100:00100000:1.0:1762167003.829347:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2646 00000100:00100000:1.0:1762167003.829356:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451683200:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167003.829397:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x816:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888db, ctime: 0x690888db, blocks: 0x103 00010000:00010000:1.0:1762167003.829417:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0919f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.829430:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.829432:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.829437:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0919f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.829449:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0919f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.830904:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0919f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.830919:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0919f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.830928:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0919f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.830936:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.830941:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0919f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.830949:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0919f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.830965:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0919f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.830977:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0919f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.831054:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451683200:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1697us (1824us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.831064:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2646 00000100:00100000:0.0:1762167003.833006:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.833058:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451683328 00000100:00100000:1.0:1762167003.833065:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451683328 00000100:00100000:1.0:1762167003.833116:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2647 00000100:00100000:1.0:1762167003.833125:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451683328:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167003.833168:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888db, ctime: 0x690888db, blocks: 0x103 00010000:00010000:1.0:1762167003.833175:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.833187:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.833189:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.833193:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.833205:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.834524:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.834537:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.834550:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.834557:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.834561:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.834570:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.834584:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.834591:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->131071] (req 0->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.834655:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451683328:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1530us (1652us total) trans 0 rc 130987/130987 00000100:00100000:1.0:1762167003.834663:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2647 00000100:00100000:0.0:1762167003.841858:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.843124:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.843172:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451683712 00000100:00100000:1.0:1762167003.843177:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451683712 00000100:00100000:1.0:1762167003.843221:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7239 00000100:00100000:1.0:1762167003.843234:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:56178:x1847765451683712:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167003.843449:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:56178:x1847765451683712:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 219us (325us total) trans 8589952572 rc 0/0 00000100:00100000:1.0:1762167003.843456:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7239 00000100:00100000:0.0:1762167003.846113:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.846247:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451683968 00000100:00100000:3.0:1762167003.846255:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451683968 00000100:00100000:3.0:1762167003.846310:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19507 00000100:00100000:3.0:1762167003.846325:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:56065:x1847765451683968:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167003.846345:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.846363:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d091ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2fd6 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.846483:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d091b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.846497:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09144 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fba expref: 923 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.846506:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d091b4 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.846535:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09144 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fba expref: 923 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.846548:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09144 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fba expref: 923 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.846561:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454374784:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.846638:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.847809:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454374784:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167003.847833:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d091b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.848079:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.848333:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d091b4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.848343:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d091b4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.848358:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00010000:00010000:3.0:1762167003.848553:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d091ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fd6 expref: 924 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.848570:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d091b4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fd6 expref: 923 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.848577:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167003.848580:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167003.848583:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000100:00100000:3.0:1762167003.848631:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:56065:x1847765451683968:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2310us (2521us total) trans 8589952573 rc 0/0 00000100:00100000:3.0:1762167003.848639:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19507 00000100:00100000:0.0:1762167003.849958:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.849990:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451684224 00000100:00100000:3.0:1762167003.849996:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451684224 00000100:00100000:3.0:1762167003.850025:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19508 00000100:00100000:3.0:1762167003.850030:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:56065:x1847765451684224:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167003.850045:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.850056:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d091c2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2fdd expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.850103:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d091c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.850112:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d091b4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fd6 expref: 924 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.850117:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d091c9 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.850142:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d091b4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fd6 expref: 924 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.850155:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d091b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fd6 expref: 924 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167003.850167:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454374912:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.850225:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.851187:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454374912:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167003.851205:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d091c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167003.851417:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.851636:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d091c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.851646:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d091c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167003.851679:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 130987 00000004:00200000:3.0:1762167003.851684:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167003.851700:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d091c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.851726:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d091c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fdd expref: 924 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.851744:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d091c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fdd expref: 923 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.851752:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167003.851756:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167003.851785:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167003.851859:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:56065:x1847765451684224:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1827us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.851868:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19508 00000100:00100000:0.0:1762167003.853819:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.853951:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451684608 00000100:00100000:1.0:1762167003.853964:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451684608 00000100:00100000:1.0:1762167003.854018:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7240 00000100:00100000:1.0:1762167003.854029:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:56065:x1847765451684608:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167003.854221:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+924:56065:x1847765451684608:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 194us (414us total) trans 8589952574 rc 0/0 00000100:00100000:1.0:1762167003.854229:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7240 00000100:00100000:0.0:1762167003.855328:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.855492:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451684864 00000100:00100000:3.0:1762167003.855498:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451684864 00000100:00100000:3.0:1762167003.855543:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19509 00000100:00100000:3.0:1762167003.855553:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+924:56065:x1847765451684864:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167003.855569:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.855573:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:3.0:1762167003.855594:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d091c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fdd expref: 924 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.855613:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09159 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc8 expref: 923 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.855626:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09121 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fb3 expref: 922 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.855638:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167003.855648:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167003.855662:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d091d0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2fe4 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.855702:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d091d7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.855713:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d091d7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.855727:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d091d7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000040:00080000:3.0:1762167003.856166:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5317, 88 off428336 00000004:00080000:3.0:1762167003.856173:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624648410333ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167003.856214:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5325, 88 off429456 00000004:00080000:3.0:1762167003.856220:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624648456747ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167003.856263:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5326, 88 off429544 00000004:00080000:3.0:1762167003.856267:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624648504433ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167003.856285:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5318, 88 off428424 00000004:00080000:3.0:1762167003.856290:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624648526932ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167003.856326:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5327, 88 off429632 00000004:00080000:3.0:1762167003.856332:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624648568573ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167003.856359:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5319, 88 off428512 00000004:00080000:3.0:1762167003.856364:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624648601008ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167003.856390:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5320, 88 off428600 00000004:00080000:3.0:1762167003.856395:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624648632330ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167003.856426:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5328, 88 off429720 00000004:00080000:3.0:1762167003.856429:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624648666588ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167003.856451:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5321, 88 off428688 00000004:00080000:3.0:1762167003.856455:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624648692280ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167003.856482:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5329, 88 off429808 00000004:00080000:3.0:1762167003.856486:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624648723610ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167003.856509:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5330, 88 off429896 00000004:00080000:3.0:1762167003.856513:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624648749858ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167003.856531:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5322, 88 off428776 00000004:00080000:3.0:1762167003.856535:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624648772863ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167003.856560:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5323, 88 off428864 00000004:00080000:3.0:1762167003.856563:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624648800686ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167003.856583:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5331, 88 off429984 00000004:00080000:3.0:1762167003.856585:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624648822813ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167003.856606:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5332, 88 off430072 00000004:00080000:3.0:1762167003.856610:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624648847283ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167003.856627:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5324, 88 off428952 00000004:00080000:3.0:1762167003.856631:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 624648868306ns, next at 625562909088ns, rc = 0 00010000:00010000:3.0:1762167003.869370:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d091d7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fe4 expref: 924 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.869392:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167003.869395:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000001:00080000:1.0:1762167003.869422:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952574 is committed 00010000:00010000:3.0:1762167003.869423:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d091d0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fe4 expref: 924 pid: 30818 timeout: 0 lvb_type: 3 00000004:00080000:1.0:1762167003.869444:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3427 committed 00010000:00010000:3.0:1762167003.869450:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d091d7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fe4 expref: 919 pid: 30818 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167003.869462:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3440 committed 00010000:00010000:3.0:1762167003.869484:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167003.869488:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762167003.869491:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922a00, rc 0) 00000020:00080000:1.0:1762167003.869494:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee3457d30c0 refcount 2 committed 0 result 0 batchid 4294969174 00000020:00080000:1.0:1762167003.869500:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2425f0300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee350485d80 00000020:00080000:1.0:1762167003.869504:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3457d3a80 00000020:00080000:1.0:1762167003.869507:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36f650400 00000020:00080000:1.0:1762167003.869510:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].42 00000020:00080000:1.0:1762167003.869559:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee3507b6f00 refcount 2 committed 0 result 0 batchid 4294969173 00000100:00100000:0.0:1762167003.869563:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454375040:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.869566:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56065:x1847765451684864:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 14013us (14238us total) trans 8589952575 rc 0/0 00000020:00080000:1.0:1762167003.869567:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36e62f6c0 00000020:00080000:1.0:1762167003.869577:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee246a9acc0 00000100:00100000:3.0:1762167003.869583:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19509 00000020:00080000:1.0:1762167003.869586:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435c0e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3729f0800 00000020:00080000:1.0:1762167003.869589:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].41 00000001:00080000:1.0:1762167003.869608:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952575 is committed 00000004:00080000:1.0:1762167003.869611:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3435 committed 00000004:00080000:1.0:1762167003.869623:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3448 committed 00000100:00100000:0.0:1762167003.869630:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167003.869656:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3447 committed 00000004:00080000:1.0:1762167003.869659:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3434 committed 00000004:00080000:1.0:1762167003.869662:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3433 committed 00000004:00080000:1.0:1762167003.869665:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3446 committed 00000100:00100000:0.0:1762167003.869666:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454375168:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1762167003.869670:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3445 committed 00000004:00080000:1.0:1762167003.869675:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3432 committed 00000004:00080000:1.0:1762167003.869677:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3444 committed 00000004:00080000:1.0:1762167003.869680:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3431 committed 00000004:00080000:1.0:1762167003.869682:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3430 committed 00000004:00080000:1.0:1762167003.869685:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3443 committed 00000004:00080000:1.0:1762167003.869688:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3429 committed 00000004:00080000:1.0:1762167003.869690:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3442 committed 00000004:00080000:1.0:1762167003.869693:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3441 committed 00000004:00080000:1.0:1762167003.869699:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3428 committed 00000100:00100000:0.0:1762167003.869699:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1762167003.869755:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969174 committed batchid 4294969172 00000100:00100000:0.0:1762167003.869902:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454375040 00000100:00100000:0.0:1762167003.869911:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454375040 00000100:00100000:0.0:1762167003.869964:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454375168 00000100:00100000:0.0:1762167003.869968:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454375168 00000100:00100000:0.0:1762167003.869999:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16401 00000100:00100000:0.0:1762167003.870012:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454375040:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1762167003.870014:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969172 00000100:00100000:1.0:1762167003.870033:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454375296:0@lo:2:osp-syn-0-0.0 00002000:00080000:0.0:1762167003.870046:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2061 count 1 00000100:00100000:1.0:1762167003.870059:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167003.870072:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.870078:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454375808:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762167003.870100:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d065d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb1fde expref: 27 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.870114:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167003.870115:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167003.870120:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167003.870125:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 4/0,1 mode: --/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.870144:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454376320:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762167003.870159:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d065d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb1fde expref: 27 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.870178:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167003.870207:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d065d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb1fde expref: 27 pid: 6535 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167003.870210:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454376960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.870217:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454375552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.870234:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454376448:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.870245:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167003.870279:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.870286:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1762167003.870297:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:1.0:1762167003.870301:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454375680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167003.870316:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454376064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.870319:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454375424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.870329:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.870350:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454376192:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.870374:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.870384:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454375296 00000100:00100000:0.0:1762167003.870389:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454375296 00000100:00100000:1.0:1762167003.870392:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454375808 00000100:00100000:1.0:1762167003.870399:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454375808 00000100:00100000:3.0:1762167003.870424:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454376704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.870435:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454376320 00000100:00100000:1.0:1762167003.870438:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454376960 00000100:00100000:0.0:1762167003.870440:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454376320 00000100:00100000:1.0:1762167003.870443:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454376960 00000100:00100000:3.0:1762167003.870456:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.870469:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454375552 00000100:00100000:1.0:1762167003.870472:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454375680 00000100:00100000:0.0:1762167003.870475:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454375552 00000100:00100000:1.0:1762167003.870478:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454375680 00010000:00010000:3.0:1762167003.870490:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167003.870498:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d091e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.870499:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454376064 00000100:00100000:1.0:1762167003.870505:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454376064 00010000:00010000:3.0:1762167003.870513:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc1709320) 00000100:00100000:0.0:1762167003.870515:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454376704 00010000:00010000:3.0:1762167003.870518:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d091e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.870520:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454376704 00010000:00010000:3.0:1762167003.870532:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d091e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.870532:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16403 00000100:00100000:1.0:1762167003.870547:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454375296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.870552:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16404 00000100:00100000:0.0:1762167003.870563:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454375808:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167003.870640:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d091e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.870649:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d091e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.870668:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167003.870671:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167003.870674:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1762167003.870732:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:0.0:1762167003.870736:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.870742:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.870746:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.870747:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:0.0:1762167003.870754:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167003.870755:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.870785:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.870791:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.870794:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 185 -> 185 00000100:00100000:0.0:1762167003.870817:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454375808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (705us total) trans 21474843082 rc 0/0 00000100:00100000:0.0:1762167003.870830:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16404 00000100:00100000:1.0:1762167003.870836:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454375296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 292us (774us total) trans 21474843083 rc 0/0 00000100:00100000:3.0:1762167003.870839:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16406 00000100:00100000:1.0:1762167003.870849:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16403 00000100:00100000:3.0:1762167003.870852:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454376960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.870859:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16407 00000100:00100000:0.0:1762167003.870870:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454375680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.870876:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16408 00000100:00100000:1.0:1762167003.870886:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454375552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167003.871030:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:0.0:1762167003.871036:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.871039:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.871044:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00002000:00010000:1.0:1762167003.871045:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.871046:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:0.0:1762167003.871052:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.871053:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167003.871054:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.871060:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.871060:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x812:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:3.0:1762167003.871062:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167003.871068:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167003.871069:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.871074:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:0.0:1762167003.871110:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454375680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (778us total) trans 21474843084 rc 0/0 00000100:00100000:0.0:1762167003.871118:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16407 00000100:00100000:3.0:1762167003.871128:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454376960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 277us (880us total) trans 17179875585 rc 0/0 00000100:00100000:1.0:1762167003.871130:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454375552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (850us total) trans 21474843085 rc 0/0 00000100:00100000:0.0:1762167003.871140:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16410 00000100:00100000:3.0:1762167003.871154:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16406 00000100:00100000:0.0:1762167003.871155:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454376704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.871164:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16408 00000004:00080000:1.0:1762167003.871227:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9c00/2, rc 0, transno 21474843085 00000100:00100000:1.0:1762167003.871245:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454375552:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167003.871257:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1762167003.871262:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a8700/2, rc 0, transno 21474843086 00002000:00010000:0.0:1762167003.871262:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.871269:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb atime from disk: 1762166999 -> 1762166999 00000100:00100000:1.0:1762167003.871273:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454376064:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167003.871274:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.871282:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167003.871291:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454377216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.871313:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454376704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (856us total) trans 17179875586 rc 0/0 00000100:00100000:0.0:1762167003.871320:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16410 00000100:00100000:1.0:1762167003.871327:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167003.871350:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454377216 00000100:00100000:0.0:1762167003.871355:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454377216 00000004:00080000:1.0:1762167003.871359:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247869880/2, rc 0, transno 17179875586 00000100:00100000:1.0:1762167003.871374:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454376704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.871387:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16411 00000100:00100000:0.0:1762167003.871396:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454377216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.871402:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.871441:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454376832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.871481:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167003.871491:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454376832 00000100:00100000:3.0:1762167003.871498:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454376832 00000004:00080000:1.0:1762167003.871518:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247869c00/2, rc 0, transno 17179875585 00002000:00010000:0.0:1762167003.871518:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167003.871525:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00000100:00100000:1.0:1762167003.871528:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454376960:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167003.871530:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:3.0:1762167003.871537:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16413 00002000:00010000:0.0:1762167003.871537:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00000004:00080000:1.0:1762167003.871544:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24786a680/2, rc 0, transno 17179875584 00002000:00010000:0.0:1762167003.871544:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167003.871551:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454376832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.871552:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24786a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454376320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167003.871569:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435aa300/2, rc 0, transno 21474843083 00000100:00100000:1.0:1762167003.871576:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454375296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.871592:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454377216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (265us total) trans 21474843087 rc 0/0 00000004:00080000:1.0:1762167003.871593:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a8e00/2, rc 0, transno 21474843082 00000100:00100000:1.0:1762167003.871603:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454375808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.871609:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16411 00000100:00100000:1.0:1762167003.871617:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762167003.871628:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454377344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.871667:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167003.871705:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435ab800/2, rc 0, transno 21474843084 00000100:00100000:1.0:1762167003.871712:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454375680:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167003.871728:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247868000/2, rc 0, transno 17179875587 00000100:00100000:1.0:1762167003.871736:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454376192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.871805:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000004:00080000:1.0:1762167003.871813:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9180/2, rc 0, transno 21474843087 00000100:00100000:1.0:1762167003.871820:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454377216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.871834:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167003.871839:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167003.871844:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.871846:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.871849:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.871852:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167003.871855:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451684992 00000100:00100000:1.0:1762167003.871860:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451684992 00000100:00100000:0.0:1762167003.871862:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454375936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167003.871887:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454375424 00000100:00100000:1.0:1762167003.871892:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454375424 00000100:00100000:3.0:1762167003.871905:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454376832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 355us (426us total) trans 17179875588 rc 0/0 00000100:00100000:0.0:1762167003.871906:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167003.871916:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16415 00000100:00100000:0.0:1762167003.871924:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247869500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454376576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.871934:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56065:x1847765451684992:12345-192.168.203.35@tcp:101:fsx.0 00000100:00100000:3.0:1762167003.871941:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16413 00010000:00010000:1.0:1762167003.871945:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762167003.871952:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762167003.871960:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb2feb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167003.871964:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454375936 00000100:00100000:0.0:1762167003.871972:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454377088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.871974:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454375936 00010000:00010000:1.0:1762167003.871986:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08d5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e78 expref: 29 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167003.871996:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167003.871998:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762167003.872003:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16416 00010000:00010000:1.0:1762167003.872004:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091ec lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [45056->106495] (req 45056->106495) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2feb expref: 29 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167003.872009:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167003.872017:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454375424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.872040:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454377088 00010000:00010000:1.0:1762167003.872043:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08d5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e78 expref: 29 pid: 12400 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167003.872046:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454377088 00010000:00010000:1.0:1762167003.872059:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d08d5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e78 expref: 29 pid: 12400 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1762167003.872075:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16418 00000100:00100000:1.0:1762167003.872078:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454377472:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167003.872087:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454376576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.872135:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242543180 going to sleep for 11 seconds 00002000:00010000:3.0:1762167003.872145:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167003.872150:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.872154:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.872157:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00000004:00080000:1.0:1762167003.872159:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24786ad80/2, rc 0, transno 17179875589 00002000:00010000:3.0:1762167003.872160:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167003.872168:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24786ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454377344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167003.872183:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247868e00/2, rc 0, transno 17179875588 00000100:00100000:1.0:1762167003.872192:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454376832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.872210:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454375424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (373us total) trans 21474843088 rc 0/0 00000100:00100000:3.0:1762167003.872218:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16416 00000100:00100000:1.0:1762167003.872226:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16419 00000100:00100000:1.0:1762167003.872237:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454377088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167003.872267:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454376576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (318us total) trans 17179875590 rc 0/0 00000100:00100000:0.0:1762167003.872275:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16418 00002000:00010000:1.0:1762167003.872335:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.872339:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x819:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.872342:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x819:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.872344:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x819:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.872347:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x819:0x0] updating lvb blocks from disk: 1 -> 3 00000004:00080000:0.0:1762167003.872364:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab1500/2, rc 0, transno 17179875583 00000100:00100000:0.0:1762167003.872370:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454375168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762167003.872379:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454377088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (372us total) trans 17179875591 rc 0/0 00000100:00100000:1.0:1762167003.872387:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16419 00000004:00080000:0.0:1762167003.872390:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9500/2, rc 0, transno 21474843088 00000100:00100000:0.0:1762167003.872396:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454375424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167003.872419:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435abb80/2, rc 0, transno 21474843089 00000100:00100000:0.0:1762167003.872424:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454375936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167003.872434:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247869500/2, rc 0, transno 17179875590 00000100:00100000:0.0:1762167003.872438:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247869500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454376576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167003.872445:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247869180/2, rc 0, transno 17179875591 00000100:00100000:0.0:1762167003.872448:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454377088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167003.872877:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454376448:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167003.872901:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.873003:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167003.873063:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454377472:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167003.873082:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091ec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [45056->106495] (req 45056->106495) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2feb expref: 30 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.873098:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b000, rc 0) 00000100:00100000:1.0:1762167003.873137:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56065:x1847765451684992:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1207us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167003.873159:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16415 00000100:00100000:3.0:1762167003.873225:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.873344:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.873359:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.873419:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.873440:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.873466:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762167003.873726:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167003.873744:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.873753:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167003.873757:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.873790:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.873803:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.873811:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d091de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x80d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167003.873829:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167003.873833:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167003.873835:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167003.873846:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454375040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3837us (4219us total) trans 21474843090 rc 0/0 00000100:00100000:3.0:1762167003.873867:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16401 00000004:00080000:0.0:1762167003.873943:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a8a80/2, rc 0, transno 21474843090 00000100:00100000:0.0:1762167003.873949:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454375040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167003.875031:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.876872:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.878419:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.883358:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.886525:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.888059:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09201 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.888070:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09201 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.888076:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09201 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.888082:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.888086:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09201 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.888094:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09201 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.888106:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:3.0:1762167003.888109:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.888113:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09201 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.888118:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09201 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167003.888690:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.890420:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.890461:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451686272 00000100:00100000:3.0:1762167003.890468:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451686272 00000100:00100000:3.0:1762167003.890516:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16420 00000100:00100000:3.0:1762167003.890525:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56065:x1847765451686272:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167003.890537:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.890552:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0920f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3000 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.890576:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d08d62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e7f expref: 25 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.890583:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.890585:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.890590:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0920f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3000 expref: 25 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.890622:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d08d62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e7f expref: 25 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.890636:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d08d62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e7f expref: 25 pid: 12402 timeout: 724 lvb_type: 1 00000100:00100000:3.0:1762167003.890649:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454377728:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.890716:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.891703:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454377728:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167003.891825:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0920f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3000 expref: 25 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.891842:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:0.0:1762167003.891878:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.891921:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56065:x1847765451686272:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1394us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.891933:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16420 00000100:00100000:0.0:1762167003.893314:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.893390:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451686528 00000100:00100000:3.0:1762167003.893395:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451686528 00000100:00100000:3.0:1762167003.893440:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16421 00000100:00100000:3.0:1762167003.893448:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451686528:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167003.893460:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167003.893474:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09216 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3007 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.893494:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08d69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e86 expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.893502:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.893504:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167003.893508:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09216 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3007 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.893570:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08d69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e86 expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167003.893582:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d08d69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2e86 expref: 28 pid: 12400 timeout: 724 lvb_type: 1 00000100:00100000:3.0:1762167003.893595:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454377984:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167003.893644:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167003.894703:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454377984:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167003.894733:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.894788:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09216 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3007 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167003.894812:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:3.0:1762167003.894852:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56065:x1847765451686528:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1403us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.894862:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16421 00000100:00100000:0.0:1762167003.896338:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.896365:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.896396:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.896444:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451686912 00000100:00100000:1.0:1762167003.896450:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451686912 00000100:00100000:3.0:1762167003.896469:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451687040 00002000:00010000:1.0:1762167003.896471:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:3.0:1762167003.896475:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451687040 00002000:00100000:1.0:1762167003.896477:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f794700 with x1847765451686912 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167003.896487:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f794700. 00002000:00010000:3.0:1762167003.896492:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167003.896496:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f794e00 with x1847765451687040 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167003.896500:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f794e00. 00000100:00100000:1.0:1762167003.896523:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2652 00000100:00100000:3.0:1762167003.896537:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2653 00000100:00100000:1.0:1762167003.896538:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451686912:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167003.896555:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451687040:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167003.896811:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167003.896816:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167003 -> 1762167004 00002000:00010000:3.0:1762167003.896818:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.896821:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167003 -> 1762167004 00002000:00010000:1.0:1762167003.896821:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.896828:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167003 -> 1762167004 00002000:00010000:3.0:1762167003.896829:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167003.896835:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.896839:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167003 -> 1762167004 00002000:00010000:1.0:1762167003.896846:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167003.896872:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451687040:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 322us (473us total) trans 21474843091 rc 0/0 00000100:00100000:1.0:1762167003.896881:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451686912:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 348us (513us total) trans 17179875592 rc 0/0 00000100:00100000:3.0:1762167003.896884:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2653 00002000:00010000:3.0:1762167003.896892:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167003.896899:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f794e00 with x1847765451687040 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167003.896901:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2652 00002000:00010000:3.0:1762167003.896907:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f794e00. 00002000:00010000:1.0:1762167003.896908:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167003.896914:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f794700 with x1847765451686912 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167003.896920:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f794700. 00000100:00100000:0.0:1762167003.897992:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.900397:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.900468:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451687296 00000100:00100000:3.0:1762167003.900476:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451687296 00002000:00100000:3.0:1762167003.900514:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (16384->45055) req@ffff9ee37f794a80 x1847765451687296/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:34/0 lens 488/0 e 0 to 0 dl 1762167014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167003.900524:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f794a80 with x1847765451687296 ext(16384->45055) 00002000:00010000:3.0:1762167003.900529:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f794a80 00000100:00100000:3.0:1762167003.900560:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2654 00000100:00100000:3.0:1762167003.900568:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451687296:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167003.901618:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451687296:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1048us (1225us total) trans 0 rc 28672/28672 00000100:00100000:1.0:1762167003.901633:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2654 00002000:00100000:1.0:1762167003.901642:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (16384->45055) req@ffff9ee37f794a80 x1847765451687296/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:34/0 lens 488/440 e 0 to 0 dl 1762167014 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167003.901651:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f794a80 with x1847765451687296 ext(16384->45055) 00002000:00010000:1.0:1762167003.901656:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f794a80 00000100:00100000:0.0:1762167003.904058:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.906217:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.906238:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.906269:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.906284:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451687680 00000100:00100000:1.0:1762167003.906293:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451687680 00002000:00010000:1.0:1762167003.906327:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (207313->18446744073709551615) 00002000:00100000:1.0:1762167003.906335:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f795880 with x1847765451687680 ext(207313->18446744073709551615) 00002000:00010000:1.0:1762167003.906346:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f795880. 00000100:00100000:3.0:1762167003.906394:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2655 00000100:00100000:3.0:1762167003.906416:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451687936:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167003.906416:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2656 00000100:00100000:1.0:1762167003.906435:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451687680:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167003.906452:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2657 00000100:00100000:0.0:1762167003.906464:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451687808:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167003.906647:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 124227 -> 207313 00002000:00010000:1.0:1762167003.906651:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167003.906652:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.906653:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.906659:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167003.906660:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167003.906662:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 185 -> 185 00002000:00010000:0.0:1762167003.906666:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167003.906670:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167003.906676:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167003.906705:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451687680:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 276us (488us total) trans 21474843093 rc 0/0 00000100:00100000:0.0:1762167003.906710:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451687808:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 246us (438us total) trans 17179875593 rc 0/0 00000100:00100000:1.0:1762167003.906715:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2656 00002000:00010000:1.0:1762167003.906723:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (207313->18446744073709551615) 00000100:00100000:0.0:1762167003.906727:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2657 00002000:00100000:1.0:1762167003.906731:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f795880 with x1847765451687680 ext(207313->18446744073709551615) 00002000:00010000:0.0:1762167003.906733:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:1.0:1762167003.906742:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f795880. 00002000:00100000:0.0:1762167003.906742:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f401c00 with x1847765451687808 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167003.906753:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36f401c00. 00000100:00100000:0.0:1762167003.908621:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.912597:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.916290:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.916373:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451688320 00000100:00100000:0.0:1762167003.916382:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451688320 00000100:00100000:0.0:1762167003.916447:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16422 00000100:00100000:0.0:1762167003.916458:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451688320:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:0.0:1762167003.930486:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843087 is committed 00000001:00080000:0.0:1762167003.930505:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843063 is committed 00000001:00080000:0.0:1762167003.930510:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843093 is committed 00000001:00080000:0.0:1762167003.930532:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843095 is committed 00000001:00080000:0.0:1762167003.930542:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843089 is committed 00000001:00080000:0.0:1762167003.930553:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843090 is committed 00000100:00100000:3.0:1762167003.930591:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451688320:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 14129us (14302us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.930604:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16422 00000100:00100000:0.0:1762167003.932699:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.937329:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.941231:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.941283:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451688704 00000100:00100000:3.0:1762167003.941291:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451688704 00000100:00100000:3.0:1762167003.941336:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16423 00000100:00100000:3.0:1762167003.941342:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451688704:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:0.0:1762167003.951736:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843096 is committed 00000100:00100000:3.0:1762167003.951973:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451688704:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 10617us (10737us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.951990:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16423 00000100:00100000:1.0:1762167003.954391:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167003.956178:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09240 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.956195:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09240 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.956202:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09240 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.956207:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167003.956210:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09240 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.956216:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09240 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.956226:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:3.0:1762167003.956229:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167003.956233:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09240 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167003.956247:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09240 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167003.956841:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.956868:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167003.956894:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.956922:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451689216 00000100:00100000:0.0:1762167003.956930:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451689216 00002000:00010000:0.0:1762167003.956950:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167003.956956:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2438baa00 with x1847765451689216 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167003.956964:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2438baa00. 00000100:00100000:3.0:1762167003.956973:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2661 00000100:00100000:3.0:1762167003.956987:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451689088:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167003.956994:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2662 00000100:00100000:1.0:1762167003.957006:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451689216:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167003.957209:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167003.957213:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167003.957216:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167003.957218:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167003.957220:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167003.957275:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451689216:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 271us (404us total) trans 17179875594 rc 0/0 00000100:00100000:1.0:1762167003.957283:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2662 00002000:00010000:1.0:1762167003.957286:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167003.957289:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2438baa00 with x1847765451689216 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167003.957294:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2438baa00. 00002000:00010000:3.0:1762167003.957390:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 207313 -> 100455 00002000:00010000:3.0:1762167003.957395:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167003.957398:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167003 -> 1762167004 00002000:00010000:3.0:1762167003.957400:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167003.957402:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 185 -> 243 00000100:00100000:3.0:1762167003.957455:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451689088:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 471us (615us total) trans 21474843098 rc 0/0 00000100:00100000:3.0:1762167003.957463:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2661 00002000:00010000:3.0:1762167003.957467:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (100455->18446744073709551615) 00002000:00100000:3.0:1762167003.957470:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2438bbb80 with x1847765451689088 ext(100455->18446744073709551615) 00002000:00010000:3.0:1762167003.957475:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2438bbb80. 00000100:00100000:1.0:1762167003.959060:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.961810:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.963928:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.963965:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.963987:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451689856 00000100:00100000:3.0:1762167003.963995:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451689856 00000100:00100000:0.0:1762167003.964002:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:3.0:1762167003.964027:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (131312->18446744073709551615) 00002000:00100000:3.0:1762167003.964032:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f401500 with x1847765451689856 ext(131312->18446744073709551615) 00002000:00010000:3.0:1762167003.964041:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f401500. 00000100:00100000:1.0:1762167003.964102:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2664 00000100:00100000:3.0:1762167003.964260:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2665 00000100:00100000:1.0:1762167003.964266:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451690112:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167003.964273:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451689856:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167003.964535:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 100455 -> 131312 00002000:00010000:1.0:1762167003.964538:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167003.964539:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167003.964546:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167003.964547:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167003.964552:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167003.964554:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167003.964556:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 243 -> 243 00002000:00010000:1.0:1762167003.964558:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167003.964562:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167003.964608:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451689856:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 335us (682us total) trans 21474843099 rc 0/0 00000100:00100000:1.0:1762167003.964609:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451690112:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 349us (643us total) trans 21474843100 rc 0/0 00000100:00100000:3.0:1762167003.964624:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2665 00000100:00100000:1.0:1762167003.964637:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2664 00002000:00010000:1.0:1762167003.964642:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167003.964647:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f403100 with x1847765451690112 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167003.964654:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f403100. 00002000:00010000:3.0:1762167003.964702:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (131312->18446744073709551615) 00002000:00100000:3.0:1762167003.964707:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f401500 with x1847765451689856 ext(131312->18446744073709551615) 00002000:00010000:3.0:1762167003.964712:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f401500. 00000100:00100000:0.0:1762167003.966851:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.966955:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451690240 00000100:00100000:3.0:1762167003.966963:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451690240 00002000:00100000:3.0:1762167003.966998:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->135167) req@ffff9ee36f403800 x1847765451690240/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:34/0 lens 488/0 e 0 to 0 dl 1762167014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167003.967008:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f403800 with x1847765451690240 ext(102400->135167) 00002000:00010000:3.0:1762167003.967014:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f403800 00000100:00100000:3.0:1762167003.967049:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2667 00000100:00100000:3.0:1762167003.967058:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451690240:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167003.968825:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451690240:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1759us (1974us total) trans 0 rc 32768/32768 00000100:00100000:3.0:1762167003.968837:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2667 00002000:00100000:3.0:1762167003.968849:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->135167) req@ffff9ee36f403800 x1847765451690240/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:34/0 lens 488/440 e 0 to 0 dl 1762167014 ref 1 fl Complete:/600/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167003.968860:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f403800 with x1847765451690240 ext(102400->135167) 00002000:00010000:3.0:1762167003.968866:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f403800 00000100:00100000:0.0:1762167003.972382:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.972467:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451690368 00000100:00100000:3.0:1762167003.972484:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451690368 00002000:00100000:3.0:1762167003.972549:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->131311) req@ffff9ee36f400380 x1847765451690368/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:34/0 lens 488/0 e 0 to 0 dl 1762167014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167003.972558:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f400380 with x1847765451690368 ext(102400->131311) 00002000:00010000:3.0:1762167003.972565:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f400380 00000100:00100000:3.0:1762167003.972599:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2668 00000100:00100000:3.0:1762167003.972610:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451690368:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:3.0:1762167003.974396:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451690368:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 1778us (2012us total) trans 21474843101 rc 0/0 00000100:00100000:3.0:1762167003.974418:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2668 00002000:00100000:3.0:1762167003.974429:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->131311) req@ffff9ee36f400380 x1847765451690368/t21474843101(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:34/0 lens 488/448 e 0 to 0 dl 1762167014 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167003.974437:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f400380 with x1847765451690368 ext(102400->131311) 00002000:00010000:3.0:1762167003.974442:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f400380 00000100:00100000:0.0:1762167003.975577:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.975628:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451690496 00000100:00100000:3.0:1762167003.975636:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451690496 00000100:00100000:3.0:1762167003.975681:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16424 00000100:00100000:3.0:1762167003.975690:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451690496:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167003.986339:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843100 is committed 00000001:00080000:1.0:1762167003.986359:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843101 is committed 00000100:00100000:3.0:1762167003.986421:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451690496:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 10715us (10829us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167003.986433:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16424 00000100:00100000:0.0:1762167003.987837:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167003.992949:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.993042:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451690752 00000100:00100000:3.0:1762167003.993051:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451690752 00002000:00100000:3.0:1762167003.993086:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->86015) req@ffff9ee36f400000 x1847765451690752/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:34/0 lens 488/0 e 0 to 0 dl 1762167014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167003.993099:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f400000 with x1847765451690752 ext(40960->86015) 00002000:00010000:3.0:1762167003.993103:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f400000 00000100:00100000:3.0:1762167003.993124:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2669 00000100:00100000:3.0:1762167003.993130:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451690752:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:3.0:1762167003.994573:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451690752:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 1437us (1628us total) trans 21474843102 rc 0/0 00000100:00100000:3.0:1762167003.994584:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2669 00002000:00100000:3.0:1762167003.994594:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->86015) req@ffff9ee36f400000 x1847765451690752/t21474843102(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:34/0 lens 488/448 e 0 to 0 dl 1762167014 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167003.994615:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f400000 with x1847765451690752 ext(40960->86015) 00002000:00010000:3.0:1762167003.994620:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f400000 00000100:00100000:0.0:1762167003.995897:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167003.995951:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451690880 00000100:00100000:3.0:1762167003.995961:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451690880 00000100:00100000:3.0:1762167003.996004:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16425 00000100:00100000:3.0:1762167003.996012:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451690880:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167004.005882:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843102 is committed 00000100:00100000:3.0:1762167004.005959:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451690880:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 9939us (10056us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.005974:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16425 00000100:00100000:0.0:1762167004.009336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167004.010791:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0926a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.010803:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0926a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.010810:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0926a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.010817:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.010822:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0926a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.010830:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0926a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.010842:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:3.0:1762167004.010845:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.010849:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0926a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.010855:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0926a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.011188:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.011215:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.011243:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.011263:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451691264 00000100:00100000:1.0:1762167004.011269:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451691264 00000100:00100000:3.0:1762167004.011281:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451691392 00000100:00100000:3.0:1762167004.011288:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451691392 00002000:00010000:1.0:1762167004.011294:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (239037->18446744073709551615) 00002000:00100000:1.0:1762167004.011301:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443cb480 with x1847765451691264 ext(239037->18446744073709551615) 00002000:00010000:3.0:1762167004.011309:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167004.011313:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c8e00 with x1847765451691392 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.011315:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443cb480. 00002000:00010000:3.0:1762167004.011325:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2443c8e00. 00000100:00100000:1.0:1762167004.011348:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2670 00000100:00100000:3.0:1762167004.011359:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2671 00000100:00100000:1.0:1762167004.011361:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451691264:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167004.011374:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451691392:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167004.011610:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167004.011614:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.011618:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.011620:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.011623:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167004.011673:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451691392:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 303us (455us total) trans 17179875596 rc 0/0 00002000:00010000:1.0:1762167004.011673:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 131312 -> 239037 00002000:00010000:1.0:1762167004.011680:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.011688:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00000100:00100000:3.0:1762167004.011692:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2671 00002000:00010000:1.0:1762167004.011694:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.011701:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:1.0:1762167004.011701:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 243 -> 259 00002000:00100000:3.0:1762167004.011709:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c8e00 with x1847765451691392 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167004.011718:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2443c8e00. 00000100:00100000:1.0:1762167004.011734:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451691264:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 377us (546us total) trans 21474843103 rc 0/0 00000100:00100000:1.0:1762167004.011744:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2670 00002000:00010000:1.0:1762167004.011748:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (239037->18446744073709551615) 00002000:00100000:1.0:1762167004.011753:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443cb480 with x1847765451691264 ext(239037->18446744073709551615) 00002000:00010000:1.0:1762167004.011758:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443cb480. 00000100:00100000:0.0:1762167004.013315:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.018036:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.020647:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.020703:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451691904 00000100:00100000:3.0:1762167004.020711:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451691904 00000100:00100000:3.0:1762167004.020756:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16426 00000100:00100000:3.0:1762167004.020792:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451691904:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167004.031912:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843103 is committed 00000001:00080000:1.0:1762167004.031937:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843105 is committed 00000100:00100000:3.0:1762167004.032026:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451691904:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 11254us (11374us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.032041:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16426 00000100:00100000:0.0:1762167004.033885:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.039000:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.041344:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.041380:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.041432:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.041515:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451692544 00000100:00100000:1.0:1762167004.041522:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451692544 00002000:00010000:1.0:1762167004.041546:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167004.041552:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c8000 with x1847765451692544 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.041561:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2443c8000. 00000100:00100000:3.0:1762167004.041569:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2675 00000100:00100000:3.0:1762167004.041583:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451692416:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167004.041751:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2676 00000100:00100000:1.0:1762167004.041790:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451692544:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167004.041931:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 239037 -> 258599 00002000:00010000:3.0:1762167004.041935:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.041938:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.041941:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.041942:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 259 -> 349 00000100:00100000:3.0:1762167004.041980:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451692416:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 401us (639us total) trans 21474843106 rc 0/0 00000100:00100000:3.0:1762167004.041987:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2675 00002000:00010000:3.0:1762167004.041990:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (258599->18446744073709551615) 00002000:00100000:3.0:1762167004.041992:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c9c00 with x1847765451692416 ext(258599->18446744073709551615) 00002000:00010000:3.0:1762167004.041996:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443c9c00. 00002000:00010000:1.0:1762167004.042007:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167004.042012:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.042016:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167004.042020:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.042027:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167004.042057:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451692544:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 298us (676us total) trans 17179875597 rc 0/0 00000100:00100000:1.0:1762167004.042068:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2676 00002000:00010000:1.0:1762167004.042071:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167004.042075:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c8000 with x1847765451692544 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.042080:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2443c8000. 00000100:00100000:0.0:1762167004.043324:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.046891:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.050312:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.050418:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451693056 00000100:00100000:3.0:1762167004.050427:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451693056 00000100:00100000:3.0:1762167004.050485:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16427 00000100:00100000:3.0:1762167004.050495:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451693056:12345-192.168.203.35@tcp:16:fsx.0 00000100:00100000:3.0:1762167004.061319:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451693056:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 10820us (11008us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.061331:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16427 00000100:00100000:0.0:1762167004.065116:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.071598:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167004.073354:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09294 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.073367:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09294 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.073374:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09294 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.073380:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.073385:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09294 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.073392:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09294 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.073418:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:3.0:1762167004.073422:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.073426:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09294 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.073432:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09294 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.074119:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.074155:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.074191:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.074342:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2680 00000100:00100000:1.0:1762167004.074353:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2681 00000100:00100000:3.0:1762167004.074359:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451693568:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167004.074372:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451693696:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167004.074640:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167004.074643:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.074645:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167004.074647:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.074648:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167004.074705:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 258599 -> 262144 00002000:00010000:3.0:1762167004.074710:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.074712:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.074715:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.074717:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 349 -> 349 00000100:00100000:3.0:1762167004.074842:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451693568:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 489us (725us total) trans 21474843109 rc 0/0 00000100:00100000:1.0:1762167004.074846:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451693696:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 477us (687us total) trans 17179875598 rc 0/0 00000100:00100000:3.0:1762167004.074854:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2680 00002000:00010000:3.0:1762167004.074858:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (262144->18446744073709551615) 00000100:00100000:1.0:1762167004.074863:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2681 00002000:00100000:3.0:1762167004.074864:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317f100 with x1847765451693568 ext(262144->18446744073709551615) 00002000:00010000:1.0:1762167004.074870:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:3.0:1762167004.074872:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34317f100. 00002000:00100000:1.0:1762167004.074877:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317df80 with x1847765451693696 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.074885:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee34317df80. 00000100:00100000:0.0:1762167004.077631:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.081534:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.081582:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451694080 00000100:00100000:3.0:1762167004.081592:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451694080 00000100:00100000:3.0:1762167004.081640:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16428 00000100:00100000:3.0:1762167004.081649:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451694080:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167004.093969:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843111 is committed 00000100:00100000:3.0:1762167004.094113:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451694080:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 12460us (12581us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.094123:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16428 00000100:00100000:0.0:1762167004.095737:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.102191:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.104466:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.104497:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.104534:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.104557:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451694720 00000100:00100000:1.0:1762167004.104564:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451694720 00002000:00010000:1.0:1762167004.104585:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167004.104594:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317ea00 with x1847765451694720 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.104602:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee34317ea00. 00000100:00100000:1.0:1762167004.104627:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2684 00000100:00100000:0.0:1762167004.104654:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2685 00000100:00100000:1.0:1762167004.104655:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451694592:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167004.104672:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451694720:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:0.0:1762167004.105025:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167004.105030:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.105033:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167004.105036:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.105038:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167004.105097:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451694720:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 431us (598us total) trans 17179875599 rc 0/0 00000100:00100000:0.0:1762167004.105110:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2685 00002000:00010000:0.0:1762167004.105117:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:1.0:1762167004.105121:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 262144 -> 253559 00002000:00100000:0.0:1762167004.105124:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317ea00 with x1847765451694720 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.105126:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.105132:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.105136:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee34317ea00. 00002000:00010000:1.0:1762167004.105137:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.105142:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 349 -> 373 00000100:00100000:1.0:1762167004.105183:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451694592:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 544us (716us total) trans 21474843113 rc 0/0 00000100:00100000:1.0:1762167004.105202:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2684 00002000:00010000:1.0:1762167004.105207:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (253559->18446744073709551615) 00002000:00100000:1.0:1762167004.105211:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317e680 with x1847765451694592 ext(253559->18446744073709551615) 00002000:00010000:1.0:1762167004.105218:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34317e680. 00000100:00100000:0.0:1762167004.106844:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.112528:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.112629:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451695104 00000100:00100000:1.0:1762167004.112645:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451695104 00002000:00100000:1.0:1762167004.112702:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (192512->229375) req@ffff9ee37fc2b100 x1847765451695104/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.112712:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc2b100 with x1847765451695104 ext(192512->229375) 00002000:00010000:1.0:1762167004.112717:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc2b100 00000100:00100000:1.0:1762167004.112753:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2687 00000100:00100000:1.0:1762167004.112795:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451695104:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:1.0:1762167004.114805:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451695104:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 2035us (2284us total) trans 21474843114 rc 0/0 00000100:00100000:1.0:1762167004.114819:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2687 00002000:00100000:1.0:1762167004.114834:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (192512->229375) req@ffff9ee37fc2b100 x1847765451695104/t21474843114(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/448 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.114845:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc2b100 with x1847765451695104 ext(192512->229375) 00002000:00010000:1.0:1762167004.114860:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc2b100 00000100:00100000:0.0:1762167004.116433:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.116496:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451695232 00000100:00100000:3.0:1762167004.116506:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451695232 00000100:00100000:3.0:1762167004.116555:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16429 00000100:00100000:3.0:1762167004.116564:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451695232:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:0.0:1762167004.126440:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843114 is committed 00000100:00100000:3.0:1762167004.126562:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451695232:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 9993us (10126us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.126573:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16429 00000100:00100000:3.0:1762167004.129689:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167004.131362:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d092be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.131373:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d092be lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.131379:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d092be lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.131384:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.131388:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d092be lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.131394:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d092be lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.131415:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:3.0:1762167004.131418:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.131421:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d092be lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.131428:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d092be lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167004.132030:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.132063:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.132114:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451695744 00000100:00100000:1.0:1762167004.132122:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451695744 00000100:00100000:3.0:1762167004.132134:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:1.0:1762167004.132150:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167004.132157:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc29500 with x1847765451695744 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.132168:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fc29500. 00000100:00100000:0.0:1762167004.132181:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451695872 00000100:00100000:0.0:1762167004.132186:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451695872 00002000:00010000:0.0:1762167004.132201:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:1.0:1762167004.132202:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2689 00002000:00100000:0.0:1762167004.132208:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc2a680 with x1847765451695872 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167004.132215:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc2a680. 00000100:00100000:1.0:1762167004.132220:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451695744:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167004.132233:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2690 00000100:00100000:0.0:1762167004.132240:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451695872:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167004.132479:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167004.132483:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.132486:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167004.132489:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.132492:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167004.132529:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167004.132536:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.132542:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167004.132548:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.132554:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167004.132556:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451695744:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 339us (524us total) trans 17179875600 rc 0/0 00000100:00100000:1.0:1762167004.132570:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2689 00002000:00010000:1.0:1762167004.132575:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167004.132578:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc29500 with x1847765451695744 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.132585:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fc29500. 00000100:00100000:0.0:1762167004.132586:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451695872:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 343us (450us total) trans 21474843115 rc 0/0 00000100:00100000:0.0:1762167004.132601:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2690 00002000:00010000:0.0:1762167004.132607:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:0.0:1762167004.132614:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc2a680 with x1847765451695872 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167004.132623:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc2a680. 00000100:00100000:0.0:1762167004.135945:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.138141:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.141155:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.141198:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451696256 00000100:00100000:3.0:1762167004.141207:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451696256 00000100:00100000:3.0:1762167004.141248:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16430 00000100:00100000:3.0:1762167004.141254:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451696256:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167004.154306:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843115 is committed 00000001:00080000:1.0:1762167004.154323:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843117 is committed 00000100:00100000:3.0:1762167004.154385:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451696256:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 13123us (13226us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.154396:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16430 00000100:00100000:3.0:1762167004.155753:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.163553:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.163692:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451696640 00000100:00100000:1.0:1762167004.163710:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451696640 00000100:00100000:1.0:1762167004.163833:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7241 00000100:00100000:1.0:1762167004.163846:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56065:x1847765451696640:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167004.164272:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:56065:x1847765451696640:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 430us (726us total) trans 8589952594 rc 0/0 00000100:00100000:1.0:1762167004.164281:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7241 00000100:00100000:0.0:1762167004.173120:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.175081:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.175555:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.175611:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451697280 00000100:00100000:1.0:1762167004.175616:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451697280 00000100:00100000:1.0:1762167004.175641:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7242 00000100:00100000:1.0:1762167004.175646:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56179:x1847765451697280:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167004.175822:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56179:x1847765451697280:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 175us (268us total) trans 8589952596 rc 0/0 00000100:00100000:1.0:1762167004.175826:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7242 00000100:00100000:0.0:1762167004.177004:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.179336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.180917:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.181070:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7312 00000100:00100000:1.0:1762167004.181087:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:2360:x1847765451697920:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.181099:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.181105:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d092cc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3046 expref: 916 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.181117:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d092cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3046 expref: 916 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.181138:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d092cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3046 expref: 916 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.181151:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:1.0:1762167004.181155:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09312 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.181162:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09312 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.181168:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09312 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.181188:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.181233:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:2360:x1847765451697920:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 153us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.181243:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7312 00000100:00100000:0.0:1762167004.182726:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.182802:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451698048 00000100:00100000:3.0:1762167004.182809:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451698048 00000100:00100000:3.0:1762167004.182855:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7243 00000100:00100000:3.0:1762167004.182865:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348211850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56179:x1847765451698048:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:3.0:1762167004.182990:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348211850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56179:x1847765451698048:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 126us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.182998:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7243 00000100:00100000:0.0:1762167004.184046:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.184091:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451698304 00000100:00100000:3.0:1762167004.184096:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451698304 00000100:00100000:3.0:1762167004.184130:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7244 00000100:00100000:3.0:1762167004.184139:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56179:x1847765451698304:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167004.184307:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56179:x1847765451698304:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 168us (262us total) trans 8589952599 rc 0/0 00000100:00100000:3.0:1762167004.184313:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7244 00000100:00100000:0.0:1762167004.185309:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.187043:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.187089:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451698816 00000100:00100000:3.0:1762167004.187093:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451698816 00000100:00100000:3.0:1762167004.187120:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7245 00000100:00100000:3.0:1762167004.187126:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56179:x1847765451698816:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762167004.187164:0:33886:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09327 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3062 expref: 916 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.187193:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.187201:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09208 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ff9 expref: 916 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.187206:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.187228:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09208 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ff9 expref: 916 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.187237:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09208 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ff9 expref: 916 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167004.187245:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454378368:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.187295:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.188144:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454378368:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167004.188161:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167004.188420:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.188466:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451698944 00000100:00100000:1.0:1762167004.188472:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451698944 00010000:00010000:1.0:1762167004.188498:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09208 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ff9 expref: 917 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167004.188534:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7313 00000100:00100000:1.0:1762167004.188541:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:2361:x1847765451698944:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.188553:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.188559:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09208 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ff9 expref: 917 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.188575:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09208 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ff9 expref: 917 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.188590:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09208 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ff9 expref: 917 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.188600:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:1.0:1762167004.188604:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.188609:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.188614:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.188649:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.188680:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167004.188684:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:2361:x1847765451698944:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 142us (263us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167004.188695:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167004.188700:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7313 00010000:00010000:3.0:1762167004.189213:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.189222:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.189228:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.189234:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.189238:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.189245:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.189255:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:3.0:1762167004.189258:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762167004.189261:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.189267:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09335 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.189281:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:3.0:1762167004.189284:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167004.189288:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09327 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3062 expref: 915 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.189416:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56179:x1847765451698816:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2276us (2363us total) trans 8589952601 rc -22/-22 00000100:00100000:3.0:1762167004.189426:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7245 00000100:00100000:0.0:1762167004.190607:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.193015:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.196400:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.198463:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.198504:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451699840 00000100:00100000:3.0:1762167004.198513:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451699840 00000100:00100000:3.0:1762167004.198559:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7246 00000100:00100000:3.0:1762167004.198569:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56179:x1847765451699840:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762167004.198629:0:33886:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0935f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3077 expref: 920 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.198659:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.198670:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0933c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3069 expref: 920 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.198678:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.198706:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0933c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3069 expref: 920 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.198717:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0933c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3069 expref: 920 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167004.198730:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454378496:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.198836:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.199992:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454378496:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167004.200014:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167004.200155:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.200225:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451699968 00000100:00100000:1.0:1762167004.200232:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451699968 00010000:00010000:1.0:1762167004.200259:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0933c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3069 expref: 921 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167004.200295:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7314 00000100:00100000:1.0:1762167004.200304:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:2361:x1847765451699968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.200318:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.200325:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0933c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3069 expref: 921 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.200335:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0933c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3069 expref: 921 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.200352:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0933c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3069 expref: 921 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.200364:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:1.0:1762167004.200369:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.200376:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.200382:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.200420:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.200465:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:2361:x1847765451699968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 162us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.200473:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7314 00010000:00010000:3.0:1762167004.200524:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.200531:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.200547:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x643:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.200557:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0934a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3070 expref: 919 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.200564:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.200587:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0934a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3070 expref: 919 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.200597:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0934a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3070 expref: 919 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:3.0:1762167004.200609:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454378624:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.200652:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1762167004.202166:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.202187:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454378624:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167004.202211:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167004.202243:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451700096 00000100:00100000:1.0:1762167004.202251:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451700096 00010000:00010000:1.0:1762167004.202279:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0934a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3070 expref: 920 pid: 30818 timeout: 724 lvb_type: 0 00000100:00100000:1.0:1762167004.202356:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7315 00000100:00100000:1.0:1762167004.202366:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:2361:x1847765451700096:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.202382:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.202389:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0934a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3070 expref: 920 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.202400:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0934a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3070 expref: 920 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.202432:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0934a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3070 expref: 920 pid: 30818 timeout: 724 lvb_type: 0 00010000:00010000:1.0:1762167004.202445:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x643:0x0].0x0 (ffff9ee2429d0400) 00010000:00010000:1.0:1762167004.202448:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.202454:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.202458:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.202477:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.202511:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:2361:x1847765451700096:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 146us (352us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167004.202512:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167004.202526:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7315 00010000:00010000:3.0:1762167004.202527:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167004.203179:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454378752:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.203223:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.203256:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7840 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.203279:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454378752 00000100:00100000:1.0:1762167004.203286:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454378752 00000100:00080000:0.0:1762167004.203337:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762167004.203344:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1762167004.203354:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454378752:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.203456:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454378752:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 104us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.203464:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1762167004.203712:0:33886:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843090 gen 2 00000004:00080000:3.0:1762167004.203718:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa98a80, transno 21474843070 00000004:00080000:3.0:1762167004.203736:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa98380, transno 21474843071 00000004:00080000:3.0:1762167004.203739:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb6300, transno 21474843072 00000004:00080000:3.0:1762167004.203741:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa9b100, transno 21474843073 00000004:00080000:3.0:1762167004.203744:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb4700, transno 21474843074 00000004:00080000:3.0:1762167004.203747:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa98e00, transno 21474843075 00000004:00080000:3.0:1762167004.203749:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb6680, transno 21474843076 00000004:00080000:3.0:1762167004.203751:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa99880, transno 21474843077 00000004:00080000:3.0:1762167004.203755:0:33886:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843080 committed transno 21474843090 00000004:00080000:3.0:1762167004.203791:0:33886:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843081 committed transno 21474843090 00000004:00080000:3.0:1762167004.203800:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a8e00, transno 21474843082 00000004:00080000:3.0:1762167004.203803:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435aa300, transno 21474843083 00000004:00080000:3.0:1762167004.203806:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435ab800, transno 21474843084 00000004:00080000:3.0:1762167004.203809:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9c00, transno 21474843085 00000004:00080000:3.0:1762167004.203812:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a8700, transno 21474843086 00000004:00080000:3.0:1762167004.203814:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9180, transno 21474843087 00000004:00080000:3.0:1762167004.203816:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9500, transno 21474843088 00000004:00080000:3.0:1762167004.203818:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435abb80, transno 21474843089 00000004:00080000:3.0:1762167004.203820:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a8a80, transno 21474843090 00000100:00100000:3.0:1762167004.203827:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454378752:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.203873:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454378880:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.203902:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.203924:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.203936:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454378880 00000100:00100000:1.0:1762167004.203943:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454378880 00000100:00100000:1.0:1762167004.203995:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1762167004.204005:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454378880:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00080000:0.0:1762167004.204037:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762167004.204072:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454378880:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.204080:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1762167004.204100:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454378880:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.204156:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454379008:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.204181:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.204201:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee342bf70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.204238:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454379008 00000100:00100000:1.0:1762167004.204244:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454379008 00000100:00100000:1.0:1762167004.204278:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1762167004.204285:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454379008:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.204366:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454379008:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.204373:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1762167004.204425:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454379008:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167004.204463:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454379136:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167004.204492:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.204520:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.204570:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454379136 00000100:00100000:1.0:1762167004.204575:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454379136 00000100:00100000:1.0:1762167004.204610:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1762167004.204618:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454379136:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.204676:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454379136:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 59us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.204684:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1762167004.204889:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454379264 00000100:00100000:3.0:1762167004.204894:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454379264 00000100:00100000:3.0:1762167004.204925:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1762167004.204932:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454379264:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.204992:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454379264:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 60us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.205000:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1762167004.205131:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454379392 00000100:00100000:3.0:1762167004.205136:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454379392 00000100:00100000:3.0:1762167004.205163:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1762167004.205169:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454379392:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.205218:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454379392:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 49us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.205228:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1762167004.205461:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454379520 00000100:00100000:3.0:1762167004.205466:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454379520 00000100:00100000:3.0:1762167004.205497:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1762167004.205506:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454379520:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.205556:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454379520:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 52us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.205563:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1762167004.205656:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454379648 00000100:00100000:3.0:1762167004.205660:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454379648 00000100:00100000:3.0:1762167004.205679:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1762167004.205684:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454379648:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.205735:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454379648:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 50us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.205743:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1762167004.205930:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454379776 00000100:00100000:3.0:1762167004.205934:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454379776 00000100:00100000:3.0:1762167004.205953:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1762167004.205957:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454379776:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.206007:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454379776:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 46us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.206014:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1762167004.206100:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454379904 00000100:00100000:3.0:1762167004.206104:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454379904 00000100:00100000:3.0:1762167004.206131:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1762167004.206138:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454379904:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.206187:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454379904:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.206194:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1762167004.206281:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454380032 00000100:00100000:3.0:1762167004.206287:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454380032 00000100:00100000:3.0:1762167004.206313:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1762167004.206321:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454380032:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.206390:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454380032:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.206396:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1762167004.206857:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454380160 00000100:00100000:3.0:1762167004.206862:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454380160 00000100:00100000:3.0:1762167004.206889:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:3.0:1762167004.206897:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454380160:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.206964:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454380160:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 67us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.206976:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:3.0:1762167004.207088:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454380288 00000100:00100000:3.0:1762167004.207094:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454380288 00000100:00100000:3.0:1762167004.207125:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1762167004.207133:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454380288:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.207191:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:33886:x1847765454380288:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 58us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.207199:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1762167004.207362:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454380416 00000100:00100000:3.0:1762167004.207367:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454380416 00000100:00100000:3.0:1762167004.207413:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1762167004.207421:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454380416:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.207484:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454380416:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 65us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.207491:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1762167004.207571:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454380416:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:0.0:1762167004.207946:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].43, 728 off57712 00000001:00080000:0.0:1762167004.207958:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952604 00000100:00100000:0.0:1762167004.208015:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454380544:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167004.208040:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.208060:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167004.209323:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454380544:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167004.209357:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454380672:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762167004.209394:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.209427:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167004.209749:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454380672:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762167004.209873:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952605 00010000:00010000:0.0:1762167004.209904:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.209914:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.209922:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.209928:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167004.209932:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.209940:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.209956:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x643:0x0].0x0 (ffff9ee2429d0400) 00010000:00010000:0.0:1762167004.209959:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762167004.209963:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.209969:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09374 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x643:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.209989:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.209999:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.210004:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.210009:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167004.210012:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.210017:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.210023:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:0.0:1762167004.210025:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762167004.210028:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.210033:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0936d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.210042:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:0.0:1762167004.210045:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167004.210051:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0935f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3077 expref: 921 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.210135:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56179:x1847765451699840:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 11568us (11678us total) trans 8589952606 rc 0/0 00000100:00100000:0.0:1762167004.210144:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7246 00000020:00080000:0.0:1762167004.210149:0:33886:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762167004.211444:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.213562:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451700352 00000100:00100000:1.0:1762167004.213570:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451700352 00002000:00100000:1.0:1762167004.213609:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (57344->200703) req@ffff9ee2435a8e00 x1847765451700352/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 504/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.213628:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a8e00 with x1847765451700352 ext(57344->200703) 00002000:00010000:1.0:1762167004.213634:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a8e00 00000100:00100000:1.0:1762167004.213661:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2693 00000100:00100000:1.0:1762167004.213672:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451700352:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:1.0:1762167004.216061:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451700352:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 2383us (2558us total) trans 21474843119 rc 0/0 00000100:00100000:1.0:1762167004.216075:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2693 00002000:00100000:1.0:1762167004.216086:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (57344->200703) req@ffff9ee2435a8e00 x1847765451700352/t21474843119(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 504/448 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.216097:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a8e00 with x1847765451700352 ext(57344->200703) 00002000:00010000:1.0:1762167004.216104:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a8e00 00000100:00100000:0.0:1762167004.218039:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167004.218946:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167004.218953:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09382 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x643:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.218960:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167004.218964:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09382 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x643:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.218969:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09382 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x643:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.218979:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x643:0x0].0x0 (ffff9ee2429d0900) 00010000:00010000:0.0:1762167004.218981:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762167004.218984:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09382 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x643:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.218988:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09382 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x643:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.219003:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167004.219005:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167004.219006:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167004.220324:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451700864 00000100:00100000:0.0:1762167004.220332:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451700864 00000100:00100000:0.0:1762167004.220371:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7248 00000100:00100000:0.0:1762167004.220380:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348211c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:56179:x1847765451700864:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167004.220604:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348211c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+924:56179:x1847765451700864:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 224us (327us total) trans 8589952609 rc 0/0 00000100:00100000:0.0:1762167004.220610:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7248 00000100:00100000:3.0:1762167004.230605:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.233310:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.235212:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.237508:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.237564:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451701632 00000100:00100000:1.0:1762167004.237573:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451701632 00000100:00100000:1.0:1762167004.237618:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 621 00000100:00100000:1.0:1762167004.237625:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+929:56180:x1847765451701632:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167004.237636:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.237654:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d093c1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3093 expref: 929 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.237668:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167004.237672:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.237721:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:56180:x1847765451701632:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 96us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.237729:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 621 00000100:00100000:3.0:1762167004.238669:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.238729:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451701888 00000100:00100000:0.0:1762167004.238736:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451701888 00000100:00100000:0.0:1762167004.238799:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7249 00000100:00100000:0.0:1762167004.238806:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:56180:x1847765451701888:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167004.239021:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+929:56180:x1847765451701888:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 214us (354us total) trans 8589952612 rc 0/0 00000100:00100000:0.0:1762167004.239029:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7249 00000100:00100000:0.0:1762167004.241928:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.243704:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.243745:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451702272 00000100:00100000:1.0:1762167004.243751:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451702272 00010000:00010000:1.0:1762167004.243809:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0939e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3085 expref: 931 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.243836:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7316 00000100:00100000:1.0:1762167004.243843:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:2360:x1847765451702272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.243851:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.243855:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0939e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3085 expref: 931 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.243864:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0939e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3085 expref: 931 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.243883:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0939e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3085 expref: 931 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.243897:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167004.243901:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d093d6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.243909:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d093d6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.243916:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d093d6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.243939:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.243976:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+930:2360:x1847765451702272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 133us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.243987:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7316 00000100:00100000:0.0:1762167004.246103:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.247995:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.248037:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451702528 00000100:00100000:1.0:1762167004.248044:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451702528 00010000:00010000:1.0:1762167004.248074:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d093d6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb309a expref: 932 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.248113:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7317 00000100:00100000:1.0:1762167004.248121:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e445f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+932:2361:x1847765451702528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.248134:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.248139:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d093d6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb309a expref: 932 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.248151:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d093d6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb309a expref: 932 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.248181:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d093d6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb309a expref: 932 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.248196:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167004.248201:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d093eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.248209:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d093eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.248216:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d093eb lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.248236:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.248280:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e445f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:2361:x1847765451702528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 159us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.248288:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7317 00000100:00100000:0.0:1762167004.250366:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.259751:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.262022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.262056:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.262082:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451703168 00000100:00100000:1.0:1762167004.262090:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451703168 00000100:00100000:1.0:1762167004.262156:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 622 00000100:00100000:1.0:1762167004.262172:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+934:2358:x1847765451703168:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.262187:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.262208:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09407 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30a8 expref: 934 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.262223:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167004.262227:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.262281:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+934:2358:x1847765451703168:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 116us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.262289:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 622 00000100:00100000:0.0:1762167004.264956:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.266517:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.266564:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451703808 00000100:00100000:1.0:1762167004.266578:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451703808 00010000:00010000:1.0:1762167004.266628:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d093eb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30a1 expref: 935 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.266666:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7318 00000100:00100000:1.0:1762167004.266674:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+935:2361:x1847765451703808:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.266690:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.266697:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d093eb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30a1 expref: 935 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.266714:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d093eb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30a1 expref: 935 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.266734:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d093eb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30a1 expref: 935 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.266750:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167004.266754:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0941c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.266790:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0941c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.266798:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0941c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.266829:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.266882:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+934:2361:x1847765451703808:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 209us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.266890:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7318 00000100:00100000:0.0:1762167004.268383:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.269651:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.270981:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.272617:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.276216:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.276333:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451704832 00000100:00100000:1.0:1762167004.276348:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451704832 00010000:00010000:1.0:1762167004.276429:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0937b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb307e expref: 936 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.276480:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7319 00000100:00100000:1.0:1762167004.276494:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+936:2360:x1847765451704832:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.276514:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.276523:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0937b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb307e expref: 936 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.276537:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0937b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb307e expref: 936 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.276562:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0937b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb307e expref: 936 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.276580:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167004.276585:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0943f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.276595:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0943f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.276602:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0943f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.276633:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.276703:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+935:2360:x1847765451704832:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 211us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.276716:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7319 00000100:00100000:0.0:1762167004.278558:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.280685:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.283308:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451705472 00000100:00100000:3.0:1762167004.283316:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451705472 00000100:00100000:3.0:1762167004.283369:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19548 00000100:00100000:3.0:1762167004.283379:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+937:56181:x1847765451705472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.283414:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.283431:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09462 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb30cb expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.283511:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09469 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.283522:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09469 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.283541:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09469 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.283553:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:3.0:1762167004.283673:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09462 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30cb expref: 940 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.283688:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09469 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30cb expref: 939 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.283696:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0c00) 00010000:00010000:3.0:1762167004.283698:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167004.283701:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167004.283790:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+939:56181:x1847765451705472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 383us (566us total) trans 8589952622 rc 0/0 00000100:00100000:3.0:1762167004.283799:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19548 00000100:00100000:0.0:1762167004.285074:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.286657:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.286716:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451705856 00000100:00100000:1.0:1762167004.286723:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451705856 00010000:00010000:1.0:1762167004.286750:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09446 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30bd expref: 940 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.286819:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7320 00000100:00100000:1.0:1762167004.286830:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e446300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+940:2360:x1847765451705856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.286845:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.286852:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09446 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30bd expref: 940 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.286863:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09446 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30bd expref: 940 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.286877:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09446 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30bd expref: 940 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.286886:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0c00) 00010000:00010000:1.0:1762167004.286889:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09477 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.286895:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09477 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.286899:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09477 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.286917:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.286960:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e446300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+939:2360:x1847765451705856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 132us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.286971:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7320 00000100:00100000:0.0:1762167004.288185:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.288227:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451705984 00000100:00100000:1.0:1762167004.288233:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451705984 00010000:00010000:1.0:1762167004.288256:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09454 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x644:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30c4 expref: 939 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.288286:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7321 00000100:00100000:1.0:1762167004.288296:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+939:2360:x1847765451705984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.288307:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.288312:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09454 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x644:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30c4 expref: 939 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.288323:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09454 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x644:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30c4 expref: 939 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.288335:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09454 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x644:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30c4 expref: 939 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.288356:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x644:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167004.288361:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0947e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x644:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.288369:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0947e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x644:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.288375:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0947e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x644:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.288409:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.288443:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+938:2360:x1847765451705984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 150us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.288450:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7321 00000100:00100000:1.0:1762167004.289051:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454381568 00000100:00100000:1.0:1762167004.289056:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454381568 00000100:00100000:1.0:1762167004.289085:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1762167004.289090:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454381568:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.289155:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454381568:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 64us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.289163:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1762167004.289294:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454381696 00000100:00100000:3.0:1762167004.289308:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454381696 00000100:00100000:3.0:1762167004.289371:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1762167004.289382:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454381696:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.289521:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454381696:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 140us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.289531:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1762167004.289757:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454381824 00000100:00100000:3.0:1762167004.289789:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454381824 00000100:00100000:3.0:1762167004.289822:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1762167004.289829:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454381824:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.289899:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454381824:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 70us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.289906:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1762167004.290049:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454381952 00000100:00100000:1.0:1762167004.290056:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454381952 00000100:00100000:1.0:1762167004.290086:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1762167004.290092:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454381952:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.290150:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454381952:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.290155:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1762167004.290361:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454382080 00000100:00100000:1.0:1762167004.290368:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454382080 00000100:00100000:1.0:1762167004.290400:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1762167004.290419:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454382080:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.290468:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454382080:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.290473:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1762167004.290597:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454382208 00000100:00100000:1.0:1762167004.290602:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454382208 00000100:00100000:1.0:1762167004.290628:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1762167004.290635:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454382208:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.290688:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454382208:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 53us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.290694:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1762167004.290876:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454382336 00000100:00100000:1.0:1762167004.290881:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454382336 00000100:00100000:1.0:1762167004.290907:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1762167004.290913:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454382336:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.290961:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454382336:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.290968:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1762167004.291045:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454382464 00000100:00100000:1.0:1762167004.291048:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454382464 00000100:00100000:1.0:1762167004.291072:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1762167004.291078:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454382464:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.291122:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454382464:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 43us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.291128:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1762167004.291201:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454382592 00000100:00100000:1.0:1762167004.291204:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454382592 00000100:00100000:1.0:1762167004.291244:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1762167004.291250:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454382592:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.291297:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454382592:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.291303:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1762167004.291374:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454382720 00000100:00100000:1.0:1762167004.291377:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454382720 00000100:00100000:1.0:1762167004.291399:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1762167004.291419:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454382720:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.291462:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454382720:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 46us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.291468:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1762167004.291545:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454382848 00000100:00100000:1.0:1762167004.291548:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454382848 00000100:00100000:1.0:1762167004.291571:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1762167004.291578:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454382848:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.291632:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454382848:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.291638:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1762167004.291709:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454382976 00000100:00100000:1.0:1762167004.291712:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454382976 00000100:00100000:1.0:1762167004.291734:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1762167004.291741:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454382976:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.291816:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454382976:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.291822:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1762167004.292156:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454383104 00000100:00100000:1.0:1762167004.292161:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454383104 00000100:00100000:1.0:1762167004.292192:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1762167004.292200:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454383104:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.292371:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33886:x1847765454383104:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 171us (257us total) trans 21474843120 rc 0/0 00000100:00100000:1.0:1762167004.292379:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1762167004.292505:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454383232 00000100:00100000:1.0:1762167004.292510:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454383232 00000100:00100000:1.0:1762167004.292536:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1762167004.292544:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:33886:x1847765454383232:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.292668:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454383232:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 124us (194us total) trans 17179875602 rc 0/0 00000100:00100000:1.0:1762167004.292678:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00010000:00010000:2.0:1762167004.292927:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09477 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.292934:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09477 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.292940:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09477 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.292944:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.292947:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09477 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.292954:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09477 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.292961:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0c00) 00010000:00010000:2.0:1762167004.292964:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167004.292967:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09477 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.292973:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09477 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.292990:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0c00) 00010000:00010000:2.0:1762167004.292993:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167004.292999:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09469 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30cb expref: 940 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.293085:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+939:56181:x1847765451705728:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7883us (8013us total) trans 8589952625 rc 0/0 00000100:00100000:2.0:1762167004.293093:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7255 00000020:00080000:2.0:1762167004.293097:0:33886:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762167004.294161:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.294211:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451706112 00000100:00100000:3.0:1762167004.294219:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451706112 00000100:00100000:3.0:1762167004.294260:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19549 00000100:00100000:3.0:1762167004.294267:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+939:56181:x1847765451706112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.294282:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.294297:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09485 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb30d2 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.294334:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09485 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d2 expref: 940 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.294343:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09485 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d2 expref: 940 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.294355:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167004.294362:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167004.294366:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:3.0:1762167004.294412:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+940:56181:x1847765451706112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 135us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.294419:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19549 00000100:00100000:0.0:1762167004.296270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.296345:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451706368 00000100:00100000:2.0:1762167004.296356:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451706368 00000100:00100000:2.0:1762167004.296429:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7256 00000100:00100000:2.0:1762167004.296443:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+940:56181:x1847765451706368:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762167004.297054:0:33886:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x644:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762167004.297145:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5326, 64 off429080 00000040:00080000:2.0:1762167004.297165:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5334, 64 off430200 00000001:00080000:2.0:1762167004.297170:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952626 00010000:00010000:2.0:1762167004.297212:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x644:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.297226:0:33886:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x644:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.297235:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x644:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.297242:0:33886:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x644:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.297246:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x644:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.297250:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x644:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.297269:0:33886:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762167004.297307:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167004.297315:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x644:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.297322:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167004.297326:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x644:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.297332:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x644:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.297344:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x644:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:3.0:1762167004.297347:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762167004.297350:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 1/0,0 mode: --/PW res: [0x200000404:0x644:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.297354:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0948c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x644:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.297369:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167004.297371:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167004.297372:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762167004.297397:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+942:56181:x1847765451706368:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 958us (1137us total) trans 8589952627 rc 0/0 00000100:00100000:2.0:1762167004.297415:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7256 00000020:00080000:2.0:1762167004.297421:0:33886:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762167004.298638:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.298685:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451706624 00000100:00100000:2.0:1762167004.298695:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451706624 00000100:00100000:2.0:1762167004.298749:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7257 00000100:00100000:2.0:1762167004.298758:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+942:56181:x1847765451706624:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167004.299039:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+943:56181:x1847765451706624:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 283us (407us total) trans 8589952628 rc 0/0 00000100:00100000:2.0:1762167004.299044:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7257 00000100:00100000:0.0:1762167004.308144:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.308230:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451706752 00000100:00100000:3.0:1762167004.308249:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451706752 00000100:00100000:3.0:1762167004.308332:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19550 00000100:00100000:3.0:1762167004.308343:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+943:56182:x1847765451706752:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.308374:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.308399:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09493 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb30d9 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.308503:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0949a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308521:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0949a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308535:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0949a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308554:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d094a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308562:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d094a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308577:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d094a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308698:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308704:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308708:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.308744:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:3.0:1762167004.308748:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167004.308798:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308812:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308822:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0949a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308829:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0949a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308835:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0949a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308845:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.308849:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0949a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308858:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0949a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308871:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167004.308875:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.308880:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0949a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308885:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0949a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308899:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d094a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308905:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d094a1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308911:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d094a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308917:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.308919:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d094a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308925:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d094a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308931:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23300) 00010000:00010000:3.0:1762167004.308934:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.308937:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d094a1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308942:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d094a1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.308975:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09493 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d9 expref: 945 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.308992:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d9 expref: 944 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.309000:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167004.309003:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167004.309005:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167004.309081:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+944:56182:x1847765451706752:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 739us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.309089:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19550 00000100:00100000:0.0:1762167004.311292:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.311344:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451707008 00000100:00100000:3.0:1762167004.311356:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451707008 00000100:00100000:3.0:1762167004.311420:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19551 00000100:00100000:3.0:1762167004.311431:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+944:56182:x1847765451707008:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.311452:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.311471:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d094af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb30e0 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.311566:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.311583:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.311593:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.311603:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:3.0:1762167004.311727:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d094af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e0 expref: 947 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.311745:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e0 expref: 946 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.311754:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167004.311757:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167004.311794:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167004.311843:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+946:56182:x1847765451707008:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 413us (558us total) trans 8589952629 rc 0/0 00000100:00100000:3.0:1762167004.311851:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19551 00000100:00100000:0.0:1762167004.313607:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.313671:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451707264 00000100:00100000:3.0:1762167004.313680:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451707264 00000100:00100000:3.0:1762167004.313729:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19552 00000100:00100000:3.0:1762167004.313736:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+946:56182:x1847765451707264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.313756:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.313808:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d094c4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb30e7 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.313910:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d094cb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.313922:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d094cb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.313930:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d094cb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.313942:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:3.0:1762167004.314075:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d094c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e7 expref: 949 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.314093:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d094cb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e7 expref: 948 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.314100:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167004.314102:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167004.314104:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000100:00100000:3.0:1762167004.314158:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+948:56182:x1847765451707264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 422us (563us total) trans 8589952630 rc 0/0 00000100:00100000:3.0:1762167004.314164:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19552 00000100:00100000:0.0:1762167004.315978:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.316051:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451707392 00000100:00100000:1.0:1762167004.316061:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451707392 00000100:00100000:1.0:1762167004.316121:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 623 00000100:00100000:1.0:1762167004.316132:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+948:56182:x1847765451707392:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167004.316148:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.316171:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d094cb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e7 expref: 948 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.316190:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:1.0:1762167004.316195:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.316244:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+947:56182:x1847765451707392:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 114us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.316252:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 623 00000100:00100000:0.0:1762167004.317208:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.317267:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451707648 00000100:00100000:2.0:1762167004.317274:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451707648 00000100:00100000:2.0:1762167004.317311:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7258 00000100:00100000:2.0:1762167004.317322:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+947:56182:x1847765451707648:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167004.317541:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+948:56182:x1847765451707648:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 221us (334us total) trans 8589952631 rc 0/0 00000100:00100000:2.0:1762167004.317549:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7258 00000100:00100000:0.0:1762167004.319651:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.319706:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451707904 00000100:00100000:3.0:1762167004.319718:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451707904 00000100:00100000:3.0:1762167004.319798:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19553 00000100:00100000:3.0:1762167004.319812:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+948:56065:x1847765451707904:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167004.319858:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.319910:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d094d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb30ee expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.320016:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.320031:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d9 expref: 949 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.320039:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.320071:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d9 expref: 949 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.320084:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d9 expref: 949 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.320098:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454383360:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.320174:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3605109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.321117:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454383360:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.321132:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.321636:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.321689:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451708032 00000100:00100000:1.0:1762167004.321696:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451708032 00010000:00010000:1.0:1762167004.321726:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d9 expref: 950 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.321785:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7322 00000100:00100000:1.0:1762167004.321795:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+950:2360:x1847765451708032:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.321808:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.321815:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d9 expref: 950 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.321827:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d9 expref: 950 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.321848:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d094a8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d9 expref: 950 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.321865:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:1.0:1762167004.321870:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.321879:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.321890:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.321921:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.321965:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+949:2360:x1847765451708032:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.321973:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7322 00010000:00010000:2.0:1762167004.322014:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.322019:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.322033:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:2.0:1762167004.322165:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d094d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30ee expref: 950 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.322179:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30ee expref: 949 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.322186:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.322189:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167004.322191:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:2.0:1762167004.322226:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+949:56065:x1847765451707904:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2420us (2583us total) trans 8589952632 rc 0/0 00000100:00100000:2.0:1762167004.322233:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19553 00000100:00100000:0.0:1762167004.323784:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.323841:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451708160 00000100:00100000:2.0:1762167004.323849:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451708160 00000100:00100000:2.0:1762167004.323895:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19554 00000100:00100000:2.0:1762167004.323904:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+949:56065:x1847765451708160:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167004.323924:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.323940:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094ee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb30f5 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.324012:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.324027:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30ee expref: 950 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.324035:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.324065:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30ee expref: 950 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.324076:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30ee expref: 950 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.324089:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454383488:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.324160:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360510540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167004.325549:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.325591:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454383488:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.325614:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167004.325615:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451708288 00000100:00100000:1.0:1762167004.325622:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451708288 00010000:00010000:1.0:1762167004.325653:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30ee expref: 951 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.325686:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7323 00000100:00100000:1.0:1762167004.325696:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+951:2360:x1847765451708288:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.325715:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.325721:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30ee expref: 951 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.325753:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30ee expref: 951 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.325793:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d094e0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30ee expref: 951 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.325966:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:1.0:1762167004.325971:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.325980:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.325987:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.326013:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.326041:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.326055:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.326090:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167004.326097:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1762167004.326097:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+950:2360:x1847765451708288:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 400us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.326108:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7323 00000004:00010000:2.0:1762167004.326121:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.326161:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30f5 expref: 950 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.326176:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30f5 expref: 949 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.326183:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.326185:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167004.326188:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167004.326222:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+949:56065:x1847765451708160:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2320us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.326229:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19554 00000100:00100000:0.0:1762167004.328999:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.329085:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451708416 00000100:00100000:1.0:1762167004.329097:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451708416 00002000:00100000:1.0:1762167004.329141:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (229376->233471) req@ffff9ee34371b480 x1847765451708416/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.329151:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34371b480 with x1847765451708416 ext(229376->233471) 00002000:00010000:1.0:1762167004.329157:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34371b480 00000100:00100000:1.0:1762167004.329189:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2694 00000100:00100000:1.0:1762167004.329200:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451708416:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167004.329393:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451708416:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 195us (402us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762167004.329413:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2694 00002000:00100000:1.0:1762167004.329421:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (229376->233471) req@ffff9ee34371b480 x1847765451708416/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/4536 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.329430:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34371b480 with x1847765451708416 ext(229376->233471) 00002000:00010000:1.0:1762167004.329434:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34371b480 00000100:00100000:0.0:1762167004.333261:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.333311:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451708544 00000100:00100000:1.0:1762167004.333321:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451708544 00002000:00100000:1.0:1762167004.333382:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (196608->200703) req@ffff9ee343718a80 x1847765451708544/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.333394:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343718a80 with x1847765451708544 ext(196608->200703) 00002000:00010000:1.0:1762167004.333399:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee343718a80 00000100:00100000:1.0:1762167004.333440:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2695 00000100:00100000:1.0:1762167004.333451:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451708544:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167004.333623:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451708544:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 175us (372us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762167004.333629:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2695 00002000:00100000:1.0:1762167004.333634:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (196608->200703) req@ffff9ee343718a80 x1847765451708544/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/4536 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.333640:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343718a80 with x1847765451708544 ext(196608->200703) 00002000:00010000:1.0:1762167004.333643:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee343718a80 00000100:00100000:0.0:1762167004.335398:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.335459:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451708672 00000100:00100000:1.0:1762167004.335468:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451708672 00002000:00100000:1.0:1762167004.335505:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (172032->229375) req@ffff9ee24240f480 x1847765451708672/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 504/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.335516:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240f480 with x1847765451708672 ext(172032->229375) 00002000:00010000:1.0:1762167004.335520:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240f480 00000100:00100000:1.0:1762167004.335544:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2696 00000100:00100000:1.0:1762167004.335551:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451708672:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167004.336964:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451708672:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1409us (1571us total) trans 0 rc 53248/53248 00000100:00100000:1.0:1762167004.336976:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2696 00002000:00100000:1.0:1762167004.336986:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (172032->229375) req@ffff9ee24240f480 x1847765451708672/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 504/440 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.336996:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240f480 with x1847765451708672 ext(172032->229375) 00002000:00010000:1.0:1762167004.337002:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240f480 00000100:00100000:0.0:1762167004.339305:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.339381:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451708928 00000100:00100000:2.0:1762167004.339395:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451708928 00000100:00100000:2.0:1762167004.339478:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19555 00000100:00100000:2.0:1762167004.339490:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+949:56065:x1847765451708928:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167004.339561:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167004.339596:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d094f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30f5 expref: 949 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.339624:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.339630:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.339952:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.339967:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.339977:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:2.0:1762167004.340036:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952633 00000004:00010000:2.0:1762167004.340064:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d58eeaa8 reply state 00000000b3ace7f4 transno 8589952634 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167004.340072:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167004.340184:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+951:56065:x1847765451708928:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 695us (888us total) trans 8589952634 rc 0/0 00000100:00100000:2.0:1762167004.340192:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19555 00000020:00080000:2.0:1762167004.340198:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167004.341005:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.341022:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.341029:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.341035:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.341040:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.341048:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.341065:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.341068:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167004.341073:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.341079:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d094fc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.341524:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.341550:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.341577:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451709056 00000100:00100000:1.0:1762167004.341587:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451709056 00002000:00010000:1.0:1762167004.341624:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (92016->18446744073709551615) 00002000:00100000:1.0:1762167004.341630:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240f100 with x1847765451709056 ext(92016->18446744073709551615) 00000100:00100000:3.0:1762167004.341638:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451709184 00002000:00010000:1.0:1762167004.341641:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240f100. 00000100:00100000:3.0:1762167004.341643:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451709184 00002000:00010000:3.0:1762167004.341661:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167004.341665:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240f800 with x1847765451709184 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167004.341673:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:3.0:1762167004.341674:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240f800. 00000100:00100000:1.0:1762167004.341685:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451709312 00000100:00100000:1.0:1762167004.341690:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451709312 00002000:00010000:1.0:1762167004.341706:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:3.0:1762167004.341708:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2697 00002000:00100000:1.0:1762167004.341710:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240d880 with x1847765451709312 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.341719:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240d880. 00000100:00100000:2.0:1762167004.341720:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2698 00000100:00100000:3.0:1762167004.341726:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451709056:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167004.341740:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2358:x1847765451709184:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167004.341751:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2699 00000100:00100000:1.0:1762167004.341789:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451709312:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167004.342021:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167004.342025:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.342028:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167004.342028:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167004.342035:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.342036:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.342043:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167004.342043:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167004.342050:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.342052:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167004.342102:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451709312:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 340us (429us total) trans 21474843121 rc 0/0 00000100:00100000:2.0:1762167004.342104:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451709184:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 369us (548us total) trans 17179875603 rc 0/0 00000100:00100000:1.0:1762167004.342119:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2699 00002000:00010000:1.0:1762167004.342124:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:2.0:1762167004.342127:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2698 00002000:00100000:1.0:1762167004.342130:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240d880 with x1847765451709312 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167004.342132:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:2.0:1762167004.342136:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240f800 with x1847765451709184 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.342139:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240d880. 00002000:00010000:2.0:1762167004.342142:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240f800. 00002000:00010000:2.0:1762167004.342347:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 262144 -> 92016 00002000:00010000:2.0:1762167004.342350:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.342352:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.342355:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.342357:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 373 -> 397 00000100:00100000:2.0:1762167004.342390:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451709056:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 672us (870us total) trans 21474843122 rc 0/0 00000100:00100000:2.0:1762167004.342398:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2697 00002000:00010000:2.0:1762167004.342411:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (92016->18446744073709551615) 00002000:00100000:2.0:1762167004.342415:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240f100 with x1847765451709056 ext(92016->18446744073709551615) 00002000:00010000:2.0:1762167004.342420:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240f100. 00000100:00100000:0.0:1762167004.343469:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.343510:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451709440 00000100:00100000:2.0:1762167004.343515:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451709440 00000100:00100000:2.0:1762167004.343548:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19556 00000100:00100000:2.0:1762167004.343554:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+950:56065:x1847765451709440:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167004.343566:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.343580:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09503 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb30fc expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.343641:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0950a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.343651:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0950a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.343658:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0950a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.343678:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:2.0:1762167004.343682:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167004.343697:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0950a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.343724:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09503 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30fc expref: 952 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.343734:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0950a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30fc expref: 951 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.343744:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.343746:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167004.343748:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:2.0:1762167004.343809:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+951:56065:x1847765451709440:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 254us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.343816:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19556 00000100:00100000:0.0:1762167004.345960:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.346025:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451709568 00000100:00100000:2.0:1762167004.346032:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451709568 00002000:00100000:2.0:1762167004.346065:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->73727) req@ffff9ee24240ca80 x1847765451709568/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.346076:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240ca80 with x1847765451709568 ext(24576->73727) 00002000:00010000:2.0:1762167004.346080:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240ca80 00000100:00100000:2.0:1762167004.346101:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2700 00000100:00100000:2.0:1762167004.346107:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451709568:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167004.347153:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451709568:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1041us (1193us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1762167004.347162:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2700 00002000:00100000:2.0:1762167004.347171:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->73727) req@ffff9ee24240ca80 x1847765451709568/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/440 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.347187:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240ca80 with x1847765451709568 ext(24576->73727) 00002000:00010000:2.0:1762167004.347191:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240ca80 00000100:00100000:0.0:1762167004.349462:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.349513:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451709696 00000100:00100000:2.0:1762167004.349522:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451709696 00002000:00100000:2.0:1762167004.349561:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (73728->94207) req@ffff9ee24240d500 x1847765451709696/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.349572:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240d500 with x1847765451709696 ext(73728->94207) 00002000:00010000:2.0:1762167004.349577:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240d500 00000100:00100000:2.0:1762167004.349606:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2701 00000100:00100000:2.0:1762167004.349616:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451709696:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167004.350661:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451709696:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1043us (1201us total) trans 0 rc 20480/20480 00000100:00100000:2.0:1762167004.350669:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2701 00002000:00100000:2.0:1762167004.350676:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (73728->94207) req@ffff9ee24240d500 x1847765451709696/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/440 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.350685:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240d500 with x1847765451709696 ext(73728->94207) 00002000:00010000:2.0:1762167004.350694:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240d500 00000100:00100000:3.0:1762167004.353586:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.353638:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451709952 00000100:00100000:2.0:1762167004.353645:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451709952 00000100:00100000:2.0:1762167004.353696:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7259 00000100:00100000:2.0:1762167004.353705:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348211050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+951:56065:x1847765451709952:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167004.354037:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348211050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+952:56065:x1847765451709952:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 331us (455us total) trans 8589952635 rc 0/0 00000100:00100000:2.0:1762167004.354049:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7259 00000100:00100000:0.0:1762167004.363041:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.363098:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451710208 00000100:00100000:2.0:1762167004.363109:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451710208 00000100:00100000:2.0:1762167004.363165:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19557 00000100:00100000:2.0:1762167004.363176:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+952:56183:x1847765451710208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.363195:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.363213:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09511 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3103 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.363284:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09518 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363297:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09518 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363307:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09518 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363320:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0951f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363325:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0951f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363330:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0951f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363465:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09526 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363474:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09526 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363482:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09526 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.363492:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00010000:00010000:2.0:1762167004.363577:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09518 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363585:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09518 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363591:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09518 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363598:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.363601:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09518 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363607:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09518 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363615:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167004.363617:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167004.363620:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09518 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363624:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09518 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363631:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0951f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363634:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0951f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363641:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0951f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363644:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.363646:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0951f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363649:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0951f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363652:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0c00) 00010000:00010000:2.0:1762167004.363653:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167004.363655:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0951f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363658:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0951f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.363687:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09511 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3103 expref: 955 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.363695:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09526 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3103 expref: 954 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.363699:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.363701:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167004.363702:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00000100:00100000:2.0:1762167004.363750:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+954:56183:x1847765451710208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 576us (718us total) trans 8589952636 rc 0/0 00000100:00100000:2.0:1762167004.363754:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19557 00000100:00100000:0.0:1762167004.365150:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.365239:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451710336 00000100:00100000:1.0:1762167004.365246:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451710336 00000100:00100000:1.0:1762167004.365300:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 624 00000100:00100000:1.0:1762167004.365307:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+954:2360:x1847765451710336:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.365318:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.365334:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09526 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3103 expref: 954 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.365348:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:1.0:1762167004.365352:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.365412:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+953:2360:x1847765451710336:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.365419:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 624 00000100:00100000:3.0:1762167004.365590:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.365632:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451710592 00000100:00100000:2.0:1762167004.365637:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451710592 00000100:00100000:2.0:1762167004.365667:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19558 00000100:00100000:2.0:1762167004.365679:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+953:56183:x1847765451710592:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.365696:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.365707:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09534 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb310a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.366141:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x645:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.366154:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.366163:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.366173:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x645:0x0]: returning size 0 00010000:00010000:2.0:1762167004.366211:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09534 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb310a expref: 956 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.366223:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb310a expref: 955 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.366230:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167004.366233:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167004.366236:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:2.0:1762167004.366278:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+955:56183:x1847765451710592:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 603us (686us total) trans 8589952637 rc 0/0 00000100:00100000:2.0:1762167004.366285:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19558 00000100:00100000:3.0:1762167004.367986:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.368038:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451710848 00000100:00100000:2.0:1762167004.368047:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451710848 00000100:00100000:2.0:1762167004.368099:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19559 00000100:00100000:2.0:1762167004.368110:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+955:56183:x1847765451710848:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.368129:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.368143:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09549 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3111 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.368229:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.368241:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb310a expref: 956 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.368249:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.368280:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb310a expref: 956 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.368294:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb310a expref: 956 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.368307:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454383616:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.368378:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3605109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.369347:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454383616:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.369369:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167004.369395:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.369449:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451710976 00000100:00100000:1.0:1762167004.369455:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451710976 00010000:00010000:1.0:1762167004.369481:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb310a expref: 957 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.369511:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7324 00000100:00100000:1.0:1762167004.369520:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+957:2361:x1847765451710976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.369530:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.369537:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb310a expref: 957 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.369549:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb310a expref: 957 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.369566:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0953b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb310a expref: 957 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.369580:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167004.369584:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.369592:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.369599:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.369622:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.369659:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+956:2361:x1847765451710976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 140us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.369666:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7324 00010000:00010000:2.0:1762167004.369682:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.369689:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.369701:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x645:0x0]: returning size 0 00000004:00080000:2.0:1762167004.369989:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x818:0x0], index 0: 0 00000004:00080000:2.0:1762167004.370000:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81b:0x0], index 1: 0 00010000:00010000:2.0:1762167004.370113:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.370119:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.370123:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.370127:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.370129:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.370134:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.370140:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167004.370142:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167004.370144:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.370147:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09550 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.370184:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09549 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3111 expref: 956 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.370193:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167004.370195:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762167004.370197:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09549 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3111 expref: 956 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.370202:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167004.370232:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+955:56183:x1847765451710848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2124us (2253us total) trans 8589952638 rc 301/301 00000100:00100000:2.0:1762167004.370238:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19559 00000100:00100000:3.0:1762167004.371113:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.371153:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451711232 00000100:00100000:2.0:1762167004.371159:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451711232 00000100:00100000:2.0:1762167004.371199:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7260 00000100:00100000:2.0:1762167004.371208:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+955:56183:x1847765451711232:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167004.371432:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+956:56183:x1847765451711232:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 224us (320us total) trans 8589952639 rc 0/0 00000100:00100000:2.0:1762167004.371440:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7260 00000100:00100000:0.0:1762167004.372612:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.372653:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451711360 00000100:00100000:2.0:1762167004.372658:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451711360 00000100:00100000:2.0:1762167004.372695:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19560 00000100:00100000:2.0:1762167004.372703:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+956:56183:x1847765451711360:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.372717:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.372734:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0955e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x645:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3118 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.372809:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09565 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x645:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.372823:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09565 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.372833:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09565 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.372857:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x645:0x0]: returning size 0 00000004:00200000:2.0:1762167004.372861:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167004.372871:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09565 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.372887:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0955e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3118 expref: 958 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.372898:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09565 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3118 expref: 957 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.372904:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.372906:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762167004.372907:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167004.372940:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+957:56183:x1847765451711360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 238us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.372946:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19560 00000100:00100000:3.0:1762167004.374188:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.374259:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451711488 00000100:00100000:0.0:1762167004.374270:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451711488 00000100:00100000:3.0:1762167004.374271:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.374334:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451711616 00000100:00100000:0.0:1762167004.374340:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451711616 00000100:00100000:1.0:1762167004.374371:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16431 00000100:00100000:1.0:1762167004.374388:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451711488:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:2.0:1762167004.374396:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16432 00010000:00010000:1.0:1762167004.374416:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762167004.374422:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451711616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.374431:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167004.374436:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0956c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb311f expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.374442:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09573 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3126 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167004.374464:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:1.0:1762167004.374465:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x818:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762167004.374483:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.374484:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.374488:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.374489:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.374500:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0956c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb311f expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.374505:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3126 expref: 35 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.374520:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0956c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb311f expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.374526:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3126 expref: 35 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.374538:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7be00, rc 0) 00010000:00010000:2.0:1762167004.374540:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00000100:00100000:1.0:1762167004.374583:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451711488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 201us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.374585:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451711616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 164us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.374599:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16431 00000100:00100000:2.0:1762167004.374606:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16432 00000100:00100000:3.0:1762167004.375975:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.376049:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451711872 00000100:00100000:2.0:1762167004.376060:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451711872 00000100:00100000:2.0:1762167004.376120:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19561 00000100:00100000:2.0:1762167004.376131:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+957:56183:x1847765451711872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.376153:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.376173:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0957a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb312d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.376290:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09581 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.376306:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09581 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.376321:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09581 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.376339:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00010000:00010000:2.0:1762167004.376510:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0957a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb312d expref: 960 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.376530:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09581 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb312d expref: 959 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.376536:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.376538:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167004.376540:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167004.376588:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+959:56183:x1847765451711872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 460us (620us total) trans 8589952640 rc 0/0 00000100:00100000:2.0:1762167004.376595:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19561 00000100:00100000:0.0:1762167004.378339:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.378385:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.378422:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451712000 00000100:00100000:0.0:1762167004.378426:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.378430:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451712000 00000100:00100000:1.0:1762167004.378455:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451712128 00000100:00100000:2.0:1762167004.378465:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451712256 00000100:00100000:1.0:1762167004.378465:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451712128 00000100:00100000:2.0:1762167004.378471:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451712256 00000100:00100000:0.0:1762167004.378483:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16433 00000100:00100000:0.0:1762167004.378495:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451712000:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167004.378500:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16434 00000100:00100000:1.0:1762167004.378516:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16435 00000100:00100000:3.0:1762167004.378522:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451712128:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167004.378530:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451712256:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762167004.378544:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.378552:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.378557:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.378567:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->106495) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2feb expref: 23 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.378571:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0920f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3000 expref: 35 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.378581:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09216 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3007 expref: 23 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.378590:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167004.378595:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167004.378595:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167004.378600:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167004.378602:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.378606:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.378611:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167004.378615:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167004.378622:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.378655:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0920f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3000 expref: 35 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.378658:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09216 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3007 expref: 23 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.378658:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->106495) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2feb expref: 23 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.378691:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->106495) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2feb expref: 23 pid: 6533 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.378692:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3007 expref: 23 pid: 7858 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.378693:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0920f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3000 expref: 35 pid: 7858 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.378730:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454383872:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167004.378730:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454384000:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167004.378733:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454383744:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167004.378846:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.378847:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287d80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.378847:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347157540 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.380278:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454383744:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167004.380302:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.380370:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454384000:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167004.380399:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.380432:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.380461:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454383872:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167004.380467:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451712512 00000100:00100000:3.0:1762167004.380475:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.380477:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451712512 00010000:00010000:1.0:1762167004.380488:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.380518:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0920f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3000 expref: 36 pid: 7858 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.380525:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451712640 00000100:00100000:2.0:1762167004.380533:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451712640 00000100:00100000:3.0:1762167004.380538:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167004.380559:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->106495) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2feb expref: 24 pid: 6533 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.380602:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451712384 00000100:00100000:2.0:1762167004.380607:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451712384 00000100:00100000:1.0:1762167004.380616:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7325 00010000:00010000:2.0:1762167004.380628:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3007 expref: 25 pid: 7858 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1762167004.380628:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7326 00000100:00100000:1.0:1762167004.380638:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2359:x1847765451712512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762167004.380654:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451712640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.380665:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.380690:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762167004.380695:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7327 00010000:00010000:1.0:1762167004.380702:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0920f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3000 expref: 36 pid: 7858 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.380713:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451712384:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167004.380717:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->106495) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2feb expref: 25 pid: 6533 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.380736:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0920f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3000 expref: 36 pid: 7858 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.380743:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->106495) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2feb expref: 25 pid: 6533 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167004.380747:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167004.380802:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09216 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3007 expref: 25 pid: 7858 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.380812:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0920f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3000 expref: 36 pid: 7858 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167004.380824:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09216 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3007 expref: 25 pid: 7858 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.380828:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d091ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->106495) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2feb expref: 25 pid: 6533 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.380840:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.380846:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.380856:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.380857:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09216 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3007 expref: 24 pid: 7858 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.380857:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.380864:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.380872:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.380900:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.380905:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.380905:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.380912:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.380921:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.380929:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.380940:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167004.380945:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.380951:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.380975:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.380985:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451712640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 339us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.380992:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765451712512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 360us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.380995:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451712384:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 287us (457us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167004.380997:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.381020:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7326 00000100:00100000:2.0:1762167004.381032:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7327 00000100:00100000:1.0:1762167004.381042:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7325 00010000:00010000:3.0:1762167004.381049:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.381062:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.381073:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.381075:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.381087:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.381088:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167004.381088:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.381103:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.381127:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.381142:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.381151:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.381182:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.381191:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.381195:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.381197:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.381223:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.381225:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167004.381232:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.381248:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.381254:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.381288:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d09596 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.381292:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167004.381301:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.381302:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.381327:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.381329:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0958f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.381364:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.381375:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0959d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.381414:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451712128:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2890us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.381417:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451712000:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2923us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.381434:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16434 00000100:00100000:0.0:1762167004.381443:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16433 00000100:00100000:1.0:1762167004.381456:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451712256:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2928us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.381469:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16435 00000100:00100000:3.0:1762167004.382590:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.382697:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451712768 00000100:00100000:0.0:1762167004.382703:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451712768 00000100:00100000:0.0:1762167004.382743:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16436 00000100:00100000:0.0:1762167004.382754:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451712768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167004.382792:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167004.382808:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d095a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3134 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.382816:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:0.0:1762167004.382834:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 92016, mtime: 0x690888dc, atime: 0x690888dc, ctime: 0x690888dc, blocks: 0x18d 00010000:00010000:0.0:1762167004.382849:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.382852:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.382860:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d095a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3134 expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167004.382873:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451712896 00010000:00010000:0.0:1762167004.382877:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d095a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3134 expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167004.382882:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451712896 00000100:00100000:3.0:1762167004.382891:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167004.382897:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:1.0:1762167004.382924:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451713024 00000100:00100000:1.0:1762167004.382927:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451713024 00000100:00100000:1.0:1762167004.382948:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16437 00000100:00100000:1.0:1762167004.382954:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451712896:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167004.382965:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762167004.382975:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451712768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 219us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.382983:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16438 00010000:00010000:1.0:1762167004.382987:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d095ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb313b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.382999:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16436 00000100:00100000:2.0:1762167004.383001:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451713024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.383026:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1762167004.383034:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888dc, atime: 0x690888db, ctime: 0x690888dc, blocks: 0x3 00010000:00010000:2.0:1762167004.383038:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d095b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3142 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167004.383052:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888dc, atime: 0x690888db, ctime: 0x690888dc, blocks: 0x3 00010000:00010000:1.0:1762167004.383053:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.383057:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.383061:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.383065:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.383068:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d095ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb313b expref: 35 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.383073:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d095b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3142 expref: 22 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.383101:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d095ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb313b expref: 35 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.383102:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d095b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3142 expref: 22 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.383142:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b800, rc 0) 00010000:00010000:2.0:1762167004.383150:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d400, rc 0) 00000100:00100000:1.0:1762167004.383194:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2358:x1847765451712896:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 236us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.383204:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451713024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 206us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.383215:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16437 00000100:00100000:2.0:1762167004.383224:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16438 00000100:00100000:3.0:1762167004.406181:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.406248:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451713152 00000100:00100000:2.0:1762167004.406258:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451713152 00000100:00100000:2.0:1762167004.406318:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2702 00000100:00100000:2.0:1762167004.406325:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451713152:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167004.406351:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d095b9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.406364:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.406367:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.406372:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d095b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.406386:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d095b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.407576:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d095b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.407588:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d095b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.407596:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d095b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.407603:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.407607:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d095b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.407615:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d095b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.407631:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d095b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.407638:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d095b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.407705:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451713152:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1380us (1534us total) trans 0 rc 92016/92016 00000100:00100000:2.0:1762167004.407711:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2702 00000100:00100000:3.0:1762167004.408887:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.408928:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451713280 00000100:00100000:2.0:1762167004.408933:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451713280 00000100:00100000:2.0:1762167004.408986:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2703 00000100:00100000:2.0:1762167004.408995:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451713280:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:2.0:1762167004.409019:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.409035:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0956c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb311f expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.409043:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.409045:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.409048:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.409077:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0956c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb311f expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.409086:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0956c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb311f expref: 22 pid: 6533 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.409096:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454384128:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.409144:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360510540 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.409911:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454384128:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.409928:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.410142:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.410192:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451713408 00000100:00100000:1.0:1762167004.410197:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451713408 00010000:00010000:1.0:1762167004.410221:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0956c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb311f expref: 23 pid: 6533 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.410253:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7328 00000100:00100000:1.0:1762167004.410262:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451713408:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.410271:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.410291:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0956c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb311f expref: 23 pid: 6533 timeout: 725 lvb_type: 1 00010000:00010000:1.0:1762167004.410299:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0956c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb311f expref: 23 pid: 6533 timeout: 725 lvb_type: 1 00010000:00010000:1.0:1762167004.410312:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0956c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb311f expref: 23 pid: 6533 timeout: 725 lvb_type: 1 00010000:00010000:1.0:1762167004.410321:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.410322:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.410325:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.410330:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.410347:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.410364:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.410372:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.410379:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451713408:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 118us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.410389:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7328 00000001:00080000:2.0:1762167004.423537:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843121 is committed 00000001:00080000:2.0:1762167004.423552:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843120 is committed 00000001:00080000:2.0:1762167004.423567:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843123 is committed 00002000:00010000:3.0:1762167004.423581:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb size from disk: 0 -> 92016 00002000:00010000:3.0:1762167004.423586:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb mtime from disk: 0 -> 1762167004 00002000:00010000:3.0:1762167004.423589:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb ctime from disk: 0 -> 1762167004 00002000:00010000:3.0:1762167004.423591:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb blocks from disk: 1 -> 259 00010000:00010000:3.0:1762167004.423613:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.423623:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.423630:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.423635:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167004.423638:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.423644:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.423657:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.423661:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d095c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.423746:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451713280:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14747us (14856us total) trans 21474843123 rc 0/0 00000100:00100000:3.0:1762167004.423756:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2703 00000100:00100000:3.0:1762167004.425107:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.425150:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451713536 00000100:00100000:2.0:1762167004.425158:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451713536 00000100:00100000:2.0:1762167004.425209:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19562 00000100:00100000:2.0:1762167004.425218:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+959:56183:x1847765451713536:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762167004.436266:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952612 is committed 00000020:00080000:1.0:1762167004.436284:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee37f4e7840 refcount 2 committed 0 result 0 batchid 4294969175 00000020:00080000:1.0:1762167004.436288:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34368fd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee242c59480 00000020:00080000:1.0:1762167004.436291:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f670300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37f4e7240 00000020:00080000:1.0:1762167004.436293:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f670e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee2478fac00 00000020:00080000:1.0:1762167004.436296:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].43 00000020:00080000:1.0:1762167004.436317:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969174 batchid updated 00000001:00080000:1.0:1762167004.436326:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952640 is committed 00000020:00080000:3.0:1762167004.436343:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969175 committed batchid 4294969174 00000020:00080000:1.0:1762167004.436356:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee36dc36900 refcount 2 committed 0 result 0 batchid 4294969176 00000020:00080000:1.0:1762167004.436359:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435e3700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3503e2780 00000020:00080000:1.0:1762167004.436361:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34368f700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3432f5900 00000020:00080000:1.0:1762167004.436364:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee34368fa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee342e36000 00000020:00080000:1.0:1762167004.436367:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].44 00000100:00100000:2.0:1762167004.436389:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:56183:x1847765451713536:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 11165us (11276us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.436415:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19562 00000020:00080000:3.0:1762167004.436693:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969173 cancel update log [0x200000bd0:0x1:0x0].41: rc = 0 00000020:00080000:3.0:1762167004.436789:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969174 cancel update log [0x200000bd0:0x1:0x0].42: rc = 0 00000020:00080000:3.0:1762167004.436801:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969176 committed batchid 4294969174 00000020:00080000:3.0:1762167004.436822:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969174 00000100:00100000:2.0:1762167004.438021:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.438051:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.438105:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451713664 00000100:00100000:1.0:1762167004.438108:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451713792 00000100:00100000:3.0:1762167004.438114:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451713664 00000100:00100000:1.0:1762167004.438114:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451713792 00000100:00100000:3.0:1762167004.438170:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16439 00000100:00100000:1.0:1762167004.438181:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16440 00000100:00100000:3.0:1762167004.438183:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451713664:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762167004.438196:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451713792:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:3.0:1762167004.438286:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451713664:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 104us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.438287:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451713792:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.438296:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16439 00000100:00100000:1.0:1762167004.438303:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16440 00000100:00100000:0.0:1762167004.444887:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.444923:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.444967:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.445009:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451714048 00000100:00100000:3.0:1762167004.445010:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451713920 00000100:00100000:3.0:1762167004.445022:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451713920 00000100:00100000:1.0:1762167004.445022:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451714048 00000100:00100000:2.0:1762167004.445046:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451714176 00000100:00100000:2.0:1762167004.445053:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451714176 00000100:00100000:1.0:1762167004.445078:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16441 00000100:00100000:3.0:1762167004.445087:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16442 00000100:00100000:1.0:1762167004.445092:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2358:x1847765451714048:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167004.445103:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16443 00000100:00100000:3.0:1762167004.445104:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451713920:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167004.445117:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451714176:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167004.445133:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d095c7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.445137:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d095ce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.445143:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095d5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.445158:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.445160:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.445163:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.445164:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.445164:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.445169:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.445173:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d095ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.445173:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d095c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.445174:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.445207:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.445207:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d095c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.445208:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d095ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.445250:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d095ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.445250:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d095c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.445257:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095d5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.445267:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d095c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.445274:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d095ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.445287:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.445291:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d095c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.445295:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d095ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.445313:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.445317:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167004.445317:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167004.445326:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d095ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.445326:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d095c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.445327:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.445334:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.445351:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d095c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.445358:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d095ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.445359:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.445369:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d095c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.445385:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d095c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.445386:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d095ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.445387:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.445421:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d095ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.445435:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.445484:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2358:x1847765451714048:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 396us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.445491:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451713920:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 389us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.445492:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451714176:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 375us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.445501:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16441 00000100:00100000:3.0:1762167004.445511:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16442 00000100:00100000:2.0:1762167004.445518:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16443 00000100:00100000:0.0:1762167004.446896:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.446958:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451714432 00000100:00100000:2.0:1762167004.446964:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451714432 00000100:00100000:2.0:1762167004.447000:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19563 00000100:00100000:2.0:1762167004.447006:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56183:x1847765451714432:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167004.447044:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167004.447061:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09565 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x645:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3118 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.447072:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.447079:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.447117:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x645:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.447125:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.447133:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:2.0:1762167004.447288:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000420403c2 reply state 000000006fc9c9b8 transno 8589952641 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167004.447300:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167004.447374:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56183:x1847765451714432:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 366us (483us total) trans 8589952641 rc 0/0 00000100:00100000:2.0:1762167004.447381:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19563 00010000:00010000:3.0:1762167004.448086:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.448095:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.448100:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.448103:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.448106:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.448113:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.448127:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0b00) 00010000:00010000:3.0:1762167004.448130:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.448134:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.448139:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d095dc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x645:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.448349:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.448386:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451714560 00000100:00100000:2.0:1762167004.448392:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451714560 00000100:00100000:2.0:1762167004.448443:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19564 00000100:00100000:2.0:1762167004.448452:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56183:x1847765451714560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.448467:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.448481:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d095e3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x645:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3149 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.448515:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d095e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3149 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.448525:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d095e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3149 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.448540:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167004.448543:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167004.448546:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167004.448581:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56183:x1847765451714560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 132us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.448585:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19564 00000100:00100000:0.0:1762167004.449813:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.449846:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.449871:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451714688 00000100:00100000:2.0:1762167004.449878:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451714688 00000100:00100000:3.0:1762167004.449891:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451714816 00000100:00100000:3.0:1762167004.449897:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451714816 00000100:00100000:2.0:1762167004.449923:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16444 00000100:00100000:2.0:1762167004.449937:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451714688:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167004.449943:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16445 00000100:00100000:3.0:1762167004.449958:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451714816:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762167004.450182:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167004.450185:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb mtime from disk: 0 -> 1762167004 00002000:00010000:3.0:1762167004.450188:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb atime from disk: 0 -> 1762167004 00002000:00010000:3.0:1762167004.450191:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb ctime from disk: 0 -> 1762167004 00002000:00010000:3.0:1762167004.450193:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167004.450223:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451714688:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 288us (411us total) trans 21474843124 rc 0/0 00000100:00100000:3.0:1762167004.450224:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451714816:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 271us (375us total) trans 17179875604 rc 0/0 00000100:00100000:2.0:1762167004.450238:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16444 00000100:00100000:3.0:1762167004.450250:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16445 00000100:00100000:0.0:1762167004.451088:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.451130:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451715072 00000100:00100000:2.0:1762167004.451136:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451715072 00000100:00100000:2.0:1762167004.451174:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19565 00000100:00100000:2.0:1762167004.451182:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56183:x1847765451715072:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:2.0:1762167004.451225:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d095ea lrc: 3/0,1 mode: --/PW res: [0x200000404:0x645:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.451236:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d095ea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.451243:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d095ea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.451260:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d095ea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.451264:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d095ea lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.451268:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d095ea lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.451272:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.451274:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d095ea lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.451278:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d095ea lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.451286:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167004.451288:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1762167004.451291:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d095ea lrc: 2/0,0 mode: --/PW res: [0x200000404:0x645:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.451294:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d095ea lrc: 0/0,0 mode: --/PW res: [0x200000404:0x645:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167004.451333:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56183:x1847765451715072:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 152us (247us total) trans 0 rc -22/-22 00000100:00100000:2.0:1762167004.451337:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19565 00000100:00100000:0.0:1762167004.452232:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.452279:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451715328 00000100:00100000:2.0:1762167004.452285:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451715328 00000100:00100000:2.0:1762167004.452326:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19566 00000100:00100000:2.0:1762167004.452336:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56183:x1847765451715328:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167004.452371:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167004.452390:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0950a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30fc expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.452420:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.452424:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.452452:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.452462:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.452469:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:2.0:1762167004.452608:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004bc25dc2 reply state 00000000f00ae708 transno 8589952642 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167004.452617:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167004.452696:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56183:x1847765451715328:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 362us (464us total) trans 8589952642 rc 0/0 00000100:00100000:2.0:1762167004.452705:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19566 00010000:00010000:2.0:1762167004.453476:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.453487:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.453494:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.453501:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.453504:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.453512:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.453523:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.453526:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167004.453530:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.453537:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d095f1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.453727:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.453755:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.453826:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451715456 00000100:00100000:0.0:1762167004.453831:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.453834:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451715456 00000100:00100000:3.0:1762167004.453851:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451715584 00000100:00100000:3.0:1762167004.453864:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451715584 00000100:00100000:2.0:1762167004.453881:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451715712 00000100:00100000:2.0:1762167004.453887:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451715712 00000100:00100000:0.0:1762167004.453896:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16446 00000100:00100000:0.0:1762167004.453910:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451715456:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167004.453914:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16447 00000100:00100000:1.0:1762167004.453934:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2358:x1847765451715584:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167004.453944:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16448 00000100:00100000:3.0:1762167004.453959:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451715712:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167004.454097:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167004.454097:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:1.0:1762167004.454103:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.454104:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.454106:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167003 -> 1762167004 00002000:00010000:0.0:1762167004.454109:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.454110:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.454114:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167004.454116:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.454120:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 397 -> 177 00000100:00100000:1.0:1762167004.454169:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2358:x1847765451715584:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 242us (410us total) trans 17179875605 rc 0/0 00000100:00100000:0.0:1762167004.454175:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451715456:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 268us (447us total) trans 21474843125 rc 0/0 00000100:00100000:1.0:1762167004.454184:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16447 00000100:00100000:0.0:1762167004.454196:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16446 00002000:00010000:3.0:1762167004.454233:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167004.454238:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.454242:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167003 -> 1762167004 00002000:00010000:3.0:1762167004.454245:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.454247:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167004.454313:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451715712:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 358us (483us total) trans 21474843126 rc 0/0 00000100:00100000:3.0:1762167004.454321:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16448 00000100:00100000:0.0:1762167004.455420:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.455463:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451715968 00000100:00100000:2.0:1762167004.455469:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451715968 00000100:00100000:2.0:1762167004.455511:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7261 00000100:00100000:2.0:1762167004.455520:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56183:x1847765451715968:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167004.455578:0:33886:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09581 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb312d expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.455608:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.455619:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09485 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d2 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.455626:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e0 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.455633:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.455660:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e0 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.455672:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e0 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.455684:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454384256:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.455812:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09485 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d2 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.455827:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09485 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d2 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.455842:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454384384:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.455882:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.457097:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454384256:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.457110:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454384384:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.457130:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167004.457447:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.457512:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451716096 00000100:00100000:1.0:1762167004.457518:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451716096 00000100:00100000:0.0:1762167004.457532:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167004.457549:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09485 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d2 expref: 896 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.457582:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451716352 00000100:00100000:2.0:1762167004.457589:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451716352 00000100:00100000:1.0:1762167004.457597:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7329 00000100:00100000:1.0:1762167004.457609:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451716096:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.457624:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.457631:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09485 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d2 expref: 897 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.457639:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7262 00010000:00010000:1.0:1762167004.457646:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09485 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d2 expref: 897 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.457654:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:49238:x1847765451716352:12345-192.168.203.35@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1762167004.457671:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09485 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30d2 expref: 897 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.457687:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:1.0:1762167004.457692:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.457699:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.457705:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.457752:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451716096:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 145us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.457781:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7329 00000100:00100000:2.0:1762167004.457865:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:49238:x1847765451716352:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 216us (333us total) trans 8589952643 rc 0/0 00000100:00100000:2.0:1762167004.457873:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7262 00000100:00100000:0.0:1762167004.459043:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.459138:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451716480 00000100:00100000:3.0:1762167004.459145:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451716480 00010000:00010000:3.0:1762167004.459169:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e0 expref: 896 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.459203:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7330 00000100:00100000:3.0:1762167004.459212:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765451716480:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.459223:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.459228:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e0 expref: 896 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.459240:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e0 expref: 896 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.459256:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d094b6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb30e0 expref: 896 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.459271:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:3.0:1762167004.459276:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.459283:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.459295:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.459324:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.459360:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167004.459363:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765451716480:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 152us (322us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167004.459377:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167004.459380:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7330 00010000:00010000:2.0:1762167004.459418:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 3/0,1 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.459430:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d095e3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3149 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.459438:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 4/0,1 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.459469:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d095e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3149 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.459482:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d095e3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3149 expref: 894 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.459495:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454384512:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.459560:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.460489:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454384512:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.460509:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 3/0,1 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167004.460839:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.460878:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451716608 00000100:00100000:3.0:1762167004.460884:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451716608 00010000:00010000:3.0:1762167004.460907:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d095e3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3149 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.460956:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7331 00000100:00100000:1.0:1762167004.460968:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451716608:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.460981:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.460988:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d095e3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3149 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.461001:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d095e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3149 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.461018:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d095e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x645:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3149 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.461029:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167004.461034:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 3/0,1 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.461041:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.461047:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.461071:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.461098:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.461110:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167004.461110:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451716608:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 142us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.461125:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7331 00000100:00100000:2.0:1762167004.461516:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454384640:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.461560:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.461589:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e1173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.461610:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454384640 00000100:00100000:1.0:1762167004.461615:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454384640 00000100:00100000:1.0:1762167004.461651:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1762167004.461660:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454384640:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.461732:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454384640:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 73us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.461739:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1762167004.461793:0:33886:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843120 gen 2 00000004:00080000:2.0:1762167004.461800:0:33886:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843118 committed transno 21474843120 00000004:00080000:2.0:1762167004.461815:0:33886:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843120 committed transno 21474843120 00000100:00100000:2.0:1762167004.461828:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454384640:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.461866:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454384768:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.461891:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.461913:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34bd2b480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.461934:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454384768 00000100:00100000:1.0:1762167004.461940:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454384768 00000100:00100000:1.0:1762167004.461972:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1762167004.461979:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454384768:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.462041:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454384768:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 62us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.462049:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1762167004.462066:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454384768:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.462110:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454384896:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.462135:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.462155:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e1173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.462166:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454384896 00000100:00100000:1.0:1762167004.462172:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454384896 00000100:00100000:1.0:1762167004.462197:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1762167004.462203:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454384896:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.462254:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454384896:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.462260:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1762167004.462283:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454384896:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.462316:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385024:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.462341:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.462362:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.462373:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454385024 00000100:00100000:1.0:1762167004.462378:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454385024 00000100:00100000:1.0:1762167004.462414:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1762167004.462420:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454385024:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.462470:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454385024:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.462476:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1762167004.462499:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385024:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.462536:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385152:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.462560:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.462582:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e1173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.462589:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454385152 00000100:00100000:1.0:1762167004.462593:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454385152 00000100:00100000:1.0:1762167004.462617:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1762167004.462622:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454385152:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.462665:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454385152:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 44us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.462672:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:2.0:1762167004.462692:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385152:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.462731:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385280:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.462755:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.462800:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.462818:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454385280 00000100:00100000:1.0:1762167004.462823:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454385280 00000100:00100000:1.0:1762167004.462849:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1762167004.462855:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454385280:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.462892:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454385280:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 37us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.462897:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1762167004.462915:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385280:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.462951:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385408:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.462974:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.462995:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3413706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.462996:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454385408 00000100:00100000:1.0:1762167004.463002:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454385408 00000100:00100000:1.0:1762167004.463030:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1762167004.463036:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454385408:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.463089:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454385408:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.463098:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1762167004.463105:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385408:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.463141:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385536:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.463165:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.463184:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e1173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.463185:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454385536 00000100:00100000:1.0:1762167004.463191:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454385536 00000100:00100000:1.0:1762167004.463216:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1762167004.463222:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454385536:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.463271:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454385536:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 48us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.463278:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1762167004.463289:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385536:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.463324:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385664:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.463347:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.463367:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.463368:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454385664 00000100:00100000:1.0:1762167004.463374:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454385664 00000100:00100000:1.0:1762167004.463413:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1762167004.463422:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454385664:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.463472:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454385664:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 51us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.463479:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1762167004.463491:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385664:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.463521:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385792:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.463542:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.463562:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3413706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.463562:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454385792 00000100:00100000:1.0:1762167004.463566:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454385792 00000100:00100000:1.0:1762167004.463587:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1762167004.463591:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454385792:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.463625:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454385792:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 33us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.463630:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1762167004.463647:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385792:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.463682:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385920:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.463706:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.463723:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454385920 00000100:00100000:1.0:1762167004.463728:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454385920 00000100:00100000:2.0:1762167004.463729:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e1173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.463755:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1762167004.463791:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454385920:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.463836:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454385920:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 75us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.463840:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1762167004.463856:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454385920:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.463887:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454386048:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.463908:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.463930:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.463930:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454386048 00000100:00100000:1.0:1762167004.463936:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454386048 00000100:00100000:1.0:1762167004.463962:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1762167004.463968:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454386048:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.464012:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454386048:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.464017:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1762167004.464033:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454386048:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.464068:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454386176:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.464092:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.464110:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454386176 00000100:00100000:2.0:1762167004.464114:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3413706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.464114:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454386176 00000100:00100000:1.0:1762167004.464137:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1762167004.464144:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454386176:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.464192:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454386176:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 48us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.464198:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1762167004.464209:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454386176:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.464241:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454386304:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.464262:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.464282:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e1173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.464282:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454386304 00000100:00100000:1.0:1762167004.464287:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454386304 00000100:00100000:1.0:1762167004.464311:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1762167004.464320:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454386304:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.464365:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454386304:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 48us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.464372:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1762167004.464385:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454386304:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:2.0:1762167004.464670:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].45, 816 off59168 00000001:00080000:2.0:1762167004.464678:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952644 00000100:00100000:2.0:1762167004.464736:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454386432:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.464782:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.464803:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347174a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.464813:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454386432 00000100:00100000:1.0:1762167004.464819:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454386432 00000100:00100000:1.0:1762167004.464848:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1762167004.464856:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454386432:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.465097:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454386432:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 242us (334us total) trans 21474843127 rc 0/0 00000100:00100000:1.0:1762167004.465104:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1762167004.465135:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454386432:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.465162:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454386560:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.465186:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.465206:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347dc6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.465219:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454386560 00000100:00100000:1.0:1762167004.465224:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454386560 00000100:00100000:1.0:1762167004.465252:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1762167004.465259:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:33886:x1847765454386560:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.465433:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454386560:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 174us (245us total) trans 17179875606 rc 0/0 00000100:00100000:1.0:1762167004.465441:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1762167004.465467:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454386560:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:2.0:1762167004.465550:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952645 00010000:00010000:2.0:1762167004.465577:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465588:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465595:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465605:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.465609:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465617:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465631:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167004.465634:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167004.465638:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 2/0,0 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465644:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d095ff lrc: 0/0,0 mode: --/EX res: [0x200000404:0x645:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465662:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465668:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465673:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465678:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.465681:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465686:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465692:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.465694:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167004.465698:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465702:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d095f8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.465713:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167004.465716:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167004.465721:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09581 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb312d expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.465823:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56183:x1847765451715968:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 10304us (10405us total) trans 8589952646 rc 0/0 00000100:00100000:2.0:1762167004.465831:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7261 00000020:00080000:2.0:1762167004.465836:0:33886:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762167004.467110:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.467153:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451716736 00000100:00100000:2.0:1762167004.467160:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451716736 00000100:00100000:2.0:1762167004.467199:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19567 00000100:00100000:2.0:1762167004.467204:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56183:x1847765451716736:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.467220:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.467234:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09606 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3150 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.467294:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09606 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3150 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.467307:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09606 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3150 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.467323:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.467327:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167004.467329:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d000, rc 0) 00000100:00100000:2.0:1762167004.467371:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56183:x1847765451716736:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 165us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.467378:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19567 00000100:00100000:0.0:1762167004.468866:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.468919:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451716992 00000100:00100000:2.0:1762167004.468926:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451716992 00000100:00100000:2.0:1762167004.468976:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7263 00000100:00100000:2.0:1762167004.468991:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56183:x1847765451716992:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167004.469180:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56183:x1847765451716992:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 190us (316us total) trans 8589952647 rc 0/0 00000100:00100000:2.0:1762167004.469188:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7263 00000100:00100000:0.0:1762167004.470173:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.470218:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451717248 00000100:00100000:2.0:1762167004.470225:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451717248 00000100:00100000:2.0:1762167004.470267:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7264 00000100:00100000:2.0:1762167004.470275:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348213050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56183:x1847765451717248:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762167004.470501:0:33886:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x645:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762167004.470612:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x645:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.470627:0:33886:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.470638:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.470647:0:33886:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.470666:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.470677:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.470701:0:33886:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762167004.470727:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167004.470736:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.470745:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167004.470750:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.470759:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x645:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.470809:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x645:0x0].0x0 (ffff9ee2429d0500) 00010000:00010000:3.0:1762167004.470814:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1762167004.470816:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348213050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56183:x1847765451717248:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 539us (642us total) trans 8589952648 rc 0/0 00010000:00010000:3.0:1762167004.470819:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 1/0,0 mode: --/PW res: [0x200000404:0x645:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.470829:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0960d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x645:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167004.470832:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7264 00010000:00010000:3.0:1762167004.470848:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167004.470852:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167004.470855:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167004.481084:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.481168:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451717376 00000100:00100000:2.0:1762167004.481182:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451717376 00000100:00100000:2.0:1762167004.481255:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19568 00000100:00100000:2.0:1762167004.481266:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56184:x1847765451717376:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.481295:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.481320:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09614 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3157 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.481438:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0961b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481454:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0961b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481473:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0961b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481492:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09622 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481498:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09622 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481505:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09622 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481630:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481639:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481646:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.481685:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:2.0:1762167004.481690:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167004.481712:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481724:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481733:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0961b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481739:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0961b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481746:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0961b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481752:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.481756:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0961b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481792:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0961b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481806:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167004.481810:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167004.481815:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0961b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481826:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0961b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481838:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09622 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481845:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09622 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481850:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09622 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481855:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.481858:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09622 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481863:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09622 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481870:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167004.481873:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167004.481875:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09622 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481881:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09622 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.481915:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09614 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3157 expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.481928:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3157 expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.481936:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.481938:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167004.481941:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167004.482015:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56184:x1847765451717376:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 751us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.482023:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19568 00000100:00100000:0.0:1762167004.484022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.484077:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451717632 00000100:00100000:2.0:1762167004.484089:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451717632 00000100:00100000:2.0:1762167004.484156:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19569 00000100:00100000:2.0:1762167004.484168:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56184:x1847765451717632:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.484190:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.484212:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09630 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb315e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.484341:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09637 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.484358:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09637 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.484370:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09637 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.484383:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00010000:00010000:2.0:1762167004.484563:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09630 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb315e expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.484584:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09637 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb315e expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.484593:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.484596:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762167004.484599:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167004.484668:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56184:x1847765451717632:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 502us (653us total) trans 8589952649 rc 0/0 00000100:00100000:2.0:1762167004.484675:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19569 00000100:00100000:0.0:1762167004.486354:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.486443:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451717888 00000100:00100000:2.0:1762167004.486454:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451717888 00000100:00100000:2.0:1762167004.486522:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19570 00000100:00100000:2.0:1762167004.486533:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56184:x1847765451717888:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.486561:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.486581:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09645 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3165 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.486678:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0964c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.486693:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0964c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.486703:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0964c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.486716:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00010000:00010000:2.0:1762167004.486910:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09645 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3165 expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.486930:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0964c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3165 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.486939:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.486942:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167004.486946:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167004.487012:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56184:x1847765451717888:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 480us (667us total) trans 8589952650 rc 0/0 00000100:00100000:2.0:1762167004.487024:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19570 00000100:00100000:0.0:1762167004.512631:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.512709:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451718016 00000100:00100000:3.0:1762167004.512720:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451718016 00000100:00100000:3.0:1762167004.512805:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2704 00000100:00100000:3.0:1762167004.512817:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451718016:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167004.512852:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0965a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.512866:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.512868:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.512874:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0965a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.512888:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0965a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.514466:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0965a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.514496:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0965a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.514504:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0965a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.514511:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167004.514519:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0965a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.514533:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0965a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.514550:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0965a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.514557:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0965a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.514626:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451718016:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1809us (2002us total) trans 0 rc 92016/92016 00000100:00100000:3.0:1762167004.514636:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2704 00000100:00100000:0.0:1762167004.517372:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.517429:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451718144 00000100:00100000:3.0:1762167004.517439:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451718144 00000100:00100000:3.0:1762167004.517506:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2705 00000100:00100000:3.0:1762167004.517517:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451718144:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:3.0:1762167004.517566:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x818:0x0] initial LVB size: 92016, mtime: 0x690888dc, atime: 0x690888dc, ctime: 0x690888dc, blocks: 0x103 00010000:00010000:3.0:1762167004.517575:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09661 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.517588:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.517590:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.517594:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09661 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.517607:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09661 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.519970:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09661 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.519985:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09661 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.519991:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09661 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.519995:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167004.519998:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09661 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.520003:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09661 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.520015:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09661 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.520019:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09661 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.520093:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451718144:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2575us (2725us total) trans 0 rc 92016/92016 00000100:00100000:3.0:1762167004.520104:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2705 00000100:00100000:0.0:1762167004.527479:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.527546:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451718272 00000100:00100000:1.0:1762167004.527556:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451718272 00000100:00100000:1.0:1762167004.527626:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 625 00000100:00100000:1.0:1762167004.527638:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56184:x1847765451718272:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167004.527654:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.527690:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0964c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3165 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.527711:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:1.0:1762167004.527716:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.527812:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56184:x1847765451718272:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 175us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.527821:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 625 00000100:00100000:0.0:1762167004.528894:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.528949:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451718528 00000100:00100000:2.0:1762167004.528956:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451718528 00000100:00100000:2.0:1762167004.529000:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7265 00000100:00100000:2.0:1762167004.529010:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56184:x1847765451718528:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167004.529215:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56184:x1847765451718528:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 206us (325us total) trans 8589952651 rc 0/0 00000100:00100000:2.0:1762167004.529223:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7265 00000100:00100000:0.0:1762167004.531974:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.532055:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451718784 00000100:00100000:2.0:1762167004.532066:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451718784 00000100:00100000:2.0:1762167004.532134:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19571 00000100:00100000:2.0:1762167004.532146:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451718784:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167004.532169:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.532188:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09668 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb316c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.532289:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.532303:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3157 expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.532320:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.532353:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3157 expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.532365:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3157 expref: 904 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.532378:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454386688:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.532469:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8300 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.533826:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454386688:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.533860:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.534140:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.534230:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451718912 00000100:00100000:1.0:1762167004.534241:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451718912 00010000:00010000:1.0:1762167004.534276:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3157 expref: 905 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.534368:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7332 00000100:00100000:1.0:1762167004.534378:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2360:x1847765451718912:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.534392:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.534407:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3157 expref: 905 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.534420:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3157 expref: 905 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.534442:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09629 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3157 expref: 905 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.534457:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:1.0:1762167004.534462:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.534471:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.534479:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.534504:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.534535:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.534541:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.534554:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000100:00100000:1.0:1762167004.534570:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2360:x1847765451718912:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 184us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.534580:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7332 00010000:00010000:2.0:1762167004.534701:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09668 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb316c expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.534717:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb316c expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.534723:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.534726:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167004.534727:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167004.534807:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451718784:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2662us (2842us total) trans 8589952652 rc 0/0 00000100:00100000:2.0:1762167004.534814:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19571 00000100:00100000:0.0:1762167004.536516:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.536574:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451719040 00000100:00100000:2.0:1762167004.536581:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451719040 00000100:00100000:2.0:1762167004.536630:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19572 00000100:00100000:2.0:1762167004.536639:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451719040:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167004.536660:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.536675:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0967d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3173 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.536789:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.536802:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb316c expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.536810:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.536841:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb316c expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.536852:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb316c expref: 905 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.536865:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454386816:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.536948:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347dc6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.538389:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454386816:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.538423:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.539578:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.539637:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451719168 00000100:00100000:1.0:1762167004.539644:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451719168 00010000:00010000:1.0:1762167004.539682:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb316c expref: 906 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.539723:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7333 00000100:00100000:1.0:1762167004.539733:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2361:x1847765451719168:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.539748:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.539754:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb316c expref: 906 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.539782:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb316c expref: 906 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.539804:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0966f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb316c expref: 906 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.539819:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:1.0:1762167004.539823:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.539831:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.539838:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.539863:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.539919:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2361:x1847765451719168:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 186us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.539931:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7333 00010000:00010000:2.0:1762167004.540362:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.540373:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.540428:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:2.0:1762167004.540433:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167004.540453:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.540483:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0967d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3173 expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.540498:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3173 expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.540506:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.540509:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167004.540512:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:2.0:1762167004.540556:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451719040:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 3919us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.540568:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19572 00000100:00100000:0.0:1762167004.542111:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.542148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.542182:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451719296 00000100:00100000:3.0:1762167004.542190:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451719296 00000100:00100000:1.0:1762167004.542205:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451719424 00000100:00100000:1.0:1762167004.542211:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451719424 00000100:00100000:3.0:1762167004.542282:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16449 00000100:00100000:3.0:1762167004.542292:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451719296:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167004.542307:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.542324:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0968b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb317a expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.542335:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16450 00000100:00100000:1.0:1762167004.542347:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2358:x1847765451719424:12345-192.168.203.35@tcp:101:fsx.0 00002000:00010000:3.0:1762167004.542350:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x818:0x0] initial LVB size: 92016, mtime: 0x690888dc, atime: 0x690888dc, ctime: 0x690888dc, blocks: 0x103 00010000:00010000:1.0:1762167004.542356:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.542368:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.542371:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09692 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3181 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.542372:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.542381:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0968b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb317a expref: 21 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.542392:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.542396:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.542412:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0968b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb317a expref: 21 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.542414:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3181 expref: 38 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167004.542437:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00010000:00010000:1.0:1762167004.542438:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3181 expref: 38 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.542450:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7be00, rc 0) 00000100:00100000:3.0:1762167004.542482:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451719296:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 191us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.542488:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2358:x1847765451719424:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 143us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.542494:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16449 00000100:00100000:1.0:1762167004.542502:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16450 00000100:00100000:0.0:1762167004.544281:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.544331:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451719552 00000100:00100000:2.0:1762167004.544340:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451719552 00000100:00100000:2.0:1762167004.544411:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16451 00000100:00100000:2.0:1762167004.544423:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765451719552:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167004.544438:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.544458:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09699 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3188 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.544480:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.544482:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.544489:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3188 expref: 39 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.544503:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3188 expref: 39 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.544514:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:2.0:1762167004.544567:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765451719552:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 147us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.544574:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16451 00000100:00100000:3.0:1762167004.546143:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.546667:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451719680 00000100:00100000:2.0:1762167004.546676:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451719680 00000100:00100000:2.0:1762167004.546724:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16452 00000100:00100000:2.0:1762167004.546733:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765451719680:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167004.546748:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.546789:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d096a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb318f expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.546812:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.546814:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.546822:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d096a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb318f expref: 40 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.546838:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d096a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb318f expref: 40 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.546849:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:2.0:1762167004.546902:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765451719680:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 171us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.546909:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16452 00000100:00100000:0.0:1762167004.548555:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.548616:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451719808 00000100:00100000:3.0:1762167004.548623:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451719808 00002000:00100000:3.0:1762167004.548666:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x818:0x0] (53248->57343) req@ffff9ee37ff81880 x1847765451719808/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167004.548680:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff81880 with x1847765451719808 ext(53248->57343) 00002000:00010000:3.0:1762167004.548686:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff81880 00000100:00100000:3.0:1762167004.548714:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2706 00000100:00100000:3.0:1762167004.548724:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451719808:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762167004.548987:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451719808:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 263us (438us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762167004.548995:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2706 00002000:00100000:3.0:1762167004.549002:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x818:0x0] (53248->57343) req@ffff9ee37ff81880 x1847765451719808/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/4536 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167004.549010:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff81880 with x1847765451719808 ext(53248->57343) 00002000:00010000:3.0:1762167004.549014:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff81880 00000100:00100000:0.0:1762167004.550640:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.550759:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451719936 00000100:00100000:3.0:1762167004.550798:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451719936 00002000:00100000:3.0:1762167004.550839:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x818:0x0] (57344->61439) req@ffff9ee37ff81500 x1847765451719936/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167004.550849:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff81500 with x1847765451719936 ext(57344->61439) 00002000:00010000:3.0:1762167004.550855:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff81500 00000100:00100000:3.0:1762167004.550883:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2707 00000100:00100000:3.0:1762167004.550894:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451719936:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762167004.551056:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451719936:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 164us (422us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762167004.551064:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2707 00002000:00100000:3.0:1762167004.551071:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x818:0x0] (57344->61439) req@ffff9ee37ff81500 x1847765451719936/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/4536 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167004.551079:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff81500 with x1847765451719936 ext(57344->61439) 00002000:00010000:3.0:1762167004.551083:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff81500 00000100:00100000:0.0:1762167004.552888:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.552999:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451720064 00000100:00100000:1.0:1762167004.553006:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451720064 00002000:00100000:1.0:1762167004.553051:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x818:0x0] (32768->94207) req@ffff9ee37ff83480 x1847765451720064/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 504/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.553063:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff83480 with x1847765451720064 ext(32768->94207) 00002000:00010000:1.0:1762167004.553068:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff83480 00000100:00100000:1.0:1762167004.553102:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2708 00000100:00100000:1.0:1762167004.553111:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451720064:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:1.0:1762167004.554390:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451720064:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1276us (1506us total) trans 0 rc 53248/53248 00000100:00100000:1.0:1762167004.554412:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2708 00002000:00100000:1.0:1762167004.554422:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x818:0x0] (32768->94207) req@ffff9ee37ff83480 x1847765451720064/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 504/440 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 53248/53248 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167004.554432:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff83480 with x1847765451720064 ext(32768->94207) 00002000:00010000:1.0:1762167004.554437:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff83480 00000100:00100000:0.0:1762167004.555915:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.555969:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451720192 00000100:00100000:2.0:1762167004.555982:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451720192 00000100:00100000:2.0:1762167004.556048:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16453 00000100:00100000:2.0:1762167004.556064:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2359:x1847765451720192:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167004.556084:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.556106:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d096a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3196 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.556135:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.556138:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.556147:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d096a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3196 expref: 41 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.556166:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d096a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3196 expref: 41 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.556183:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167004.556256:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2359:x1847765451720192:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 198us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.556263:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16453 00000100:00100000:0.0:1762167004.558069:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.558142:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451720448 00000100:00100000:2.0:1762167004.558154:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451720448 00000100:00100000:2.0:1762167004.558220:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7266 00000100:00100000:2.0:1762167004.558232:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451720448:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167004.558592:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451720448:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 362us (530us total) trans 8589952653 rc 0/0 00000100:00100000:2.0:1762167004.558601:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7266 00000100:00100000:0.0:1762167004.568301:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.568377:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451720576 00000100:00100000:2.0:1762167004.568387:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451720576 00000100:00100000:2.0:1762167004.568466:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19573 00000100:00100000:2.0:1762167004.568477:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56185:x1847765451720576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.568501:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.568521:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d096ae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb319d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.568589:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096b5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568602:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568612:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568628:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096bc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568634:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568641:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568730:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d096c3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568735:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d096c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568740:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d096c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.568794:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:2.0:1762167004.568798:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167004.568816:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d096c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568826:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d096c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568835:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568841:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096b5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568848:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568862:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.568867:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568874:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096b5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568885:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167004.568889:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167004.568893:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568898:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568910:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568915:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096bc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568921:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568925:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.568928:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568934:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096bc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568941:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167004.568956:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167004.568959:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096bc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568968:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096bc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.568998:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d096ae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb319d expref: 907 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.569011:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d096c3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb319d expref: 906 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.569018:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.569020:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167004.569023:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167004.569071:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56185:x1847765451720576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 597us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.569077:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19573 00000100:00100000:0.0:1762167004.570547:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.570644:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451720704 00000100:00100000:3.0:1762167004.570653:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451720704 00000100:00100000:3.0:1762167004.570705:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 626 00000100:00100000:3.0:1762167004.570715:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2359:x1847765451720704:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.570863:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.570886:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d096c3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb319d expref: 906 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.570908:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00000100:00100000:0.0:1762167004.570912:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167004.570915:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167004.570966:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451720960 00000100:00100000:2.0:1762167004.570971:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451720960 00000100:00100000:3.0:1762167004.570972:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2359:x1847765451720704:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 256us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.570981:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 626 00000100:00100000:2.0:1762167004.571006:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19574 00000100:00100000:2.0:1762167004.571014:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56185:x1847765451720960:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.571027:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.571039:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d096ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31a4 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.571131:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.571149:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3173 expref: 906 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.571157:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.571184:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3173 expref: 906 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.571193:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3173 expref: 906 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.571203:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454386944:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.571256:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347174a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.572143:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454386944:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.572162:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167004.572531:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.572632:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451721088 00000100:00100000:3.0:1762167004.572637:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451721088 00010000:00010000:3.0:1762167004.572660:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3173 expref: 907 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.572695:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7334 00000100:00100000:3.0:1762167004.572705:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:2360:x1847765451721088:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.572715:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.572722:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3173 expref: 907 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.572733:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3173 expref: 907 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.572748:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09684 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3173 expref: 907 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.572795:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.572800:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167004.572808:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167004.572815:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167004.572839:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167004.572877:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2360:x1847765451721088:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 174us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.572882:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7334 00010000:00010000:2.0:1762167004.573002:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.573023:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167004.573047:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00010000:00010000:2.0:1762167004.573275:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d096ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31a4 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.573297:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31a4 expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.573307:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.573311:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167004.573314:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167004.573387:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56185:x1847765451720960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2372us (2476us total) trans 8589952654 rc 0/0 00000100:00100000:2.0:1762167004.573397:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19574 00000100:00100000:1.0:1762167004.574805:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.574881:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451721216 00000100:00100000:2.0:1762167004.574893:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451721216 00000100:00100000:2.0:1762167004.574946:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19575 00000100:00100000:2.0:1762167004.574956:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56185:x1847765451721216:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.574979:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.574995:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d096df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31ab expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.575072:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.575083:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31a4 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.575089:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.575114:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31a4 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.575123:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31a4 expref: 907 pid: 32138 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.575133:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454387072:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.575197:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8300 going to sleep for 11 seconds 00000100:00100000:0.0:1762167004.576671:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.576696:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454387072:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.576715:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167004.576802:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451721344 00000100:00100000:3.0:1762167004.576808:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451721344 00010000:00010000:3.0:1762167004.576834:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31a4 expref: 908 pid: 32138 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.576872:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7335 00000100:00100000:3.0:1762167004.576880:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2360:x1847765451721344:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.576892:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.576898:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31a4 expref: 908 pid: 32138 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.576910:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31a4 expref: 908 pid: 32138 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.576935:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d096d1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31a4 expref: 908 pid: 32138 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.576950:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.576955:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167004.576964:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167004.576971:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167004.576993:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.577023:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.577033:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167004.577044:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:2360:x1847765451721344:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 163us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.577052:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7335 00000004:00200000:2.0:1762167004.577071:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:2.0:1762167004.577076:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167004.577095:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.577124:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d096df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ab expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.577139:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ab expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.577147:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.577150:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167004.577153:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167004.577202:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56185:x1847765451721216:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2247us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.577213:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19575 00000100:00100000:0.0:1762167004.578327:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.578371:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451721600 00000100:00100000:2.0:1762167004.578377:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451721600 00000100:00100000:2.0:1762167004.578427:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7267 00000100:00100000:2.0:1762167004.578437:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56185:x1847765451721600:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167004.578633:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56185:x1847765451721600:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 198us (309us total) trans 8589952655 rc 0/0 00000100:00100000:2.0:1762167004.578641:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7267 00000100:00100000:0.0:1762167004.579992:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.580047:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451721856 00000100:00100000:2.0:1762167004.580054:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451721856 00000100:00100000:2.0:1762167004.580094:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19576 00000100:00100000:2.0:1762167004.580103:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56185:x1847765451721856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.580121:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.580124:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762167004.580144:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09637 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb315e expref: 907 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.580161:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.580165:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.580177:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31b2 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.580261:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d096f4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.580269:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d096f4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.580279:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d096f4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167004.580287:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00010000:00010000:2.0:1762167004.580376:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d096ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b2 expref: 909 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.580388:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d096f4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b2 expref: 908 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.580395:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.580397:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167004.580413:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167004.580456:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56185:x1847765451721856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 355us (468us total) trans 8589952656 rc 0/0 00000100:00100000:2.0:1762167004.580463:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19576 00000100:00100000:1.0:1762167004.581643:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.581717:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.581806:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451721984 00000100:00100000:0.0:1762167004.581813:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451721984 00000100:00100000:0.0:1762167004.581859:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451722112 00000100:00100000:0.0:1762167004.581865:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451722112 00000100:00100000:2.0:1762167004.581886:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16454 00000100:00100000:1.0:1762167004.581908:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16455 00000100:00100000:2.0:1762167004.581917:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451721984:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167004.581939:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2360:x1847765451722112:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167004.581977:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.581979:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.582028:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0968b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb317a expref: 21 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582035:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09573 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3126 expref: 41 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.582046:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.582051:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.582057:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.582058:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d096a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3196 expref: 41 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582121:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d096a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb318f expref: 41 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582129:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09699 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3188 expref: 41 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582137:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09692 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3181 expref: 41 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582144:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.582146:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.582150:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 8/0,1 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.582152:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0968b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb317a expref: 21 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582195:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3181 expref: 41 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582207:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09692 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3181 expref: 41 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.582221:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0968b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb317a expref: 21 pid: 6533 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.582225:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454387328:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.582244:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454387200:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.582304:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347dc6cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1762167004.582313:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3188 expref: 41 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582321:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09699 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3188 expref: 41 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.582329:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454387456:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167004.582362:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d096a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb318f expref: 41 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582372:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d096a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb318f expref: 41 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.582382:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454387584:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167004.582426:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d096a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3196 expref: 41 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582436:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d096a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3196 expref: 41 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.582446:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454387712:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167004.582489:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3126 expref: 41 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.582499:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09573 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3126 expref: 41 pid: 33894 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.582509:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454387840:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167004.582543:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.583965:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454387328:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.583977:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454387200:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167004.583985:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454387456:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167004.583999:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.584001:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454387584:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.584003:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.584018:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454387712:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.584031:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451722368 00000100:00100000:0.0:1762167004.584034:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.584038:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451722368 00000100:00100000:0.0:1762167004.584053:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167004.584063:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09699 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3188 expref: 42 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.584084:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451722240 00000100:00100000:1.0:1762167004.584089:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451722240 00010000:00010000:1.0:1762167004.584108:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09692 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3181 expref: 43 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.584112:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451722752 00000100:00100000:2.0:1762167004.584119:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451722752 00010000:00010000:2.0:1762167004.584141:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d096a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb318f expref: 44 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.584142:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7336 00000100:00100000:1.0:1762167004.584152:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:2359:x1847765451722368:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.584161:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762167004.584175:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7337 00010000:00010000:1.0:1762167004.584182:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09699 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3188 expref: 44 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.584188:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+44:2360:x1847765451722240:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.584205:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3188 expref: 44 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.584206:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.584229:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09699 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3188 expref: 44 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167004.584250:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7338 00000100:00100000:3.0:1762167004.584259:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:2359:x1847765451722752:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762167004.584261:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167004.584268:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762167004.584276:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.584313:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167004.584351:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09692 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3181 expref: 43 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:1.0:1762167004.584351:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.584356:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d096a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb318f expref: 43 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.584365:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3181 expref: 43 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.584377:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d096a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb318f expref: 43 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.584391:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09692 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3181 expref: 43 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.584408:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d096a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb318f expref: 43 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.584411:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:2359:x1847765451722368:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 246us (401us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167004.584416:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.584426:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.584426:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7336 00000100:00100000:3.0:1762167004.584444:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2359:x1847765451722752:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.584445:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765451722240:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 259us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.584447:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451722624 00000100:00100000:1.0:1762167004.584453:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451722624 00000100:00100000:2.0:1762167004.584457:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7337 00000100:00100000:3.0:1762167004.584467:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7338 00010000:00010000:1.0:1762167004.584473:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d096a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3196 expref: 40 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.584477:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451722496 00000100:00100000:2.0:1762167004.584482:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451722496 00000100:00100000:3.0:1762167004.584483:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451722880 00000100:00100000:3.0:1762167004.584486:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451722880 00000100:00100000:1.0:1762167004.584499:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7339 00010000:00010000:3.0:1762167004.584503:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09573 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3126 expref: 40 pid: 33894 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.584503:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0968b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb317a expref: 22 pid: 6533 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.584513:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765451722624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.584523:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762167004.584528:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7340 00000100:00100000:2.0:1762167004.584532:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7341 00010000:00010000:1.0:1762167004.584538:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d096a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3196 expref: 40 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167004.584540:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451722496:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167004.584540:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765451722880:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167004.584552:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.584557:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d096a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3196 expref: 40 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.584571:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09573 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3126 expref: 40 pid: 33894 timeout: 725 lvb_type: 1 00010000:00010000:1.0:1762167004.584575:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d096a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3196 expref: 40 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.584589:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09573 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3126 expref: 40 pid: 33894 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.584593:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.584599:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.584606:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.584607:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0968b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb317a expref: 22 pid: 6533 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.584609:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.584614:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.584617:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0968b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb317a expref: 22 pid: 6533 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.584629:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.584632:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0968b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb317a expref: 22 pid: 6533 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.584638:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765451722624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 127us (373us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167004.584647:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.584647:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.584650:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762167004.584651:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7339 00010000:00010000:3.0:1762167004.584654:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.584664:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.584669:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765451722880:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 131us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.584678:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7341 00010000:00010000:3.0:1762167004.584683:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.584706:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.584709:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d09573 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3126 expref: 37 pid: 33894 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167004.584711:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451722496:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (432us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167004.584722:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.584726:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7340 00000100:00100000:1.0:1762167004.584740:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454387840:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.584749:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.584758:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.584786:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.584794:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.584798:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.584804:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.584816:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.584820:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.584835:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.584836:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.584857:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09702 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.584865:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.584875:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.584883:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.584890:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7aa00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167004.584894:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.584902:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.584910:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451721984:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3009us (3269us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167004.584917:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.584922:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16454 00010000:00010000:1.0:1762167004.584931:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09709 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.584962:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167004.584976:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765451722112:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3054us (3257us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.584985:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16455 00000100:00100000:0.0:1762167004.586018:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.586060:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451723136 00000100:00100000:2.0:1762167004.586066:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451723136 00000100:00100000:2.0:1762167004.586111:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19577 00000100:00100000:2.0:1762167004.586119:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56185:x1847765451723136:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167004.586182:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762167004.586199:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d096e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ab expref: 908 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.586218:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09606 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3150 expref: 907 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.586228:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:2.0:1762167004.586232:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.586259:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.586270:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167004.586279:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000040:00080000:2.0:1762167004.586796:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5327, 88 off429168 00000004:00080000:2.0:1762167004.586804:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625379040552ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.586860:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5335, 88 off430288 00000004:00080000:2.0:1762167004.586866:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625379103599ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.586896:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5336, 88 off430376 00000004:00080000:2.0:1762167004.586902:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625379138560ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.586923:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5328, 88 off429256 00000004:00080000:2.0:1762167004.586928:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625379165238ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.587074:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5337, 88 off430464 00000004:00080000:2.0:1762167004.587080:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625379317369ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.587104:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5329, 88 off429344 00000004:00080000:2.0:1762167004.587107:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625379344152ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.587138:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5330, 88 off429432 00000004:00080000:2.0:1762167004.587142:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625379379159ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.587159:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5338, 88 off430552 00000004:00080000:2.0:1762167004.587162:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625379399924ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.587197:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5339, 88 off430640 00000004:00080000:2.0:1762167004.587202:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625379439373ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.587219:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5331, 88 off429520 00000004:00080000:2.0:1762167004.587223:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625379460492ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.587252:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5340, 88 off430728 00000004:00080000:2.0:1762167004.587257:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625379494679ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.587274:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5332, 88 off429608 00000004:00080000:2.0:1762167004.587278:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625379514988ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.587303:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5333, 88 off429696 00000004:00080000:2.0:1762167004.587308:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625379544824ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.587331:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5341, 88 off430816 00000004:00080000:2.0:1762167004.587335:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625379571834ns, next at 625562874244ns, rc = 0 00000001:00080000:1.0:1762167004.600706:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952657 is committed 00000004:00080000:1.0:1762167004.600717:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3455 committed 00000004:00080000:1.0:1762167004.600728:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3442 committed 00000004:00010000:3.0:1762167004.600735:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000e8cf423 reply state 0000000015524745 transno 8589952657 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00080000:1.0:1762167004.600746:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3441 committed 00000100:00100000:3.0:1762167004.600751:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1762167004.600752:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3454 committed 00000004:00080000:1.0:1762167004.600757:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3440 committed 00000004:00080000:1.0:1762167004.600759:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3453 committed 00000004:00080000:1.0:1762167004.600782:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3452 committed 00000004:00080000:1.0:1762167004.600785:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3439 committed 00000004:00080000:1.0:1762167004.600788:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3438 committed 00000004:00080000:1.0:1762167004.600790:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3451 committed 00000004:00080000:1.0:1762167004.600792:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3437 committed 00000004:00080000:1.0:1762167004.600795:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3450 committed 00000004:00080000:1.0:1762167004.600798:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3449 committed 00000004:00080000:1.0:1762167004.600801:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3436 committed 00000020:00080000:1.0:1762167004.600848:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee34bd2b480 refcount 2 committed 0 result 0 batchid 4294969177 00000020:00080000:1.0:1762167004.600853:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f942000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37fca8e40 00000020:00080000:1.0:1762167004.600857:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435e3d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee34bd2b180 00000020:00080000:1.0:1762167004.600861:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee2435e3200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee2432da400 00000020:00080000:1.0:1762167004.600866:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].45 00010000:00080000:3.0:1762167004.600881:0:32138:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000020:00080000:1.0:1762167004.600899:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969176 batchid updated 00000100:00100000:3.0:1762167004.600903:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56185:x1847765451723136:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 14779us (14883us total) trans 8589952657 rc 0/0 00000100:00100000:3.0:1762167004.600915:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19577 00000020:00080000:1.0:1762167004.600915:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969175 batchid updated 00000020:00080000:3.0:1762167004.600948:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969177 committed batchid 4294969176 00000100:00100000:0.0:1762167004.601010:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454387968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762167004.601065:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.601104:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454388480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762167004.601116:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454387968 00000100:00100000:1.0:1762167004.601125:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454387968 00000100:00100000:0.0:1762167004.601136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.601165:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454388992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167004.601167:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454388480 00000100:00100000:1.0:1762167004.601171:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454388480 00000100:00100000:0.0:1762167004.601198:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.601202:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16456 00000100:00100000:2.0:1762167004.601211:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454388992 00000100:00100000:1.0:1762167004.601213:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454387968:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.601218:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454388992 00000100:00100000:0.0:1762167004.601222:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454389504:0@lo:2:osp-syn-1-0.0 00002000:00080000:1.0:1762167004.601239:0:7858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2073 count 1 00000100:00100000:0.0:1762167004.601250:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.601262:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454389504 00010000:00010000:1.0:1762167004.601262:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.601267:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454389504 00000100:00100000:0.0:1762167004.601278:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00010000:00010000:1.0:1762167004.601284:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 35 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.601288:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454388352:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762167004.601299:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167004.601302:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1762167004.601304:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16457 00010000:00010000:1.0:1762167004.601307:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1762167004.601308:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969175 cancel update log [0x200000bd0:0x1:0x0].43: rc = 0 00000100:00100000:2.0:1762167004.601318:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454388480:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.601324:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1762167004.601338:0:12400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2066 count 1 00010000:00010000:1.0:1762167004.601347:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 35 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.601349:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454388864:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762167004.601356:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.601365:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 35 pid: 12400 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167004.601380:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09087 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f82 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167004.601385:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454390016:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167004.601395:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167004.601396:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.601409:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.601413:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1762167004.601426:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969176 cancel update log [0x200000bd0:0x1:0x0].44: rc = 0 00000100:00100000:0.0:1762167004.601429:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454389376:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1762167004.601440:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969176 00010000:00010000:2.0:1762167004.601441:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09087 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f82 expref: 19 pid: 7858 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167004.601452:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59840 going to sleep for 11 seconds 00010000:00010000:2.0:1762167004.601455:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09087 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f82 expref: 19 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.601459:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167004.601463:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.601481:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454389888:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167004.601487:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167004.601487:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454390144:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167004.601500:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167004.601509:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167004.601511:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.601517:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167004.601522:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1762167004.601526:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167004.601540:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454388352 00000100:00100000:2.0:1762167004.601544:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454388352 00010000:00010000:3.0:1762167004.601545:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00000100:00100000:0.0:1762167004.601549:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454388096:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762167004.601550:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167004.601556:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167004.601559:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454388864 00000100:00100000:2.0:1762167004.601563:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454388864 00010000:00010000:3.0:1762167004.601567:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09710 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167004.601578:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454389376 00000100:00100000:2.0:1762167004.601583:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454389376 00000100:00100000:0.0:1762167004.601584:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.601602:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454389888 00000100:00100000:0.0:1762167004.601603:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454388608:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.601607:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454389888 00000100:00100000:3.0:1762167004.601611:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454388096 00000100:00100000:3.0:1762167004.601618:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454388096 00000100:00100000:2.0:1762167004.601631:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16458 00000100:00100000:0.0:1762167004.601635:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.601645:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454388992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167004.601652:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454388608 00000100:00100000:0.0:1762167004.601653:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454389120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.601657:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454388608 00000100:00100000:3.0:1762167004.601681:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16459 00000100:00100000:0.0:1762167004.601684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.601693:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454389504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167004.601699:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454389632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.601724:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.601739:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1762167004.601746:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454388224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.601800:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.601819:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454388736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167004.601849:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454388992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (650us total) trans 17179875607 rc 0/0 00000100:00100000:2.0:1762167004.601859:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16458 00000100:00100000:0.0:1762167004.601861:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167004.601867:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:3.0:1762167004.601874:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.601878:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00000100:00100000:0.0:1762167004.601878:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454389248:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167004.601884:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.601889:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:2.0:1762167004.601893:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454389120 00000100:00100000:2.0:1762167004.601899:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454389120 00000100:00100000:0.0:1762167004.601910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.601919:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454389632 00000100:00100000:2.0:1762167004.601924:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454389632 00000100:00100000:0.0:1762167004.601928:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454389760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167004.601934:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3294:x1847765454389504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (683us total) trans 17179875608 rc 0/0 00000100:00100000:2.0:1762167004.601938:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454388224 00000100:00100000:2.0:1762167004.601942:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454388224 00000100:00100000:3.0:1762167004.601944:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16459 00000100:00100000:2.0:1762167004.601960:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454388736 00000100:00100000:0.0:1762167004.601960:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.601964:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454389248 00000100:00100000:2.0:1762167004.601965:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454388736 00000100:00100000:3.0:1762167004.601969:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454389248 00000100:00100000:2.0:1762167004.601983:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454389760 00000100:00100000:2.0:1762167004.601986:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454389760 00000100:00100000:3.0:1762167004.601993:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16460 00000100:00100000:3.0:1762167004.602002:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454388352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.602009:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16461 00000100:00100000:2.0:1762167004.602019:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454388864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167004.602095:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167004.602098:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167004.602101:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762167004.602104:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167004.602106:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167004.602141:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16462 00000100:00100000:3.0:1762167004.602142:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3294:x1847765454388352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (822us total) trans 17179875609 rc 0/0 00000100:00100000:3.0:1762167004.602152:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16460 00000100:00100000:0.0:1762167004.602155:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454389376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167004.602158:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167004.602163:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.602166:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.602169:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.602172:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167004.602173:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16463 00000100:00100000:3.0:1762167004.602184:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454389888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167004.602201:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454388864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (809us total) trans 21474843128 rc 0/0 00000100:00100000:2.0:1762167004.602206:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16461 00000100:00100000:2.0:1762167004.602222:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16464 00000100:00100000:2.0:1762167004.602228:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3295:x1847765454388096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762167004.602238:0:33892:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2069 count 1 00010000:00010000:2.0:1762167004.602247:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.602259:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d07c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2843 expref: 35 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.602266:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.602268:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.602271:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.602295:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d07c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2843 expref: 35 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167004.602297:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 130987 -> 130987 00002000:00010000:0.0:1762167004.602304:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167004.602309:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00010000:00010000:2.0:1762167004.602313:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d07c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2843 expref: 35 pid: 6535 timeout: 725 lvb_type: 0 00002000:00010000:0.0:1762167004.602314:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167004.602319:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167004.602333:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454390272:192.168.203.35@tcp:104: 00002000:00010000:3.0:1762167004.602360:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167004.602364:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.602367:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.602371:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167004.602371:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454389376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (910us total) trans 21474843129 rc 0/0 00002000:00010000:3.0:1762167004.602376:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167004.602386:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16462 00000100:00100000:2.0:1762167004.602397:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167004.602421:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16465 00000100:00100000:3.0:1762167004.602427:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454389888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 243us (921us total) trans 21474843130 rc 0/0 00000100:00100000:0.0:1762167004.602433:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3295:x1847765454388608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167004.602440:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16463 00000100:00100000:3.0:1762167004.602458:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16466 00000100:00100000:3.0:1762167004.602467:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454389120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167004.602554:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167004.602557:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.602560:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.602562:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.602565:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167004.602569:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167004.602572:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.602573:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167004.602575:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.602577:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167004.602607:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3295:x1847765454388608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (975us total) trans 17179875610 rc 0/0 00000100:00100000:0.0:1762167004.602618:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16465 00000100:00100000:0.0:1762167004.602636:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16467 00000100:00100000:0.0:1762167004.602644:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454389632:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167004.602647:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce7b80/2, rc 0, transno 17179875610 00000100:00100000:3.0:1762167004.602658:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454389120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (930us total) trans 21474843131 rc 0/0 00000100:00100000:3.0:1762167004.602668:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16466 00000100:00100000:1.0:1762167004.602672:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454388608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167004.602690:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16468 00000004:00080000:1.0:1762167004.602693:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4fb80/2, rc 0, transno 21474843131 00000100:00100000:3.0:1762167004.602702:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454388224:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762167004.602705:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454389120:0@lo:2:osp-syn-0-0.0 00002000:00080000:3.0:1762167004.602720:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2070 count 1 00002000:00010000:3.0:1762167004.602741:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x816:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888db, ctime: 0x690888db, blocks: 0x103 00002000:00010000:0.0:1762167004.602743:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:3.0:1762167004.602747:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0972c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167004.602748:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167004.602755:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167004.602788:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00010000:00010000:3.0:1762167004.602791:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1762167004.602792:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 1 -> 3 00010000:00010000:3.0:1762167004.602795:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.602802:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0972c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.602816:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0972c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.602826:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0972c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.602828:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454389632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (1102us total) trans 21474843132 rc 0/0 00000100:00100000:0.0:1762167004.602846:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16467 00010000:00010000:3.0:1762167004.602853:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0972c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.602867:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16469 00000100:00100000:0.0:1762167004.602876:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454388736:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167004.602883:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1762167004.602891:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454390528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167004.602923:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167004.602946:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4f480/2, rc 0, transno 21474843132 00000100:00100000:1.0:1762167004.602951:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454389632:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167004.602999:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:0.0:1762167004.603003:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00010000:00010000:2.0:1762167004.603005:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1762167004.603006:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.603012:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00010000:00010000:2.0:1762167004.603014:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0972c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167004.603015:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 177 -> 177 00010000:00010000:2.0:1762167004.603027:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.603032:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0972c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.603041:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0972c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.603055:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0972c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.603060:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454388736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (1202us total) trans 21474843133 rc 0/0 00010000:00010000:2.0:1762167004.603076:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0972c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.603077:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16469 00000100:00100000:0.0:1762167004.603101:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454390528 00010000:00010000:2.0:1762167004.603104:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167004.603107:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454390528 00010000:00010000:2.0:1762167004.603108:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1762167004.603109:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4d880/2, rc 0, transno 21474843133 00000100:00100000:1.0:1762167004.603117:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454388736:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762167004.603119:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167004.603135:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16470 00000100:00100000:0.0:1762167004.603146:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3295:x1847765454389248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167004.603256:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167004.603260:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167004.603262:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167004.603265:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167004.603267:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167004.603319:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1847765454389248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (1408us total) trans 17179875611 rc 0/0 00000100:00100000:0.0:1762167004.603326:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16470 00000100:00100000:0.0:1762167004.603346:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16471 00000100:00100000:0.0:1762167004.603355:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f549c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3295:x1847765454389760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167004.603375:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454388224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 676us (1578us total) trans 21474843134 rc 0/0 00000100:00100000:3.0:1762167004.603383:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16468 00000100:00100000:3.0:1762167004.603413:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16472 00000100:00100000:3.0:1762167004.603420:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3295:x1847765454390528:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167004.603463:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4ca80/2, rc 0, transno 21474843134 00000100:00100000:1.0:1762167004.603469:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454388224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.603477:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f549c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1847765454389760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (1520us total) trans 17179875612 rc 0/0 00000100:00100000:0.0:1762167004.603483:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16471 00000004:00080000:1.0:1762167004.603484:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce7100/2, rc 0, transno 17179875611 00000100:00100000:1.0:1762167004.603487:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454389248:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167004.603496:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce5500/2, rc 0, transno 17179875612 00000100:00100000:1.0:1762167004.603500:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454389760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167004.603548:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762167004.603558:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3295:x1847765454390528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (633us total) trans 17179875613 rc 0/0 00000100:00100000:0.0:1762167004.603559:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454390400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.603571:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16472 00000004:00080000:1.0:1762167004.603580:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354ed80/2, rc 0, transno 17179875613 00000100:00100000:1.0:1762167004.603587:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454390528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167004.603590:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.603620:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454390400 00000100:00100000:3.0:1762167004.603625:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454390400 00000004:00080000:0.0:1762167004.603646:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce6d80/2, rc 0, transno 17179875609 00000100:00100000:0.0:1762167004.603653:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454388352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.603661:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16473 00000004:00080000:0.0:1762167004.603666:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4e300/2, rc 0, transno 21474843128 00000100:00100000:0.0:1762167004.603673:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454388864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167004.603675:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454390400:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167004.603688:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4e680/2, rc 0, transno 21474843129 00000100:00100000:0.0:1762167004.603693:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454389376:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167004.603702:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28e00/2, rc 0, transno 21474843130 00000100:00100000:0.0:1762167004.603706:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454389888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167004.603716:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce5f80/2, rc 0, transno 17179875607 00000100:00100000:0.0:1762167004.603721:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454388992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167004.603731:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce7480/2, rc 0, transno 17179875608 00000100:00100000:0.0:1762167004.603734:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454389504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.603822:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454390400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (229us total) trans 21474843135 rc 0/0 00000100:00100000:2.0:1762167004.603829:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16473 00000004:00080000:0.0:1762167004.603871:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354f480/2, rc 0, transno 21474843135 00000100:00100000:0.0:1762167004.603876:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454390400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.604180:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.604198:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454390016:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.604206:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454390144:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.604207:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451723264 00000100:00100000:3.0:1762167004.604213:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451723264 00010000:00010000:1.0:1762167004.604221:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.604230:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.604246:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.604259:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19578 00000100:00100000:2.0:1762167004.604268:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454390272:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.604270:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56185:x1847765451723264:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:0.0:1762167004.604284:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167004.604287:0:33892:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.604290:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167004.604305:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451723392 00010000:00010000:3.0:1762167004.604308:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09733 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31b9 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.604309:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451723392 00010000:00010000:1.0:1762167004.604331:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 36 pid: 12400 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1762167004.604355:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167004.604356:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09733 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b9 expref: 891 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.604363:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451723520 00000100:00100000:1.0:1762167004.604367:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451723520 00010000:00010000:3.0:1762167004.604370:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09733 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b9 expref: 891 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604381:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09087 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f82 expref: 20 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1762167004.604382:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451723648 00010000:00010000:3.0:1762167004.604387:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00000100:00100000:0.0:1762167004.604389:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451723648 00000100:00100000:2.0:1762167004.604391:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7342 00010000:00010000:3.0:1762167004.604394:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167004.604411:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:2.0:1762167004.604417:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2360:x1847765451723392:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167004.604426:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d07c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2843 expref: 37 pid: 6535 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.604430:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7343 00010000:00010000:2.0:1762167004.604431:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167004.604442:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 37 pid: 12400 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.604445:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451723520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.604462:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167004.604470:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 37 pid: 12400 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.604471:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09087 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f82 expref: 20 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1762167004.604481:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7344 00000100:00100000:3.0:1762167004.604492:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56185:x1847765451723264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 223us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.604497:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2360:x1847765451723648:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.604498:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09087 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f82 expref: 20 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.604505:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d08e42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ee1 expref: 37 pid: 12400 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.604506:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19578 00010000:00010000:0.0:1762167004.604510:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.604518:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d07c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2843 expref: 37 pid: 6535 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.604528:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09087 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f82 expref: 20 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.604529:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.604533:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.604534:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d07c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2843 expref: 36 pid: 6535 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167004.604540:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604555:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.604557:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604560:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.604560:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d07c91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2843 expref: 36 pid: 6535 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.604567:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.604589:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.604592:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.604592:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.604597:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.604607:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167004.604617:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604626:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167004.604640:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451723392:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 236us (396us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167004.604641:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167004.604650:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7342 00000100:00100000:1.0:1762167004.604656:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451723520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 212us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.604666:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7343 00000100:00100000:0.0:1762167004.604671:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451723648:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 176us (316us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167004.604679:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.604682:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7344 00010000:00010000:2.0:1762167004.604693:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.604702:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.604710:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.604741:0:7858:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762167004.604811:0:33892:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.604820:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.604828:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.604835:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.604851:0:33892:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1762167004.604862:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1762167004.604869:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604879:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7aa00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167004.604883:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604893:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604906:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604914:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09717 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604931:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167004.604935:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604942:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167004.604945:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604954:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604963:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604967:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09725 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.604979:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167004.604981:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167004.604982:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762167004.605238:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3294:x1847765454387968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4027us (4172us total) trans 17179875614 rc 0/0 00000100:00100000:2.0:1762167004.605247:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16456 00000004:00080000:1.0:1762167004.605272:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce4000/2, rc 0, transno 17179875614 00010000:00010000:2.0:1762167004.605273:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.605281:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3295:x1847765454388096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3051us (3697us total) trans 17179875615 rc 0/0 00000100:00100000:1.0:1762167004.605282:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454387968:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762167004.605292:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.605298:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16464 00010000:00010000:2.0:1762167004.605314:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.605321:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.605323:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167004.605345:0:12400:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1762167004.605409:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce6300/2, rc 0, transno 17179875615 00000100:00100000:3.0:1762167004.605414:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454388096:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762167004.605498:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167004.605503:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.605511:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167004.605514:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.605522:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.605532:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.605539:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0971e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.605560:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167004.605562:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167004.605564:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762167004.605651:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454388480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4338us (4515us total) trans 21474843136 rc 0/0 00000100:00100000:2.0:1762167004.605658:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16457 00000004:00080000:1.0:1762167004.605672:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4c000/2, rc 0, transno 21474843136 00000100:00100000:1.0:1762167004.605677:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454388480:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.606380:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.606463:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451723776 00000100:00100000:3.0:1762167004.606469:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451723776 00000100:00100000:3.0:1762167004.606513:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19579 00000100:00100000:3.0:1762167004.606522:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56185:x1847765451723776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.606535:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.606548:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0973a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31c0 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.606615:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09741 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167004.606627:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09741 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167004.606636:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09741 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167004.606661:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:3.0:1762167004.606666:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167004.606690:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09741 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167004.606714:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0973a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c0 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.606727:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09741 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c0 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.606734:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.606737:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167004.606740:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922a00, rc 0) 00000100:00100000:3.0:1762167004.606811:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56185:x1847765451723776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 278us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.606819:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19579 00000100:00100000:0.0:1762167004.632294:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.632349:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451723904 00000100:00100000:2.0:1762167004.632360:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451723904 00000100:00100000:0.0:1762167004.632382:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.632424:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451724032 00000100:00100000:2.0:1762167004.632428:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451724032 00000100:00100000:2.0:1762167004.632454:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16474 00000100:00100000:2.0:1762167004.632464:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451723904:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:1.0:1762167004.632472:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16475 00010000:00010000:2.0:1762167004.632478:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167004.632488:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765451724032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167004.632499:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.632500:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09748 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31c7 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.632515:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0974f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31ce expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167004.632527:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x818:0x0] initial LVB size: 92016, mtime: 0x690888dc, atime: 0x690888dc, ctime: 0x690888dc, blocks: 0x103 00002000:00010000:1.0:1762167004.632535:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81b:0x0] initial LVB size: 0, mtime: 0x690888dc, atime: 0x690888dc, ctime: 0x690888dc, blocks: 0x1 00010000:00010000:2.0:1762167004.632546:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.632549:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.632550:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.632553:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.632563:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0974f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ce expref: 35 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.632564:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c7 expref: 20 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.632592:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0974f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ce expref: 35 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.632597:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c7 expref: 20 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.632614:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d200, rc 0) 00010000:00010000:1.0:1762167004.632614:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7aa00, rc 0) 00000100:00100000:1.0:1762167004.632674:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765451724032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 191us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.632676:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451723904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 213us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.632686:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16474 00000100:00100000:1.0:1762167004.632695:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16475 00000100:00100000:1.0:1762167004.634475:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.634542:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451724160 00000100:00100000:3.0:1762167004.634552:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451724160 00000100:00100000:3.0:1762167004.634633:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2709 00000100:00100000:3.0:1762167004.634644:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451724160:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167004.634685:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09756 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.634701:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.634703:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.634709:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09756 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.634721:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09756 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.637114:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09756 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.637136:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09756 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.637146:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.637155:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167004.637160:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.637174:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09756 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.637196:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09756 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.637203:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09756 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.637300:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451724160:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2651us (2829us total) trans 0 rc 92016/92016 00000100:00100000:3.0:1762167004.637312:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2709 00000100:00100000:0.0:1762167004.639536:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.639591:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451724288 00000100:00100000:3.0:1762167004.639603:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451724288 00000100:00100000:3.0:1762167004.639688:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2710 00000100:00100000:3.0:1762167004.639700:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451724288:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167004.639797:0:14117:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888d5, ctime: 0x690888db, blocks: 0x203 00010000:00010000:3.0:1762167004.639806:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0975d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.639819:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.639821:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.639827:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0975d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.639839:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0975d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167004.655445:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875606 is committed 00000001:00080000:3.0:1762167004.655446:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875615 is committed 00000001:00080000:1.0:1762167004.655466:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875605 is committed 00000001:00080000:1.0:1762167004.655513:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875616 is committed 00002000:00010000:0.0:1762167004.655615:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167003 -> 1762167004 00002000:00010000:0.0:1762167004.655620:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167003 -> 1762167004 00010000:00010000:0.0:1762167004.655634:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0975d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.655646:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0975d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.655655:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0975d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.655662:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167004.655667:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0975d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.655675:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0975d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.655694:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0975d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.655702:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0975d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.655849:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451724288:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16145us (16318us total) trans 17179875616 rc 0/0 00000100:00100000:0.0:1762167004.655860:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2710 00000100:00100000:0.0:1762167004.658576:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.658644:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451724416 00000100:00100000:3.0:1762167004.658656:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451724416 00000100:00100000:3.0:1762167004.658747:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2711 00000100:00100000:3.0:1762167004.658757:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451724416:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762167004.658843:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.658865:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08ef8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f12 expref: 20 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167004.658871:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.658873:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.658875:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.658918:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f12 expref: 20 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167004.658934:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f12 expref: 20 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167004.658953:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454390656:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.659052:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e1173c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.660280:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454390656:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167004.660309:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.660541:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.660605:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451724544 00000100:00100000:2.0:1762167004.660618:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451724544 00010000:00010000:2.0:1762167004.660660:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f12 expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.660706:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7345 00000100:00100000:2.0:1762167004.660717:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451724544:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167004.660740:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167004.660797:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f12 expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.660816:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f12 expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.660841:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d08ef8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f12 expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.660858:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.660861:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.660865:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.660874:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.660908:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.660965:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.660971:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451724544:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 254us (428us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167004.660984:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.660987:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7345 00000001:00080000:2.0:1762167004.675649:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843133 is committed 00000001:00080000:2.0:1762167004.675676:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843125 is committed 00000001:00080000:2.0:1762167004.675692:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843136 is committed 00000001:00080000:2.0:1762167004.675709:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843137 is committed 00002000:00010000:3.0:1762167004.675748:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167003 -> 1762167004 00002000:00010000:3.0:1762167004.675754:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167003 -> 1762167004 00010000:00010000:3.0:1762167004.675803:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.675816:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.675829:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.675837:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167004.675842:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.675851:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.675871:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.675878:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09764 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.675984:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451724416:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 17224us (17415us total) trans 21474843137 rc 0/0 00000100:00100000:3.0:1762167004.675995:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2711 00000100:00100000:1.0:1762167004.678159:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.678205:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451724672 00000100:00100000:3.0:1762167004.678214:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451724672 00000100:00100000:3.0:1762167004.678284:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2712 00000100:00100000:3.0:1762167004.678294:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451724672:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762167004.678321:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.678337:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0914b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc1 expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167004.678346:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.678348:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.678351:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.678382:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0914b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc1 expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167004.678392:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0914b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc1 expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167004.678416:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454390784:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.678474:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360510540 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.679471:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454390784:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167004.679488:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.679817:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.679895:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451724800 00000100:00100000:2.0:1762167004.679901:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451724800 00010000:00010000:2.0:1762167004.679927:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0914b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc1 expref: 22 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.679962:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7346 00000100:00100000:2.0:1762167004.679971:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451724800:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167004.679983:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167004.680002:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0914b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc1 expref: 22 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.680013:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0914b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc1 expref: 22 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.680037:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0914b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2fc1 expref: 22 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:2.0:1762167004.680051:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.680053:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.680057:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.680066:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.680091:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.680113:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.680125:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.680133:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451724800:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 161us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.680144:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7346 00000001:00080000:3.0:1762167004.691679:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875617 is committed 00002000:00010000:2.0:1762167004.691748:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167003 -> 1762167004 00002000:00010000:2.0:1762167004.691751:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167003 -> 1762167004 00010000:00010000:2.0:1762167004.691777:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.691785:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.691791:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.691795:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.691798:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.691815:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.691832:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.691840:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0976b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.691915:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451724672:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13620us (13760us total) trans 17179875617 rc 0/0 00000100:00100000:2.0:1762167004.691922:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2712 00000100:00100000:1.0:1762167004.693738:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.693813:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451724928 00000100:00100000:2.0:1762167004.693822:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451724928 00000100:00100000:2.0:1762167004.693886:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2713 00000100:00100000:2.0:1762167004.693895:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451724928:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167004.693935:0:14117:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 130987, mtime: 0x690888db, atime: 0x690888db, ctime: 0x690888db, blocks: 0x103 00010000:00010000:2.0:1762167004.693944:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09772 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.693955:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.693957:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.693963:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.693977:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167004.706739:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875618 is committed 00002000:00010000:3.0:1762167004.706825:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167003 -> 1762167004 00002000:00010000:3.0:1762167004.706831:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167003 -> 1762167004 00010000:00010000:3.0:1762167004.706843:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.706862:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.706868:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.706874:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167004.706878:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.706884:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09772 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.706900:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09772 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.706907:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09772 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.707003:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451724928:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13104us (13265us total) trans 17179875618 rc 0/0 00000100:00100000:3.0:1762167004.707013:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2713 00000100:00100000:0.0:1762167004.714363:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.714441:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451725184 00000100:00100000:3.0:1762167004.714450:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451725184 00000100:00100000:3.0:1762167004.714495:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19580 00000100:00100000:3.0:1762167004.714502:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56185:x1847765451725184:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167004.714548:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.714585:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09741 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c0 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.714604:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.714609:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.714888:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.714901:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.714910:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:3.0:1762167004.714963:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952658 00000004:00010000:3.0:1762167004.714989:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d6e4d35f reply state 000000002cc47885 transno 8589952659 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167004.714997:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167004.715066:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56185:x1847765451725184:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 565us (712us total) trans 8589952659 rc 0/0 00000100:00100000:3.0:1762167004.715071:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19580 00000020:00080000:3.0:1762167004.715075:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167004.715802:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.715813:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.715820:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.715830:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.715834:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.715841:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.715852:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.715855:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.715858:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.715863:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09779 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.716092:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.716144:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451725312 00000100:00100000:1.0:1762167004.716150:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451725312 00000100:00100000:1.0:1762167004.716186:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16476 00000100:00100000:1.0:1762167004.716194:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56185:x1847765451725312:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167004.716206:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167004.716235:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09780 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31d5 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167004.716260:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 130987, mtime: 0x690888dc, atime: 0x690888d5, ctime: 0x690888dc, blocks: 0x203 00010000:00010000:1.0:1762167004.716276:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.716278:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.716285:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09780 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31d5 expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.716299:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09780 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31d5 expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.716309:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7bc00, rc 0) 00000100:00100000:1.0:1762167004.716349:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56185:x1847765451725312:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 156us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.716355:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16476 00000100:00100000:0.0:1762167004.717378:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.717418:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451725440 00000100:00100000:3.0:1762167004.717423:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451725440 00002000:00010000:3.0:1762167004.717440:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (92016->18446744073709551615) 00002000:00100000:3.0:1762167004.717444:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccc700 with x1847765451725440 ext(92016->18446744073709551615) 00002000:00010000:3.0:1762167004.717451:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fccc700. 00000100:00100000:0.0:1762167004.717458:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.717533:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451725568 00000100:00100000:3.0:1762167004.717538:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451725568 00000100:00100000:2.0:1762167004.717547:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2714 00002000:00010000:3.0:1762167004.717554:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:3.0:1762167004.717557:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccfb80 with x1847765451725568 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167004.717562:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451725440:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167004.717565:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fccfb80. 00000100:00100000:3.0:1762167004.717602:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2715 00000100:00100000:3.0:1762167004.717611:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451725568:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167004.717929:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167004.717933:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167003 -> 1762167004 00002000:00010000:3.0:1762167004.717936:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167004.717939:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167003 -> 1762167004 00002000:00010000:3.0:1762167004.717942:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167004.717960:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 130987 -> 92016 00002000:00010000:2.0:1762167004.717964:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.717966:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167004.717968:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.717969:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167004.717990:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451725568:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 380us (532us total) trans 21474843138 rc 0/0 00000100:00100000:2.0:1762167004.717993:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451725440:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 437us (629us total) trans 17179875619 rc 0/0 00000100:00100000:3.0:1762167004.718006:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2715 00002000:00010000:3.0:1762167004.718011:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:3.0:1762167004.718016:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccfb80 with x1847765451725568 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167004.718016:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2714 00002000:00010000:2.0:1762167004.718020:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (92016->18446744073709551615) 00002000:00010000:3.0:1762167004.718024:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fccfb80. 00002000:00100000:2.0:1762167004.718024:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccc700 with x1847765451725440 ext(92016->18446744073709551615) 00002000:00010000:2.0:1762167004.718028:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fccc700. 00000100:00100000:3.0:1762167004.719035:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.719098:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451725696 00000100:00100000:0.0:1762167004.719104:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451725696 00000100:00100000:0.0:1762167004.719146:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19581 00000100:00100000:0.0:1762167004.719155:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56185:x1847765451725696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167004.719174:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167004.719188:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09787 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31dc expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.719257:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0978e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.719269:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0978e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.719279:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0978e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167004.719303:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:0.0:1762167004.719307:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167004.719321:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0978e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.719346:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09787 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31dc expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.719362:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0978e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31dc expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.719369:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:0.0:1762167004.719372:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167004.719375:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:0.0:1762167004.719428:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56185:x1847765451725696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 274us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.719435:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19581 00000100:00100000:0.0:1762167004.720753:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.720920:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451725952 00000100:00100000:3.0:1762167004.720927:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451725952 00000100:00100000:3.0:1762167004.720967:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19582 00000100:00100000:3.0:1762167004.720978:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56185:x1847765451725952:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167004.721016:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.721036:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0978e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31dc expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.721050:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.721054:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.721239:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.721251:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.721259:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:3.0:1762167004.721308:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952660 00000004:00010000:3.0:1762167004.721330:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e6587e89 reply state 00000000da4c1c2b transno 8589952661 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167004.721338:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167004.721415:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56185:x1847765451725952:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 439us (664us total) trans 8589952661 rc 0/0 00000100:00100000:3.0:1762167004.721422:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19582 00000020:00080000:3.0:1762167004.721426:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167004.722005:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.722013:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.722019:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.722025:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167004.722029:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.722036:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.722048:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:1.0:1762167004.722051:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167004.722054:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.722060:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09795 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.722297:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.722341:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451726080 00000100:00100000:1.0:1762167004.722347:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451726080 00000100:00100000:1.0:1762167004.722391:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16477 00000100:00100000:1.0:1762167004.722410:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56185:x1847765451726080:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167004.722420:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167004.722433:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0979c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31e3 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167004.722449:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 130987, mtime: 0x690888dc, atime: 0x690888db, ctime: 0x690888dc, blocks: 0x203 00010000:00010000:1.0:1762167004.722460:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.722461:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.722465:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0979c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31e3 expref: 18 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.722474:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0979c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31e3 expref: 18 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.722481:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ae00, rc 0) 00000100:00100000:1.0:1762167004.722513:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56185:x1847765451726080:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 116us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.722517:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16477 00000100:00100000:2.0:1762167004.723528:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.723566:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451726208 00000100:00100000:1.0:1762167004.723571:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451726208 00000100:00100000:1.0:1762167004.723604:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16478 00000100:00100000:1.0:1762167004.723613:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56185:x1847765451726208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167004.723624:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167004.723634:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31ea expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.723654:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f4a expref: 23 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.723662:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.723664:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.723668:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 23 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.723696:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f4a expref: 23 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167004.723709:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f4a expref: 23 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:1.0:1762167004.723723:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454390912:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167004.723822:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59840 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.724605:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454390912:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167004.724626:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 23 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.724639:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ac00, rc 0) 00000100:00100000:1.0:1762167004.724674:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56185:x1847765451726208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1062us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.724681:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16478 00000100:00100000:2.0:1762167004.724790:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.724945:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451726336 00000100:00100000:3.0:1762167004.724950:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451726336 00010000:00010000:3.0:1762167004.724969:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f4a expref: 23 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167004.725012:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7347 00000100:00100000:3.0:1762167004.725022:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451726336:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.725033:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.725052:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f4a expref: 23 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.725063:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f4a expref: 23 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.725081:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d08f8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f4a expref: 23 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.725092:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.725095:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.725100:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.725109:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.725145:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.725154:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765454391040:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167004.725191:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360510540 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.726230:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765454391040:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167004.726247:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167004.726296:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451726336:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1276us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.726306:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.726311:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7347 00000100:00100000:0.0:1762167004.726379:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451726592 00000100:00100000:0.0:1762167004.726386:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451726592 00000100:00100000:2.0:1762167004.726418:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:0.0:1762167004.726421:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167004.726426:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb4380 with x1847765451726592 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167004.726433:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fcb4380. 00000100:00100000:3.0:1762167004.726451:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451726464 00000100:00100000:0.0:1762167004.726455:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2716 00000100:00100000:3.0:1762167004.726456:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451726464 00000100:00100000:0.0:1762167004.726465:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451726592:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167004.726518:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (92016->18446744073709551615) 00002000:00100000:3.0:1762167004.726523:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343718e00 with x1847765451726464 ext(92016->18446744073709551615) 00002000:00010000:3.0:1762167004.726531:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee343718e00. 00000100:00100000:3.0:1762167004.726555:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2717 00000100:00100000:3.0:1762167004.726565:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451726464:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167004.726681:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167004.726685:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167003 -> 1762167005 00002000:00010000:0.0:1762167004.726689:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167004.726691:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167003 -> 1762167005 00002000:00010000:0.0:1762167004.726694:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167004.726731:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451726592:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 267us (428us total) trans 17179875620 rc 0/0 00000100:00100000:0.0:1762167004.726740:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2716 00002000:00010000:0.0:1762167004.726744:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167004.726748:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb4380 with x1847765451726592 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167004.726752:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fcb4380. 00002000:00010000:3.0:1762167004.726842:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 130987 -> 92016 00002000:00010000:3.0:1762167004.726847:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167004 -> 1762167005 00002000:00010000:3.0:1762167004.726849:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.726851:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167004 -> 1762167005 00002000:00010000:3.0:1762167004.726853:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167004.726945:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451726464:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 381us (526us total) trans 21474843139 rc 0/0 00000100:00100000:3.0:1762167004.726954:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2717 00002000:00010000:3.0:1762167004.726958:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (92016->18446744073709551615) 00002000:00100000:3.0:1762167004.726961:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343718e00 with x1847765451726464 ext(92016->18446744073709551615) 00002000:00010000:3.0:1762167004.726966:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee343718e00. 00000100:00100000:1.0:1762167004.727918:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.727959:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451726720 00000100:00100000:3.0:1762167004.727965:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451726720 00000100:00100000:3.0:1762167004.727999:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19583 00000100:00100000:3.0:1762167004.728004:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56185:x1847765451726720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.728017:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.728033:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d097aa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31f1 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.728102:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d097b1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.728114:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d097b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.728124:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d097b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.728146:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:3.0:1762167004.728150:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167004.728163:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d097b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.728180:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d097aa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f1 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.728190:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d097b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f1 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.728195:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.728197:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167004.728199:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167004.728227:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56185:x1847765451726720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 223us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.728231:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19583 00000100:00100000:2.0:1762167004.729529:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.729603:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451726976 00000100:00100000:3.0:1762167004.729610:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451726976 00000100:00100000:3.0:1762167004.729649:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19584 00000100:00100000:3.0:1762167004.729660:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56185:x1847765451726976:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167004.729697:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.729715:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d097b1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f1 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.729732:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.729737:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.729957:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.729969:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.729982:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:3.0:1762167004.730032:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952662 00000004:00010000:3.0:1762167004.730057:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000507dce8f reply state 000000006c0eafac transno 8589952663 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167004.730066:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167004.730144:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56185:x1847765451726976:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 485us (617us total) trans 8589952663 rc 0/0 00000100:00100000:3.0:1762167004.730151:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19584 00000020:00080000:3.0:1762167004.730155:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167004.731035:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.731045:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.731053:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.731060:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.731065:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.731072:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.731084:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.731088:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.731092:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.731103:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097b8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167004.731115:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.731160:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451727104 00000100:00100000:1.0:1762167004.731165:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451727104 00000100:00100000:1.0:1762167004.731194:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16479 00000100:00100000:1.0:1762167004.731201:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56185:x1847765451727104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167004.731216:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167004.731233:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d097bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31f8 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167004.731258:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 130987, mtime: 0x690888dc, atime: 0x690888da, ctime: 0x690888dc, blocks: 0x103 00010000:00010000:1.0:1762167004.731273:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.731275:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.731282:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d097bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f8 expref: 24 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.731296:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d097bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f8 expref: 24 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.731306:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b400, rc 0) 00000100:00100000:1.0:1762167004.731346:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56185:x1847765451727104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 146us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.731355:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16479 00000100:00100000:1.0:1762167004.732251:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.732307:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451727360 00000100:00100000:3.0:1762167004.732313:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451727360 00002000:00010000:3.0:1762167004.732335:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2069 (0->18446744073709551615) 00002000:00100000:3.0:1762167004.732339:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2438b8000 with x1847765451727360 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167004.732349:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2438b8000. 00000100:00100000:3.0:1762167004.732376:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2718 00000100:00100000:3.0:1762167004.732383:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451727360:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167004.732414:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.732444:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451727232 00000100:00100000:0.0:1762167004.732450:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451727232 00002000:00010000:0.0:1762167004.732470:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2072 (92016->18446744073709551615) 00002000:00100000:0.0:1762167004.732473:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f285f80 with x1847765451727232 ext(92016->18446744073709551615) 00002000:00010000:0.0:1762167004.732480:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36f285f80. 00000100:00100000:0.0:1762167004.732506:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2719 00000100:00100000:0.0:1762167004.732516:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451727232:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167004.732673:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167004.732678:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167003 -> 1762167005 00002000:00010000:3.0:1762167004.732681:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167004.732683:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167003 -> 1762167005 00002000:00010000:3.0:1762167004.732686:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167004.732721:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 130987 -> 92016 00002000:00010000:0.0:1762167004.732725:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167004 -> 1762167005 00002000:00010000:0.0:1762167004.732728:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00000100:00100000:3.0:1762167004.732732:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451727360:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 349us (483us total) trans 21474843140 rc 0/0 00000100:00100000:3.0:1762167004.732737:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2718 00002000:00010000:3.0:1762167004.732741:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2069 (0->18446744073709551615) 00002000:00010000:0.0:1762167004.732742:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167004 -> 1762167005 00002000:00100000:3.0:1762167004.732745:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2438b8000 with x1847765451727360 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167004.732749:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2438b8000. 00002000:00010000:0.0:1762167004.732750:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:0.0:1762167004.732802:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451727232:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 289us (403us total) trans 17179875621 rc 0/0 00000100:00100000:0.0:1762167004.732811:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2719 00002000:00010000:0.0:1762167004.732815:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2072 (92016->18446744073709551615) 00002000:00100000:0.0:1762167004.732818:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f285f80 with x1847765451727232 ext(92016->18446744073709551615) 00002000:00010000:0.0:1762167004.732824:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36f285f80. 00000100:00100000:1.0:1762167004.733872:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.733910:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451727488 00000100:00100000:3.0:1762167004.733916:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451727488 00000100:00100000:3.0:1762167004.733951:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19585 00000100:00100000:3.0:1762167004.733959:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56185:x1847765451727488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.733976:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.733991:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d097c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb31ff expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.734062:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d097cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.734072:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d097cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.734078:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d097cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.734098:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:3.0:1762167004.734102:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167004.734115:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d097cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.734137:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d097c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ff expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.734151:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d097cd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ff expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.734157:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.734160:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167004.734163:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167004.734199:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56185:x1847765451727488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 240us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.734205:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19585 00000100:00100000:1.0:1762167004.735366:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.735466:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451727744 00000100:00100000:3.0:1762167004.735472:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451727744 00000100:00100000:3.0:1762167004.735508:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19586 00000100:00100000:3.0:1762167004.735515:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56185:x1847765451727744:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167004.735544:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.735561:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d097cd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ff expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.735581:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.735585:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.735732:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.735741:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.735746:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:3.0:1762167004.735816:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952664 00000004:00010000:3.0:1762167004.735836:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f8f0a5bd reply state 000000009856d82f transno 8589952665 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167004.735842:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167004.735894:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56185:x1847765451727744:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 379us (530us total) trans 8589952665 rc 0/0 00000100:00100000:3.0:1762167004.735898:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19586 00000020:00080000:3.0:1762167004.735901:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167004.736562:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.736572:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.736579:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.736585:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167004.736588:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.736596:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.736607:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:1.0:1762167004.736610:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167004.736613:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.736619:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d097d4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167004.736854:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.736889:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451727872 00000100:00100000:0.0:1762167004.736893:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451727872 00000100:00100000:0.0:1762167004.736923:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16480 00000100:00100000:0.0:1762167004.736929:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56185:x1847765451727872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167004.736940:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167004.736956:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d097db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3206 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167004.736974:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 130987, mtime: 0x690888dc, atime: 0x690888db, ctime: 0x690888dc, blocks: 0x103 00010000:00010000:0.0:1762167004.736989:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.736991:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.736997:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d097db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3206 expref: 26 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.737010:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d097db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3206 expref: 26 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.737020:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:0.0:1762167004.737058:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56185:x1847765451727872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 129us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.737065:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16480 00000100:00100000:2.0:1762167004.737884:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.737929:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451728000 00000100:00100000:0.0:1762167004.737939:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451728000 00000100:00100000:0.0:1762167004.737972:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16481 00000100:00100000:0.0:1762167004.737981:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56185:x1847765451728000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167004.737991:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167004.738003:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb320d expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.738021:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d08f61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f3c expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167004.738029:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.738031:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.738034:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.738065:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d08f61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f3c expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167004.738078:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d08f61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f3c expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1762167004.738096:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454391168:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167004.738161:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167004.739100:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454391168:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167004.739121:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.739131:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8000, rc 0) 00000100:00100000:2.0:1762167004.739169:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.739169:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56185:x1847765451728000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1186us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.739180:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16481 00000100:00100000:3.0:1762167004.739249:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451728128 00000100:00100000:3.0:1762167004.739256:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451728128 00010000:00010000:3.0:1762167004.739316:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d08f61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f3c expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167004.739356:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7348 00000100:00100000:3.0:1762167004.739366:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451728128:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.739376:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.739394:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d08f61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f3c expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.739417:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d08f61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f3c expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.739436:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d08f61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2f3c expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.739449:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.739451:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.739455:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.739463:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.739489:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.739499:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454391296:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167004.739547:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360510d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.740628:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454391296:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167004.740645:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167004.740678:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451728128:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1314us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.740688:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7348 00000100:00100000:2.0:1762167004.740696:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.740751:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451728256 00000100:00100000:0.0:1762167004.740756:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451728256 00000100:00100000:2.0:1762167004.740784:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:0.0:1762167004.740806:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (92016->18446744073709551615) 00002000:00100000:0.0:1762167004.740812:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242523800 with x1847765451728256 ext(92016->18446744073709551615) 00000100:00100000:1.0:1762167004.740818:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451728384 00002000:00010000:0.0:1762167004.740821:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242523800. 00000100:00100000:1.0:1762167004.740825:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451728384 00002000:00010000:1.0:1762167004.740843:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:1.0:1762167004.740848:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242522d80 with x1847765451728384 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167004.740851:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2720 00002000:00010000:1.0:1762167004.740856:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242522d80. 00000100:00100000:0.0:1762167004.740864:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451728256:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167004.740883:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2721 00000100:00100000:1.0:1762167004.740895:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451728384:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167004.741144:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 130987 -> 92016 00002000:00010000:0.0:1762167004.741148:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167004 -> 1762167005 00002000:00010000:0.0:1762167004.741150:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167004.741151:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167004 -> 1762167005 00002000:00010000:0.0:1762167004.741153:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 259 -> 259 00002000:00010000:1.0:1762167004.741162:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167004.741167:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167003 -> 1762167005 00002000:00010000:1.0:1762167004.741171:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167004.741174:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167003 -> 1762167005 00002000:00010000:1.0:1762167004.741176:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167004.741196:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451728256:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 334us (503us total) trans 17179875622 rc 0/0 00000100:00100000:1.0:1762167004.741206:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451728384:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 313us (421us total) trans 21474843141 rc 0/0 00000100:00100000:0.0:1762167004.741207:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2720 00000100:00100000:1.0:1762167004.741220:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2721 00002000:00010000:0.0:1762167004.741220:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (92016->18446744073709551615) 00002000:00010000:1.0:1762167004.741227:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167004.741227:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242523800 with x1847765451728256 ext(92016->18446744073709551615) 00002000:00100000:1.0:1762167004.741233:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242522d80 with x1847765451728384 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167004.741237:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242523800. 00002000:00010000:1.0:1762167004.741241:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242522d80. 00000100:00100000:1.0:1762167004.742183:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.742225:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451728640 00000100:00100000:3.0:1762167004.742231:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451728640 00000100:00100000:3.0:1762167004.742272:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19587 00000100:00100000:3.0:1762167004.742280:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56185:x1847765451728640:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167004.742350:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.742364:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.742374:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:3.0:1762167004.742486:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000069d62bde reply state 0000000064b0c1a1 transno 8589952666 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167004.742494:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167004.742556:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56185:x1847765451728640:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 276us (375us total) trans 8589952666 rc 0/0 00000100:00100000:3.0:1762167004.742563:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19587 00010000:00010000:0.0:1762167004.743390:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.743421:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.743429:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.743436:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167004.743443:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.743457:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.743477:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:0.0:1762167004.743481:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167004.743489:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167004.743495:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167004.743506:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d097e9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167004.743564:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451728768 00000100:00100000:2.0:1762167004.743571:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451728768 00000100:00100000:2.0:1762167004.743604:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16482 00000100:00100000:2.0:1762167004.743611:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56185:x1847765451728768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.743620:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.743630:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3214 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.743647:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09748 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c7 expref: 22 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.743652:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.743654:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.743658:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.743686:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c7 expref: 22 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.743699:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c7 expref: 22 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.743712:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454391424:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.743795:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.744855:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454391424:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.744880:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.744902:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167004.744945:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56185:x1847765451728768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1333us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.744953:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16482 00000100:00100000:0.0:1762167004.745033:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.745103:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451728896 00000100:00100000:3.0:1762167004.745110:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451728896 00010000:00010000:3.0:1762167004.745131:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c7 expref: 22 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167004.745163:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7349 00000100:00100000:3.0:1762167004.745171:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451728896:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.745182:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.745199:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c7 expref: 22 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.745211:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c7 expref: 22 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.745229:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09748 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31c7 expref: 22 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.745240:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.745242:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.745246:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.745255:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.745280:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.745291:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454391552:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167004.745351:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3605109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.746150:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454391552:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167004.746164:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167004.746194:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451728896:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1024us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.746202:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7349 00000100:00100000:1.0:1762167004.746382:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.746448:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451729024 00000100:00100000:2.0:1762167004.746452:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451729024 00000100:00100000:2.0:1762167004.746481:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16483 00000100:00100000:2.0:1762167004.746487:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56185:x1847765451729024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.746495:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.746505:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb321b expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.746520:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0974f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ce expref: 28 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.746524:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.746526:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.746528:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.746544:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0974f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ce expref: 28 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.746559:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0974f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ce expref: 28 pid: 33892 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.746575:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454391680:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.746621:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.747523:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454391680:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.747541:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.747555:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00000100:00100000:2.0:1762167004.747591:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56185:x1847765451729024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1103us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.747598:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16483 00000100:00100000:1.0:1762167004.747845:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.747884:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451729152 00000100:00100000:3.0:1762167004.747891:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451729152 00010000:00010000:3.0:1762167004.747912:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0974f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ce expref: 28 pid: 33892 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167004.747942:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7350 00000100:00100000:3.0:1762167004.747952:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451729152:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.747963:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.747980:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0974f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ce expref: 28 pid: 33892 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.747992:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0974f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ce expref: 28 pid: 33892 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.748010:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0974f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ce expref: 28 pid: 33892 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167004.748021:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.748023:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.748028:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.748042:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.748067:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.748078:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765454391808:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167004.748129:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3605109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.748963:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765454391808:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167004.749036:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167004.749071:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451729152:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1120us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.749079:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7350 00000100:00100000:1.0:1762167004.749119:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.749196:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451729280 00000100:00100000:2.0:1762167004.749203:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451729280 00000100:00100000:2.0:1762167004.749248:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16484 00000100:00100000:2.0:1762167004.749260:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451729280:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:0.0:1762167004.749276:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.749320:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451729408 00000100:00100000:3.0:1762167004.749327:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451729408 00000100:00100000:3.0:1762167004.749366:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16485 00000100:00100000:3.0:1762167004.749382:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451729408:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762167004.749501:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:2.0:1762167004.749506:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.749509:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.749511:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb ctime from disk: 1762167004 -> 1762167005 00002000:00010000:2.0:1762167004.749514:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00002000:00010000:3.0:1762167004.749537:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167004.749542:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.749544:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.749547:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb ctime from disk: 1762167004 -> 1762167005 00002000:00010000:3.0:1762167004.749549:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167004.749556:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451729280:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 299us (438us total) trans 21474843142 rc 0/0 00000100:00100000:2.0:1762167004.749566:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16484 00000100:00100000:3.0:1762167004.749579:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451729408:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 203us (312us total) trans 17179875623 rc 0/0 00000100:00100000:3.0:1762167004.749591:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16485 00000100:00100000:1.0:1762167004.750681:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.750749:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451729664 00000100:00100000:2.0:1762167004.750757:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451729664 00000100:00100000:2.0:1762167004.750833:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7268 00000100:00100000:2.0:1762167004.750845:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56185:x1847765451729664:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167004.750918:0:33886:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d096f4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b2 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.750968:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.750982:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09733 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b9 expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.750989:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.751030:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09733 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b9 expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.751044:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09733 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b9 expref: 900 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.751058:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454391936:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.751128:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.752272:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454391936:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.752294:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167004.752395:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.752448:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451729792 00000100:00100000:3.0:1762167004.752490:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451729792 00010000:00010000:3.0:1762167004.752517:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09733 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b9 expref: 901 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.752551:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7351 00000100:00100000:3.0:1762167004.752562:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:2360:x1847765451729792:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.752575:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.752582:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09733 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b9 expref: 901 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.752592:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09733 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b9 expref: 901 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.752605:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09733 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b9 expref: 901 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.752617:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:3.0:1762167004.752621:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.752626:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.752632:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167004.752655:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.752685:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.752694:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167004.752701:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2360:x1847765451729792:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 140us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.752710:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7351 00000040:00080000:2.0:1762167004.753240:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5334, 88 off429784 00000004:00080000:2.0:1762167004.753249:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625545485859ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.753330:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5342, 88 off430904 00000004:00080000:2.0:1762167004.753337:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625545573844ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.753372:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5343, 88 off430992 00000004:00080000:2.0:1762167004.753377:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625545614134ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.753392:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5335, 88 off429872 00000004:00080000:2.0:1762167004.753397:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625545634171ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.753451:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5344, 88 off431080 00000004:00080000:2.0:1762167004.753456:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625545693761ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.753488:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5336, 88 off429960 00000004:00080000:2.0:1762167004.753493:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625545730256ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.753517:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5337, 88 off430048 00000004:00080000:2.0:1762167004.753520:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625545757384ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.753535:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5345, 88 off431168 00000004:00080000:2.0:1762167004.753538:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625545775161ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.753552:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5346, 88 off431256 00000004:00080000:2.0:1762167004.753554:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625545791729ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.753573:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5338, 88 off430136 00000004:00080000:2.0:1762167004.753577:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625545814677ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.753603:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5347, 88 off431344 00000004:00080000:2.0:1762167004.753608:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625545845081ns, next at 625562874244ns, rc = 0 00000040:00080000:2.0:1762167004.753635:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5339, 88 off430224 00000004:00080000:2.0:1762167004.753640:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625545877332ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.753668:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5340, 88 off430312 00000004:00080000:2.0:1762167004.753672:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625545909522ns, next at 625562909088ns, rc = 0 00000040:00080000:2.0:1762167004.753699:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5348, 88 off431432 00000004:00080000:2.0:1762167004.753704:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625545940856ns, next at 625562874244ns, rc = 0 00000001:00080000:1.0:1762167004.764787:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952667 is committed 00000004:00080000:1.0:1762167004.764801:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3462 committed 00000004:00010000:3.0:1762167004.764803:0:33886:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005506fd61 reply state 000000004c6210e2 transno 8589952667 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000004:00080000:1.0:1762167004.764812:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3449 committed 00000100:00100000:3.0:1762167004.764820:0:33886:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1762167004.764821:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3448 committed 00000004:00080000:1.0:1762167004.764825:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3461 committed 00000004:00080000:1.0:1762167004.764827:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3447 committed 00000004:00080000:1.0:1762167004.764829:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3460 committed 00000004:00080000:1.0:1762167004.764831:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3459 committed 00000004:00080000:1.0:1762167004.764833:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3446 committed 00010000:00010000:3.0:1762167004.764834:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00000004:00080000:1.0:1762167004.764835:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3445 committed 00000004:00080000:1.0:1762167004.764840:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3458 committed 00010000:00010000:3.0:1762167004.764841:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1762167004.764845:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3444 committed 00000004:00080000:1.0:1762167004.764850:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3457 committed 00010000:00010000:3.0:1762167004.764852:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d096f4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31b2 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167004.764853:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3456 committed 00000004:00080000:1.0:1762167004.764857:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3443 committed 00000020:00080000:1.0:1762167004.764903:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969177 batchid updated 00000100:00100000:1.0:1762167004.764937:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454392320:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1762167004.764985:0:33886:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762167004.764997:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.765004:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56185:x1847765451729664:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 14160us (14325us total) trans 8589952667 rc 0/0 00000100:00100000:3.0:1762167004.765018:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7268 00000100:00100000:1.0:1762167004.765044:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454392832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167004.765063:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454392064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167004.765071:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.765095:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.765101:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454393344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.765124:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454392320 00000100:00100000:0.0:1762167004.765126:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454392576:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.765134:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454392320 00000100:00100000:1.0:1762167004.765134:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.765164:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454392832 00000100:00100000:1.0:1762167004.765165:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1762167004.765169:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.765174:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454392832 00000100:00100000:1.0:1762167004.765175:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454392192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.765186:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454392064 00000100:00100000:2.0:1762167004.765191:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454392064 00000100:00100000:0.0:1762167004.765201:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454393088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167004.765203:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.765224:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454393344 00000100:00100000:2.0:1762167004.765227:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454392576 00000100:00100000:3.0:1762167004.765230:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454393344 00000100:00100000:2.0:1762167004.765232:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454392576 00000100:00100000:0.0:1762167004.765236:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454392448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167004.765251:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454392704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.765260:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454392192 00000100:00100000:3.0:1762167004.765266:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454392192 00000100:00100000:2.0:1762167004.765267:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16486 00000100:00100000:0.0:1762167004.765268:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.765283:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454392320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167004.765290:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16487 00000100:00100000:1.0:1762167004.765291:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.765293:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454392960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.765305:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454392832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167004.765314:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454393216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.765325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.765343:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454393472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167004.765348:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.765364:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454393728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.765374:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.765395:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.765426:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454392448 00000100:00100000:0.0:1762167004.765431:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454392448 00000020:00080000:1.0:1762167004.765433:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969177 00000100:00100000:0.0:1762167004.765452:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454392704 00000100:00100000:0.0:1762167004.765456:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454392704 00000100:00100000:0.0:1762167004.765473:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454392960 00000100:00100000:0.0:1762167004.765476:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454392960 00000100:00100000:0.0:1762167004.765493:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454393216 00000100:00100000:0.0:1762167004.765496:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454393216 00000100:00100000:0.0:1762167004.765513:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454393472 00002000:00010000:3.0:1762167004.765515:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167004.765516:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454393472 00002000:00010000:3.0:1762167004.765522:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167004.765526:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.765529:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167004.765532:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167004.765533:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454393728 00000100:00100000:0.0:1762167004.765536:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454393728 00002000:00010000:2.0:1762167004.765547:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167004.765552:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.765555:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.765557:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00000100:00100000:0.0:1762167004.765560:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16488 00002000:00010000:2.0:1762167004.765562:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167004.765572:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454392064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.765577:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454392832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 276us (504us total) trans 17179875624 rc 0/0 00000100:00100000:3.0:1762167004.765583:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16487 00000100:00100000:3.0:1762167004.765602:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16489 00000100:00100000:2.0:1762167004.765609:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454392320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 330us (613us total) trans 17179875625 rc 0/0 00000100:00100000:3.0:1762167004.765612:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454393344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.765630:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16486 00000100:00100000:2.0:1762167004.765654:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16490 00000020:00080000:1.0:1762167004.765656:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969177 cancel update log [0x200000bd0:0x1:0x0].45: rc = 0 00000100:00100000:2.0:1762167004.765664:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454392576:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1762167004.765670:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969177 00000100:00100000:1.0:1762167004.765691:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16491 00000100:00100000:1.0:1762167004.765701:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454392192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167004.765748:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:0.0:1762167004.765751:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.765753:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.765755:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.765757:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 177 -> 177 00002000:00010000:3.0:1762167004.765793:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:3.0:1762167004.765798:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167004.765801:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.765804:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167004.765806:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:0.0:1762167004.765810:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454392064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (714us total) trans 21474843143 rc 0/0 00000100:00100000:0.0:1762167004.765817:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16488 00000100:00100000:0.0:1762167004.765832:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16492 00002000:00010000:2.0:1762167004.765834:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:2.0:1762167004.765839:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00000100:00100000:0.0:1762167004.765843:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454392448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167004.765844:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00000100:00100000:3.0:1762167004.765850:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454393344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 239us (715us total) trans 17179875626 rc 0/0 00002000:00010000:2.0:1762167004.765851:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.765858:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167004.765860:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16489 00000100:00100000:3.0:1762167004.765878:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16493 00000100:00100000:3.0:1762167004.765887:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454392704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167004.765900:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167004.765902:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454392576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 240us (735us total) trans 17179875627 rc 0/0 00002000:00010000:1.0:1762167004.765906:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167004.765912:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1762167004.765915:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16490 00002000:00010000:1.0:1762167004.765916:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167004.765921:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167004.765937:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16494 00000100:00100000:2.0:1762167004.765948:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454392960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167004.765960:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454392192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 259us (755us total) trans 17179875628 rc 0/0 00000100:00100000:1.0:1762167004.765969:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16491 00002000:00010000:0.0:1762167004.765989:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167004.765991:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16495 00002000:00010000:0.0:1762167004.765996:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.766000:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00000100:00100000:1.0:1762167004.766002:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454393216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167004.766004:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.766008:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167004.766038:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167004.766042:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454392448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (778us total) trans 21474843144 rc 0/0 00002000:00010000:3.0:1762167004.766044:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.766051:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00000100:00100000:0.0:1762167004.766055:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16492 00002000:00010000:3.0:1762167004.766056:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.766061:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167004.766076:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16496 00000100:00100000:0.0:1762167004.766083:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454393472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167004.766091:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:2.0:1762167004.766096:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167004.766098:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:3.0:1762167004.766102:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454392704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (813us total) trans 21474843145 rc 0/0 00002000:00010000:2.0:1762167004.766103:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167004.766110:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167004.766115:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16493 00000100:00100000:3.0:1762167004.766140:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16497 00000100:00100000:3.0:1762167004.766151:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454393728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167004.766153:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454392960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (827us total) trans 21474843146 rc 0/0 00002000:00010000:1.0:1762167004.766153:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167004.766160:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167004.766168:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167004.766170:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167004.766174:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16494 00002000:00010000:1.0:1762167004.766174:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167004.766175:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167004.766181:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167004.766182:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167004.766184:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167004.766190:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167004.766230:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454393472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (855us total) trans 21474843148 rc 0/0 00000100:00100000:1.0:1762167004.766231:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454393216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (880us total) trans 21474843147 rc 0/0 00000100:00100000:0.0:1762167004.766239:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16496 00000100:00100000:1.0:1762167004.766248:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16495 00000100:00100000:0.0:1762167004.766281:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843136 gen 2 00000004:00080000:0.0:1762167004.766285:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843127 committed transno 21474843136 00002000:00010000:3.0:1762167004.766293:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:3.0:1762167004.766298:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.766301:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00000004:00080000:0.0:1762167004.766303:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4e300, transno 21474843128 00002000:00010000:3.0:1762167004.766304:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000100:00100000:1.0:1762167004.766309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167004.766311:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00000004:00080000:0.0:1762167004.766319:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4e680, transno 21474843129 00000004:00080000:0.0:1762167004.766324:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28e00, transno 21474843130 00000004:00080000:0.0:1762167004.766327:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4fb80, transno 21474843131 00000004:00080000:0.0:1762167004.766329:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4f480, transno 21474843132 00000004:00080000:0.0:1762167004.766332:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4d880, transno 21474843133 00000100:00100000:1.0:1762167004.766335:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454393600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167004.766337:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4ca80, transno 21474843134 00000004:00080000:0.0:1762167004.766343:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354f480, transno 21474843135 00000004:00080000:0.0:1762167004.766346:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4c000, transno 21474843136 00000100:00100000:3.0:1762167004.766352:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454393728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (954us total) trans 21474843149 rc 0/0 00000100:00100000:0.0:1762167004.766354:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37fccc380 x1847765454392448/t21474843144(21474843144) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167020 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1762167004.766372:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16497 00000004:00080000:0.0:1762167004.766372:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccc380/2, rc 0, transno 21474843144 00000100:00100000:1.0:1762167004.766376:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.766383:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454392448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.766396:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454393088 00000004:00080000:0.0:1762167004.766415:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcce300/2, rc 0, transno 21474843146 00000100:00100000:3.0:1762167004.766416:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454393088 00000100:00100000:0.0:1762167004.766423:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454392960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167004.766434:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccd880/2, rc 0, transno 21474843143 00000100:00100000:1.0:1762167004.766442:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454392064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167004.766442:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345730700/2, rc 0, transno 21474843148 00000100:00100000:3.0:1762167004.766450:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454393600 00000100:00100000:0.0:1762167004.766452:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454393472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.766456:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454393600 00000100:00100000:1.0:1762167004.766464:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875615 gen 2 00000004:00080000:1.0:1762167004.766469:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875581 committed transno 17179875615 00000100:00100000:3.0:1762167004.766489:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16498 00000004:00080000:1.0:1762167004.766489:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875582 committed transno 17179875615 00000100:00100000:0.0:1762167004.766500:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16499 00000004:00080000:1.0:1762167004.766502:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee374ab1500, transno 17179875583 00000100:00100000:3.0:1762167004.766505:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454393088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167004.766512:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454393600:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167004.766516:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24786a680, transno 17179875584 00000004:00080000:1.0:1762167004.766522:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247869c00, transno 17179875585 00000004:00080000:1.0:1762167004.766525:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247869880, transno 17179875586 00000004:00080000:1.0:1762167004.766527:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247868000, transno 17179875587 00000004:00080000:1.0:1762167004.766532:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247868e00, transno 17179875588 00000004:00080000:1.0:1762167004.766535:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24786ad80, transno 17179875589 00000004:00080000:1.0:1762167004.766539:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247869500, transno 17179875590 00000004:00080000:1.0:1762167004.766543:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247869180, transno 17179875591 00000004:00080000:1.0:1762167004.766548:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875601 committed transno 17179875615 00000004:00080000:1.0:1762167004.766562:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875602 committed transno 17179875615 00000004:00080000:2.0:1762167004.766578:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 7 in progress, 3 in flight, 9 done 00000004:00080000:1.0:1762167004.766582:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875606 committed transno 17179875615 00000004:00080000:1.0:1762167004.766596:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce5f80, transno 17179875607 00000004:00080000:1.0:1762167004.766599:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce7480, transno 17179875608 00000004:00080000:1.0:1762167004.766602:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce6d80, transno 17179875609 00000004:00080000:1.0:1762167004.766605:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce7b80, transno 17179875610 00000004:00080000:1.0:1762167004.766608:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce7100, transno 17179875611 00000004:00080000:1.0:1762167004.766612:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce5500, transno 17179875612 00000004:00080000:1.0:1762167004.766616:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354ed80, transno 17179875613 00000004:00080000:1.0:1762167004.766620:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce4000, transno 17179875614 00000004:00080000:1.0:1762167004.766623:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce6300, transno 17179875615 00000100:00100000:1.0:1762167004.766628:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee242520e00 x1847765454392576/t17179875627(17179875627) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167020 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762167004.766634:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242520e00/2, rc 0, transno 17179875627 00000100:00100000:1.0:1762167004.766638:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454392576:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167004.766647:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167004.766651:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.766657:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:0.0:1762167004.766660:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.766663:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167004.766665:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167004.766668:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167004.766669:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:1.0:1762167004.766672:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00002000:00010000:3.0:1762167004.766673:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167004.766679:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00010000:00010000:1.0:1762167004.766687:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.766695:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.766702:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167004.766707:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167004.766713:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454393600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (342us total) trans 17179875629 rc 0/0 00010000:00010000:1.0:1762167004.766718:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167004.766722:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16499 00000100:00100000:3.0:1762167004.766723:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454393088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (414us total) trans 17179875630 rc 0/0 00000004:00080000:2.0:1762167004.766736:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242523480/2, rc 0, transno 17179875630 00000100:00100000:3.0:1762167004.766742:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16498 00000100:00100000:2.0:1762167004.766746:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454393088:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762167004.766753:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0300) 00000004:00080000:2.0:1762167004.766757:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242521c00/2, rc 0, transno 17179875629 00010000:00010000:1.0:1762167004.766758:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762167004.766778:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454393600:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762167004.766785:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.766793:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d097fe lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00000004:00080000:1.0:1762167004.766939:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 7 in progress, 4 in flight, 18 done 00000004:00080000:1.0:1762167004.766961:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242520380/2, rc 0, transno 17179875628 00000100:00100000:1.0:1762167004.766966:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454392192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167004.766974:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccc000/2, rc 0, transno 21474843145 00000100:00100000:1.0:1762167004.766976:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454392704:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167004.766981:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345732300/2, rc 0, transno 21474843147 00000100:00100000:1.0:1762167004.766983:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454393216:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167004.766987:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345732680/2, rc 0, transno 21474843149 00000100:00100000:1.0:1762167004.766989:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454393728:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167004.766994:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242521f80/2, rc 0, transno 17179875624 00000100:00100000:1.0:1762167004.766995:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454392832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167004.766999:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242520700/2, rc 0, transno 17179875626 00000100:00100000:1.0:1762167004.767001:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454393344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167004.767004:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242521500/2, rc 0, transno 17179875625 00000100:00100000:1.0:1762167004.767006:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454392320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167004.768199:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.768288:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451729920 00000100:00100000:3.0:1762167004.768294:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451729920 00000100:00100000:3.0:1762167004.768341:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19588 00000100:00100000:3.0:1762167004.768351:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56185:x1847765451729920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.768370:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.768387:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d09805 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3222 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.768448:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d09805 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3222 expref: 890 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.768461:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d09805 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3222 expref: 890 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.768479:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167004.768482:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167004.768485:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:3.0:1762167004.768529:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56185:x1847765451729920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 180us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.768536:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19588 00000100:00100000:1.0:1762167004.770284:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.770335:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451730176 00000100:00100000:3.0:1762167004.770343:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451730176 00000100:00100000:3.0:1762167004.770392:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7269 00000100:00100000:3.0:1762167004.770416:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348213450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56185:x1847765451730176:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167004.770654:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348213450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56185:x1847765451730176:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 252us (374us total) trans 8589952668 rc 0/0 00000100:00100000:3.0:1762167004.770662:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7269 00000100:00100000:1.0:1762167004.779937:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.780003:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451730304 00000100:00100000:3.0:1762167004.780017:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451730304 00000100:00100000:3.0:1762167004.780081:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19589 00000100:00100000:3.0:1762167004.780092:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56186:x1847765451730304:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.780116:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.780136:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0980c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3229 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.780206:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09813 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780219:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09813 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780230:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09813 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780243:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0981a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780250:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0981a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780257:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0981a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780360:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780380:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780391:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.780436:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:3.0:1762167004.780441:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167004.780456:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780468:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780476:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09813 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780482:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09813 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780488:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09813 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780494:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.780498:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09813 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780505:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09813 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780517:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167004.780520:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.780525:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09813 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780530:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09813 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780542:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0981a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780548:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0981a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780553:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0981a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780558:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.780561:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0981a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780566:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0981a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780573:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23a00) 00010000:00010000:3.0:1762167004.780576:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.780579:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0981a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780585:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0981a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.780612:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0980c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3229 expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.780627:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3229 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.780636:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167004.780639:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167004.780641:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167004.780701:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56186:x1847765451730304:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 611us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.780709:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19589 00000100:00100000:0.0:1762167004.782221:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.782257:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451730560 00000100:00100000:3.0:1762167004.782265:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451730560 00000100:00100000:3.0:1762167004.782341:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19590 00000100:00100000:3.0:1762167004.782351:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56186:x1847765451730560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.782367:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.782379:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09828 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3230 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.782453:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0982f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.782462:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0982f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.782468:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0982f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.782475:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00010000:00010000:3.0:1762167004.782565:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09828 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3230 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.782577:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0982f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3230 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.782582:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167004.782584:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167004.782586:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167004.782622:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56186:x1847765451730560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 274us (406us total) trans 8589952669 rc 0/0 00000100:00100000:3.0:1762167004.782626:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19590 00000100:00100000:1.0:1762167004.784074:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.784120:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451730816 00000100:00100000:3.0:1762167004.784128:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451730816 00000100:00100000:3.0:1762167004.784177:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19591 00000100:00100000:3.0:1762167004.784184:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56186:x1847765451730816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.784198:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.784208:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0983d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3237 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.784292:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09844 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.784303:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09844 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.784313:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09844 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.784324:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00010000:00010000:3.0:1762167004.784424:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0983d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3237 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.784442:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09844 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3237 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.784451:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167004.784453:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167004.784455:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167004.784508:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56186:x1847765451730816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 324us (437us total) trans 8589952670 rc 0/0 00000100:00100000:3.0:1762167004.784516:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19591 00000100:00100000:1.0:1762167004.811254:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.811349:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451730944 00000100:00100000:3.0:1762167004.811364:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451730944 00000100:00100000:3.0:1762167004.811464:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2722 00000100:00100000:3.0:1762167004.811476:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451730944:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167004.811517:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09852 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.811532:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.811534:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.811539:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09852 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.811551:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09852 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.813268:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09852 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.813283:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09852 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.813291:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09852 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.813297:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.813302:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09852 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.813310:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09852 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.813327:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09852 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.813334:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09852 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.813415:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451730944:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1940us (2174us total) trans 0 rc 92016/92016 00000100:00100000:2.0:1762167004.813426:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2722 00000100:00100000:1.0:1762167004.815419:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.815476:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451731072 00000100:00100000:2.0:1762167004.815485:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451731072 00000100:00100000:2.0:1762167004.815557:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2723 00000100:00100000:2.0:1762167004.815565:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e445500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451731072:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167004.815592:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.815618:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31d5 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.815625:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.815628:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.815631:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.815664:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09780 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31d5 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.815677:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09780 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31d5 expref: 28 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.815692:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454393856:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.815793:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a780 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.817033:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454393856:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.817058:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.817155:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.817255:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451731200 00000100:00100000:3.0:1762167004.817261:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451731200 00010000:00010000:3.0:1762167004.817289:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09780 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31d5 expref: 29 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.817322:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7352 00000100:00100000:3.0:1762167004.817331:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451731200:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.817344:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.817366:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09780 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31d5 expref: 29 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.817378:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09780 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31d5 expref: 29 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.817407:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09780 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31d5 expref: 29 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.817422:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.817425:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.817429:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.817437:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.817456:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.817475:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.817483:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.817489:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451731200:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.817495:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7352 00010000:00010000:2.0:1762167004.818670:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.818684:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.818691:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.818698:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.818702:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.818710:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.818725:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.818732:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09859 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.818829:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e445500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451731072:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3262us (3426us total) trans 0 rc 92016/92016 00000100:00100000:2.0:1762167004.818837:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2723 00000100:00100000:1.0:1762167004.821070:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.821145:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451731328 00000100:00100000:2.0:1762167004.821155:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451731328 00000100:00100000:2.0:1762167004.821229:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2724 00000100:00100000:2.0:1762167004.821239:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451731328:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167004.821272:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.821291:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0979c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31e3 expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.821300:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.821303:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.821307:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.821340:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0979c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31e3 expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.821353:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0979c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31e3 expref: 22 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.821367:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454393984:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.821449:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a780 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.822617:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454393984:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.822640:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.822721:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.822851:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451731456 00000100:00100000:3.0:1762167004.822857:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451731456 00010000:00010000:3.0:1762167004.822886:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0979c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31e3 expref: 23 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.822920:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7353 00000100:00100000:3.0:1762167004.822927:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451731456:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167004.822938:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.822960:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0979c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31e3 expref: 23 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.822973:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0979c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31e3 expref: 23 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.823000:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0979c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31e3 expref: 23 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167004.823020:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.823021:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.823025:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.823034:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.823058:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.823081:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.823092:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167004.823100:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451731456:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 170us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.823111:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7353 00010000:00010000:2.0:1762167004.824199:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.824212:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.824220:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.824229:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.824233:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.824243:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.824256:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.824264:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09860 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.824326:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451731328:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3087us (3264us total) trans 0 rc 92016/92016 00000100:00100000:2.0:1762167004.824336:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2724 00000100:00100000:0.0:1762167004.826722:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.826811:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451731584 00000100:00100000:2.0:1762167004.826821:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451731584 00000100:00100000:2.0:1762167004.826893:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2725 00000100:00100000:2.0:1762167004.826903:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451731584:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167004.826936:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.826953:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d097bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f8 expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.826960:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.826963:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.826967:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.826996:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d097bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f8 expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.827010:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d097bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f8 expref: 27 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.827023:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454394112:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.827099:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a780 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.828167:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454394112:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.828190:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.828277:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.828324:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451731712 00000100:00100000:3.0:1762167004.828330:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451731712 00010000:00010000:3.0:1762167004.828357:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d097bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f8 expref: 28 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1762167004.828452:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7354 00000100:00100000:0.0:1762167004.828465:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451731712:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167004.828477:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.828498:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d097bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f8 expref: 28 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.828510:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d097bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f8 expref: 28 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.828530:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d097bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31f8 expref: 28 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.828542:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.828544:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.828548:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.828557:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.828587:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167004.828628:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451731712:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 167us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.828635:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7354 00010000:00010000:2.0:1762167004.828699:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.828709:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.830043:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.830059:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.830067:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.830075:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.830080:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.830088:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.830103:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.830110:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09867 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.830171:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451731584:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3268us (3455us total) trans 0 rc 92016/92016 00000100:00100000:2.0:1762167004.830180:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2725 00000100:00100000:1.0:1762167004.831995:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.832042:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451731840 00000100:00100000:2.0:1762167004.832051:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451731840 00000100:00100000:2.0:1762167004.832112:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2726 00000100:00100000:2.0:1762167004.832122:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451731840:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167004.832152:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.832170:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d097db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3206 expref: 26 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.832178:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.832180:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.832183:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.832214:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d097db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3206 expref: 26 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.832226:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d097db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3206 expref: 26 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.832240:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454394240:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.832307:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a780 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.833327:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454394240:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.833348:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.833528:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.833576:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451731968 00000100:00100000:0.0:1762167004.833582:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451731968 00010000:00010000:0.0:1762167004.833611:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d097db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3206 expref: 27 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1762167004.833642:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7355 00000100:00100000:0.0:1762167004.833652:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451731968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167004.833664:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.833683:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d097db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3206 expref: 27 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.833695:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d097db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3206 expref: 27 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.833715:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d097db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3206 expref: 27 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.833730:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.833731:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.833734:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.833741:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.833793:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.833796:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.833803:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.833839:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451731968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 188us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.833847:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7355 00010000:00010000:2.0:1762167004.835236:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.835250:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.835259:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.835266:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.835270:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.835278:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.835293:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.835300:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0986e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.835365:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765451731840:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3245us (3378us total) trans 0 rc 92016/92016 00000100:00100000:2.0:1762167004.835372:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2726 00000100:00100000:1.0:1762167004.837442:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.837505:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451732096 00000100:00100000:2.0:1762167004.837514:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451732096 00000100:00100000:2.0:1762167004.837574:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2727 00000100:00100000:2.0:1762167004.837583:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451732096:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167004.837613:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.837631:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.837639:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.837642:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167004.837645:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.837677:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.837690:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 21 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.837704:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454394368:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.837810:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a780 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.839127:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454394368:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.839148:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.839273:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.839315:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451732224 00000100:00100000:0.0:1762167004.839321:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451732224 00010000:00010000:0.0:1762167004.839353:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 22 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1762167004.839386:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7356 00000100:00100000:0.0:1762167004.839395:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451732224:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167004.839417:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.839437:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 22 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.839450:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 22 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.839470:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d097f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3214 expref: 22 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.839484:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.839485:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.839489:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.839498:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.839534:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.839571:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.839581:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.839588:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451732224:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 191us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.839599:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7356 00010000:00010000:2.0:1762167004.840983:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.840998:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.841006:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.841014:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167004.841018:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.841027:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.841041:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.841052:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09875 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.841118:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451732096:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3534us (3682us total) trans 0 rc 92016/92016 00000100:00100000:2.0:1762167004.841128:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2727 00000100:00100000:3.0:1762167004.847979:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.848035:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451732352 00000100:00100000:0.0:1762167004.848045:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451732352 00000100:00100000:0.0:1762167004.848109:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 627 00000100:00100000:0.0:1762167004.848121:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56186:x1847765451732352:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:0.0:1762167004.848135:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.848159:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09844 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3237 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.848176:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:0.0:1762167004.848181:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167004.848244:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56186:x1847765451732352:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.848252:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 627 00000100:00100000:1.0:1762167004.849188:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.849222:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451732608 00000100:00100000:3.0:1762167004.849227:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451732608 00000100:00100000:3.0:1762167004.849277:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7270 00000100:00100000:3.0:1762167004.849285:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56186:x1847765451732608:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167004.849495:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56186:x1847765451732608:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 211us (309us total) trans 8589952671 rc 0/0 00000100:00100000:3.0:1762167004.849503:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7270 00000100:00100000:1.0:1762167004.851555:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.851825:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451732864 00000100:00100000:3.0:1762167004.851834:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451732864 00000100:00100000:3.0:1762167004.851885:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19592 00000100:00100000:3.0:1762167004.851895:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451732864:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167004.851913:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.851928:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0987c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb323e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.852008:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.852023:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3229 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.852031:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.852063:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3229 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.852074:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3229 expref: 897 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.852084:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454394496:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.852147:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.853149:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454394496:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167004.853176:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167004.853377:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.853428:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451732992 00000100:00100000:0.0:1762167004.853433:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451732992 00010000:00010000:0.0:1762167004.853454:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3229 expref: 898 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1762167004.853481:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7357 00000100:00100000:0.0:1762167004.853490:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451732992:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167004.853501:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.853508:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3229 expref: 898 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.853521:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3229 expref: 898 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.853541:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09821 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3229 expref: 898 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.853558:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:0.0:1762167004.853562:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.853571:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.853578:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.853607:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167004.853651:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451732992:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 161us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.853658:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7357 00010000:00010000:3.0:1762167004.853673:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.853683:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.853702:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00010000:00010000:3.0:1762167004.853870:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0987c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb323e expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.853932:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb323e expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.853941:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167004.853944:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167004.853947:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:3.0:1762167004.853986:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451732864:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2092us (2438us total) trans 8589952672 rc 0/0 00000100:00100000:3.0:1762167004.853993:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19592 00000100:00100000:1.0:1762167004.854974:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.855022:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451733120 00000100:00100000:3.0:1762167004.855027:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451733120 00000100:00100000:3.0:1762167004.855055:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19593 00000100:00100000:3.0:1762167004.855061:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451733120:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167004.855074:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.855084:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09891 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3245 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.855132:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.855144:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb323e expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.855152:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.855178:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb323e expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.855191:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb323e expref: 898 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.855205:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454394624:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.855278:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.856275:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454394624:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167004.856299:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167004.856329:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.856372:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451733248 00000100:00100000:0.0:1762167004.856378:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451733248 00010000:00010000:0.0:1762167004.856413:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb323e expref: 899 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1762167004.856444:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7358 00000100:00100000:0.0:1762167004.856454:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2361:x1847765451733248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167004.856468:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.856473:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb323e expref: 899 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.856484:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb323e expref: 899 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.856500:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09883 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb323e expref: 899 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167004.856512:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:0.0:1762167004.856516:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.856524:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.856531:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167004.856552:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.856573:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.856582:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.856590:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451733248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 136us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.856599:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7358 00000004:00200000:3.0:1762167004.856615:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92016 00000004:00200000:3.0:1762167004.856620:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167004.856637:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.856665:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09891 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3245 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.856680:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3245 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.856688:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167004.856690:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167004.856693:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167004.856802:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451733120:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1739us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.856816:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19593 00000100:00100000:1.0:1762167004.857973:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.858045:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451733376 00000100:00100000:3.0:1762167004.858050:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451733376 00000100:00100000:3.0:1762167004.858083:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16500 00000100:00100000:3.0:1762167004.858093:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451733376:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167004.858105:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.858120:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0989f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb324c expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167004.858141:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 92016, mtime: 0x690888dd, atime: 0x690888da, ctime: 0x690888dd, blocks: 0x103 00010000:00010000:3.0:1762167004.858155:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.858157:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167004.858164:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0989f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb324c expref: 26 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167004.858178:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0989f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb324c expref: 26 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167004.858194:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:3.0:1762167004.858232:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451733376:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 141us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.858238:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16500 00000100:00100000:0.0:1762167004.859681:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.859747:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451733504 00000100:00100000:2.0:1762167004.859753:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451733504 00002000:00100000:2.0:1762167004.859824:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x818:0x0] (81920->94207) req@ffff9ee345730380 x1847765451733504/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.859834:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee345730380 with x1847765451733504 ext(81920->94207) 00002000:00010000:2.0:1762167004.859840:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee345730380 00000100:00100000:2.0:1762167004.859866:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2728 00000100:00100000:2.0:1762167004.859875:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451733504:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167004.860062:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451733504:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 187us (388us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1762167004.860070:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2728 00002000:00100000:2.0:1762167004.860078:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x818:0x0] (81920->94207) req@ffff9ee345730380 x1847765451733504/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/12728 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.860086:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee345730380 with x1847765451733504 ext(81920->94207) 00002000:00010000:2.0:1762167004.860090:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee345730380 00000100:00100000:1.0:1762167004.862330:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.862390:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451733632 00000100:00100000:2.0:1762167004.862408:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451733632 00002000:00100000:2.0:1762167004.862443:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x818:0x0] (0->81919) req@ffff9ee374ab2680 x1847765451733632/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.862453:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab2680 with x1847765451733632 ext(0->81919) 00002000:00010000:2.0:1762167004.862457:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374ab2680 00000100:00100000:2.0:1762167004.862485:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2729 00000100:00100000:2.0:1762167004.862494:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451733632:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167004.863759:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451733632:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1262us (1431us total) trans 0 rc 81920/81920 00000100:00100000:2.0:1762167004.863792:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2729 00002000:00100000:2.0:1762167004.863801:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x818:0x0] (0->81919) req@ffff9ee374ab2680 x1847765451733632/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/440 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 81920/81920 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.863811:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab2680 with x1847765451733632 ext(0->81919) 00002000:00010000:2.0:1762167004.863815:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374ab2680 00000100:00100000:0.0:1762167004.865815:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.865855:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451733888 00000100:00100000:3.0:1762167004.865864:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451733888 00000100:00100000:3.0:1762167004.865917:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19594 00000100:00100000:3.0:1762167004.865926:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451733888:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:3.0:1762167004.865969:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167004.865993:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09898 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3245 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.866011:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167004.866015:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.866224:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.866236:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.866244:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:3.0:1762167004.866290:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952673 00000004:00010000:3.0:1762167004.866314:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eff9cc9d reply state 00000000a033ac85 transno 8589952674 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167004.866322:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167004.866395:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451733888:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 470us (587us total) trans 8589952674 rc 0/0 00000100:00100000:3.0:1762167004.866414:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19594 00000020:00080000:3.0:1762167004.866420:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167004.867176:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.867188:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.867194:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.867199:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167004.867204:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.867218:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.867228:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:1.0:1762167004.867231:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167004.867235:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.867240:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d098a6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167004.867581:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.867628:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451734144 00000100:00100000:3.0:1762167004.867676:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451734144 00000100:00100000:3.0:1762167004.867715:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7271 00000100:00100000:3.0:1762167004.867726:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451734144:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167004.867985:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451734144:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 261us (404us total) trans 8589952675 rc 0/0 00000100:00100000:2.0:1762167004.867994:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7271 00000100:00100000:0.0:1762167004.869129:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.869178:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451734400 00000100:00100000:3.0:1762167004.869185:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451734400 00000100:00100000:3.0:1762167004.869231:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19595 00000100:00100000:3.0:1762167004.869240:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451734400:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167004.869256:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.869259:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762167004.869281:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0982f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3230 expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.869301:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d09805 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3222 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.869308:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167004.869316:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167004.869329:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098ad lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3253 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.869371:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.869382:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.869391:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000040:00080000:3.0:1762167004.869905:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5341, 88 off430400 00000004:00080000:3.0:1762167004.869914:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625662151110ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167004.869965:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5349, 88 off431520 00000004:00080000:3.0:1762167004.869970:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625662207086ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167004.870005:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5350, 88 off431608 00000004:00080000:3.0:1762167004.870009:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625662246036ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167004.870030:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5342, 88 off430488 00000004:00080000:3.0:1762167004.870036:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625662271856ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167004.870077:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5351, 88 off431696 00000004:00080000:3.0:1762167004.870082:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625662319351ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167004.870113:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5343, 88 off430576 00000004:00080000:3.0:1762167004.870119:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625662355892ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167004.870143:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5344, 88 off430664 00000004:00080000:3.0:1762167004.870147:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625662384500ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167004.870163:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5352, 88 off431784 00000004:00080000:3.0:1762167004.870166:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625662403588ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167004.870200:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5353, 88 off431872 00000004:00080000:3.0:1762167004.870205:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625662442387ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167004.870223:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5345, 88 off430752 00000004:00080000:3.0:1762167004.870227:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625662464662ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167004.870243:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5354, 88 off431960 00000004:00080000:3.0:1762167004.870247:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625662484718ns, next at 625562874244ns, rc = 0 00000040:00080000:3.0:1762167004.870265:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5346, 88 off430840 00000004:00080000:3.0:1762167004.870269:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625662506345ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167004.870286:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5347, 88 off430928 00000004:00080000:3.0:1762167004.870290:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625662527108ns, next at 625562909088ns, rc = 0 00000040:00080000:3.0:1762167004.870306:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5355, 88 off432048 00000004:00080000:3.0:1762167004.870310:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625662547050ns, next at 625562874244ns, rc = 0 00000001:00080000:1.0:1762167004.881950:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952675 is committed 00000001:00080000:1.0:1762167004.881967:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952676 is committed 00000004:00080000:1.0:1762167004.881973:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3469 committed 00000004:00080000:1.0:1762167004.882000:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3456 committed 00000004:00080000:1.0:1762167004.882017:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3455 committed 00000004:00080000:1.0:1762167004.882023:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3468 committed 00000004:00080000:1.0:1762167004.882027:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3454 committed 00000004:00080000:1.0:1762167004.882031:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3467 committed 00000004:00080000:1.0:1762167004.882036:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3466 committed 00000004:00080000:1.0:1762167004.882040:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3453 committed 00000004:00080000:1.0:1762167004.882042:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3452 committed 00000004:00080000:1.0:1762167004.882044:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3465 committed 00000004:00080000:1.0:1762167004.882045:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3451 committed 00000004:00080000:1.0:1762167004.882047:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3464 committed 00000004:00080000:1.0:1762167004.882048:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3463 committed 00000004:00080000:1.0:1762167004.882049:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3450 committed 00010000:00010000:3.0:1762167004.882081:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3253 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.882102:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:3.0:1762167004.882107:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762167004.882133:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098ad lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3253 expref: 891 pid: 30818 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1762167004.882149:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454394752:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167004.882167:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3253 expref: 890 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.882214:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:3.0:1762167004.882218:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762167004.882224:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:1.0:1762167004.882230:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.882306:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454395264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.882318:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451734400:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 13071us (13184us total) trans 8589952676 rc 0/0 00000100:00100000:0.0:1762167004.882329:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454394880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167004.882338:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19595 00000100:00100000:1.0:1762167004.882361:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.882391:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454395008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167004.882416:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454395776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.882418:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.882439:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454394752 00000100:00100000:3.0:1762167004.882451:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454394752 00000100:00100000:0.0:1762167004.882464:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454395392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.882475:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.882500:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454395264 00000100:00100000:1.0:1762167004.882513:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454395264 00000100:00100000:0.0:1762167004.882528:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.882530:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454394880 00000100:00100000:3.0:1762167004.882538:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454394880 00000100:00100000:2.0:1762167004.882539:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454395520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.882570:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454395904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167004.882574:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454395008 00000100:00100000:1.0:1762167004.882582:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454395008 00000100:00100000:2.0:1762167004.882589:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.882591:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454395392 00000100:00100000:3.0:1762167004.882598:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454395392 00000100:00100000:0.0:1762167004.882627:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.882632:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454396032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.882637:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454395520 00000100:00100000:3.0:1762167004.882643:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454395520 00000100:00100000:1.0:1762167004.882646:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454395904 00000100:00100000:1.0:1762167004.882654:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454395904 00000100:00100000:0.0:1762167004.882674:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454396416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.882681:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16501 00000100:00100000:2.0:1762167004.882698:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.882700:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454394752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167004.882709:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16502 00000100:00100000:0.0:1762167004.882722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.882728:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454395264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167004.882830:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454396032 00000100:00100000:0.0:1762167004.882833:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454396416 00000100:00100000:2.0:1762167004.882838:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454396032 00000100:00100000:0.0:1762167004.882841:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454396416 00000100:00100000:2.0:1762167004.882911:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16503 00000100:00100000:0.0:1762167004.882928:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16504 00000100:00100000:2.0:1762167004.882931:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454394880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167004.882945:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454395392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167004.883112:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:3.0:1762167004.883118:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.883122:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.883124:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.883127:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 177 -> 177 00002000:00010000:1.0:1762167004.883133:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167004.883140:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.883144:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.883147:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.883151:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167004.883174:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167004.883180:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167004.883183:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:3.0:1762167004.883190:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454394752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 491us (963us total) trans 21474843150 rc 0/0 00002000:00010000:0.0:1762167004.883192:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167004.883207:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167004.883211:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167004.883218:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16501 00000100:00100000:1.0:1762167004.883220:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454395264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 493us (854us total) trans 21474843151 rc 0/0 00002000:00010000:2.0:1762167004.883231:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167004.883237:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167004.883241:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000100:00100000:1.0:1762167004.883245:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16502 00002000:00010000:2.0:1762167004.883249:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167004.883265:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16505 00000100:00100000:3.0:1762167004.883288:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3296:x1847765454395008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167004.883289:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454395392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 340us (755us total) trans 17179875631 rc 0/0 00000100:00100000:1.0:1762167004.883290:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16506 00000100:00100000:1.0:1762167004.883318:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454395520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.883318:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16504 00000100:00100000:2.0:1762167004.883330:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454394880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 407us (912us total) trans 17179875632 rc 0/0 00000100:00100000:2.0:1762167004.883345:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16503 00000100:00100000:0.0:1762167004.883359:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16507 00000100:00100000:0.0:1762167004.883381:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454395904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.883389:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16508 00000100:00100000:2.0:1762167004.883422:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454396032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167004.883521:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167004.883526:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.883528:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.883532:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167004.883536:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167004.883575:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167004.883580:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.883584:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167004.883587:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.883591:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167004.883601:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3296:x1847765454395008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 325us (1131us total) trans 17179875633 rc 0/0 00000100:00100000:3.0:1762167004.883613:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16505 00000100:00100000:3.0:1762167004.883646:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16509 00000100:00100000:3.0:1762167004.883666:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454396416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167004.883667:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3296:x1847765454395520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 352us (1074us total) trans 21474843152 rc 0/0 00002000:00010000:2.0:1762167004.883672:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167004.883683:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454395904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 303us (1053us total) trans 17179875634 rc 0/0 00002000:00010000:2.0:1762167004.883686:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167004.883699:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00000100:00100000:1.0:1762167004.883710:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16506 00002000:00010000:2.0:1762167004.883712:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167004.883718:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167004.883725:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16507 00000100:00100000:2.0:1762167004.883813:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3296:x1847765454396032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 395us (1119us total) trans 21474843153 rc 0/0 00000100:00100000:2.0:1762167004.883827:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16508 00000004:00080000:1.0:1762167004.883867:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcced80/2, rc 0, transno 17179875632 00000100:00100000:2.0:1762167004.883875:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454395136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167004.883882:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454394880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167004.883896:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454396416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (1165us total) trans 21474843154 rc 0/0 00000100:00100000:3.0:1762167004.883909:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16509 00000004:00080000:1.0:1762167004.883914:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc33480/2, rc 0, transno 17179875631 00000100:00100000:1.0:1762167004.883923:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454395392:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167004.883946:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243304000/2, rc 0, transno 17179875634 00000100:00100000:2.0:1762167004.883948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.883959:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454395904:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167004.883977:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4e680/2, rc 0, transno 21474843154 00000100:00100000:1.0:1762167004.883984:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454396416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.883991:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454395136 00000100:00100000:3.0:1762167004.883999:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454395136 00000100:00100000:2.0:1762167004.884007:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454395648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167004.884048:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16510 00000100:00100000:2.0:1762167004.884052:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.884066:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3293:x1847765454395136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167004.884074:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454395648 00000100:00100000:0.0:1762167004.884084:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454395648 00000100:00100000:2.0:1762167004.884088:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454396160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.884132:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167004.884148:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454396160 00000100:00100000:0.0:1762167004.884157:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454396160 00000100:00100000:1.0:1762167004.884168:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16511 00000100:00100000:2.0:1762167004.884174:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762167004.884188:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3293:x1847765454395648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.884190:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454396288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167004.884211:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16512 00000100:00100000:0.0:1762167004.884228:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3293:x1847765454396160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167004.884237:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.884250:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3293:x1847765454395136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (298us total) trans 17179875635 rc 0/0 00000100:00100000:3.0:1762167004.884260:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16510 00000004:00080000:2.0:1762167004.884287:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fa98e00/2, rc 0, transno 17179875635 00000100:00100000:3.0:1762167004.884288:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454396288 00000100:00100000:3.0:1762167004.884294:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454396288 00000100:00100000:2.0:1762167004.884299:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454395136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167004.884324:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16513 00000100:00100000:3.0:1762167004.884338:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3293:x1847765454396288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167004.884368:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167004.884424:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:1.0:1762167004.884431:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167004.884435:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167004.884438:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000004:00080000:2.0:1762167004.884440:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242520a80/2, rc 0, transno 21474843150 00002000:00010000:1.0:1762167004.884443:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:2.0:1762167004.884452:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454394752:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167004.884463:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167004.884469:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.884473:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167004.884477:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167004.884479:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:2.0:1762167004.884481:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242521180/2, rc 0, transno 21474843151 00000100:00100000:2.0:1762167004.884491:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454395264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167004.884529:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454395776 00000100:00100000:2.0:1762167004.884534:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454395776 00000100:00100000:1.0:1762167004.884537:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3293:x1847765454395648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 352us (487us total) trans 17179875636 rc 0/0 00002000:00010000:3.0:1762167004.884554:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167004.884554:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16511 00000100:00100000:0.0:1762167004.884560:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3293:x1847765454396160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 333us (424us total) trans 17179875637 rc 0/0 00002000:00010000:3.0:1762167004.884566:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167004.884580:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167004.884586:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167004.884586:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16514 00002000:00010000:3.0:1762167004.884592:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167004.884599:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16512 00000100:00100000:2.0:1762167004.884603:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454395776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167004.884644:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3293:x1847765454396288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 310us (408us total) trans 21474843155 rc 0/0 00000100:00100000:3.0:1762167004.884651:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16513 00000004:00080000:3.0:1762167004.884693:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240e300/2, rc 0, transno 17179875633 00000100:00100000:3.0:1762167004.884698:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454395008:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167004.884714:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242522a00/2, rc 0, transno 21474843152 00000100:00100000:3.0:1762167004.884719:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454395520:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167004.884730:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4f800/2, rc 0, transno 21474843153 00000100:00100000:3.0:1762167004.884734:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454396032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167004.884791:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454395776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (397us total) trans 21474843156 rc 0/0 00000100:00100000:2.0:1762167004.884806:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16514 00000004:00080000:1.0:1762167004.884840:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28e00/2, rc 0, transno 21474843156 00000100:00100000:1.0:1762167004.884852:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454395776:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167004.884964:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4e300/2, rc 0, transno 21474843155 00000100:00100000:3.0:1762167004.884972:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454396288:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167004.884985:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243305880/2, rc 0, transno 17179875636 00000100:00100000:3.0:1762167004.884990:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454395648:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167004.885002:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243305500/2, rc 0, transno 17179875637 00000100:00100000:3.0:1762167004.885006:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454396160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167004.888154:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.888261:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451734528 00000100:00100000:2.0:1762167004.888270:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451734528 00000100:00100000:2.0:1762167004.888340:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16515 00000100:00100000:2.0:1762167004.888352:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56065:x1847765451734528:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167004.888370:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.888387:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb325a expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.888429:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d095a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3134 expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.888438:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.888440:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.888444:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 21 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.888476:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d095a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3134 expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.888490:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d095a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3134 expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.888504:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454396544:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.888587:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.889982:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454396544:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.890016:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167004.890016:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 21 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.890035:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:0.0:1762167004.890079:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451734656 00000100:00100000:0.0:1762167004.890087:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451734656 00000100:00100000:2.0:1762167004.890094:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56065:x1847765451734528:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1743us (1947us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.890103:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16515 00010000:00010000:0.0:1762167004.890118:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d095a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3134 expref: 22 pid: 7858 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1762167004.890155:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7359 00000100:00100000:0.0:1762167004.890165:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451734656:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167004.890177:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.890197:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d095a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3134 expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1762167004.890208:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d095a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3134 expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1762167004.890228:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d095a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3134 expref: 21 pid: 7858 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1762167004.890245:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.890247:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.890254:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.890264:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.890294:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.890306:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454396672:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167004.890362:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167004.891598:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454396672:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762167004.891618:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167004.891623:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.891660:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451734656:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1496us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.891668:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451734784 00000100:00100000:0.0:1762167004.891672:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7359 00000100:00100000:2.0:1762167004.891676:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451734784 00000100:00100000:2.0:1762167004.891715:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16516 00000100:00100000:2.0:1762167004.891725:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56065:x1847765451734784:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167004.891736:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.891750:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3261 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.891796:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d095ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb313b expref: 27 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.891805:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.891807:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.891810:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.891834:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d095ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb313b expref: 27 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.891848:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d095ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb313b expref: 27 pid: 6533 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.891860:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454396800:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.891908:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.892959:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454396800:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.892982:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.892998:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:2.0:1762167004.893042:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451734784:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1320us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.893050:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16516 00000100:00100000:3.0:1762167004.893195:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.893276:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451734912 00000100:00100000:0.0:1762167004.893282:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451734912 00010000:00010000:0.0:1762167004.893306:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d095ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb313b expref: 27 pid: 6533 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1762167004.893344:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7360 00000100:00100000:0.0:1762167004.893353:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451734912:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167004.893365:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.893395:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d095ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb313b expref: 27 pid: 6533 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1762167004.893419:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d095ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb313b expref: 27 pid: 6533 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1762167004.893440:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d095ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb313b expref: 27 pid: 6533 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1762167004.893451:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.893452:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167004.893458:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.893467:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.893496:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 26 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.893509:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765454396928:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167004.893563:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167004.894640:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765454396928:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762167004.894652:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167004.894663:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.894723:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451735040 00000100:00100000:0.0:1762167004.894730:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451734912:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1375us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.894731:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451735040 00000100:00100000:0.0:1762167004.894743:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7360 00000100:00100000:2.0:1762167004.894802:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16517 00000100:00100000:2.0:1762167004.894813:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56065:x1847765451735040:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167004.894827:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.894842:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3268 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.894868:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d095b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3142 expref: 21 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.894876:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.894877:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167004.894881:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 21 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.894906:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d095b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3142 expref: 21 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167004.894918:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d095b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3142 expref: 21 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167004.894930:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454397056:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.894981:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.895973:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454397056:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167004.895997:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 21 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167004.896008:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167004.896020:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:1.0:1762167004.896059:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451735168 00000100:00100000:1.0:1762167004.896065:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451735168 00010000:00010000:1.0:1762167004.896092:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d095b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3142 expref: 22 pid: 12400 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167004.896116:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56065:x1847765451735040:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1304us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.896124:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16517 00000100:00100000:1.0:1762167004.896130:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7361 00000100:00100000:1.0:1762167004.896140:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451735168:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.896150:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.896170:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d095b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3142 expref: 21 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:1.0:1762167004.896183:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d095b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3142 expref: 21 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:1.0:1762167004.896203:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d095b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3142 expref: 21 pid: 12400 timeout: 725 lvb_type: 1 00010000:00010000:1.0:1762167004.896216:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.896218:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167004.896222:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.896231:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.896258:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167004.896274:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f796300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454397184:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167004.896322:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3504606c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167004.897439:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.897441:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f796300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454397184:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167004.897457:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.897495:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451735168:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1356us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.897504:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7361 00000100:00100000:2.0:1762167004.897524:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451735296 00000100:00100000:2.0:1762167004.897530:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451735296 00002000:00010000:2.0:1762167004.897557:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (105681->18446744073709551615) 00002000:00100000:2.0:1762167004.897562:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243306d80 with x1847765451735296 ext(105681->18446744073709551615) 00002000:00010000:2.0:1762167004.897570:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243306d80. 00000100:00100000:2.0:1762167004.897600:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2730 00000100:00100000:2.0:1762167004.897609:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451735296:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167004.897725:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.897749:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451735424 00000100:00100000:1.0:1762167004.897753:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451735424 00002000:00010000:1.0:1762167004.897789:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167004.897793:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f796300 with x1847765451735424 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.897799:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f796300. 00000100:00100000:0.0:1762167004.897805:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.897815:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451735552 00000100:00100000:1.0:1762167004.897819:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451735552 00002000:00010000:1.0:1762167004.897832:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167004.897835:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243304380 with x1847765451735552 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.897840:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243304380. 00000100:00100000:3.0:1762167004.897846:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2731 00002000:00010000:2.0:1762167004.897877:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 92016 -> 105681 00002000:00010000:2.0:1762167004.897882:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167004 -> 1762167005 00002000:00010000:2.0:1762167004.897885:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00000100:00100000:1.0:1762167004.897888:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2732 00002000:00010000:2.0:1762167004.897889:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167004 -> 1762167005 00002000:00010000:2.0:1762167004.897894:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 177 -> 177 00000100:00100000:1.0:1762167004.897901:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451735552:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167004.897942:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451735296:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 320us (493us total) trans 21474843157 rc 0/0 00000100:00100000:2.0:1762167004.897950:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2730 00002000:00010000:2.0:1762167004.897953:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (105681->18446744073709551615) 00002000:00100000:2.0:1762167004.897957:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243306d80 with x1847765451735296 ext(105681->18446744073709551615) 00002000:00010000:2.0:1762167004.897962:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243306d80. 00002000:00010000:1.0:1762167004.898033:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167004.898037:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451735424:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167004.898045:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167004 -> 1762167005 00002000:00010000:1.0:1762167004.898049:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167004.898052:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167004 -> 1762167005 00002000:00010000:1.0:1762167004.898055:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167004.898098:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451735552:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 199us (292us total) trans 21474843158 rc 0/0 00000100:00100000:1.0:1762167004.898106:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2732 00002000:00010000:1.0:1762167004.898109:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167004.898112:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243304380 with x1847765451735552 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167004.898117:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243304380. 00002000:00010000:2.0:1762167004.898298:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167004.898302:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167004 -> 1762167005 00002000:00010000:2.0:1762167004.898305:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167004.898307:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167004 -> 1762167005 00002000:00010000:2.0:1762167004.898309:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167004.898346:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451735424:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 487us (618us total) trans 17179875638 rc 0/0 00000100:00100000:2.0:1762167004.898354:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2731 00002000:00010000:2.0:1762167004.898358:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:2.0:1762167004.898362:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f796300 with x1847765451735424 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167004.898367:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f796300. 00000100:00100000:2.0:1762167004.900337:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.900428:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451735680 00000100:00100000:0.0:1762167004.900436:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451735680 00002000:00100000:0.0:1762167004.900478:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->106495) req@ffff9ee36dce7480 x1847765451735680/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 504/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167004.900489:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce7480 with x1847765451735680 ext(81920->106495) 00002000:00010000:0.0:1762167004.900494:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce7480 00000100:00100000:0.0:1762167004.900529:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2733 00000100:00100000:0.0:1762167004.900538:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451735680:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167004.901874:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451735680:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1331us (1537us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1762167004.901886:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2733 00002000:00100000:2.0:1762167004.901896:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->106495) req@ffff9ee36dce7480 x1847765451735680/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 504/440 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.901906:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce7480 with x1847765451735680 ext(81920->106495) 00002000:00010000:2.0:1762167004.901911:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce7480 00000100:00100000:3.0:1762167004.903573:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.903639:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451735808 00000100:00100000:2.0:1762167004.903648:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451735808 00002000:00100000:2.0:1762167004.903689:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (86016->90111) req@ffff9ee36e629880 x1847765451735808/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.903706:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e629880 with x1847765451735808 ext(86016->90111) 00002000:00010000:2.0:1762167004.903711:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e629880 00000100:00100000:2.0:1762167004.903739:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2734 00000100:00100000:2.0:1762167004.903750:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451735808:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167004.903952:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451735808:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 204us (382us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167004.903961:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2734 00002000:00100000:2.0:1762167004.903967:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (86016->90111) req@ffff9ee36e629880 x1847765451735808/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/4536 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.903976:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e629880 with x1847765451735808 ext(86016->90111) 00002000:00010000:2.0:1762167004.903979:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e629880 00000100:00100000:0.0:1762167004.905419:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.905534:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451735936 00000100:00100000:2.0:1762167004.905540:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451735936 00002000:00100000:2.0:1762167004.905571:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (90112->94207) req@ffff9ee243306680 x1847765451735936/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.905581:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243306680 with x1847765451735936 ext(90112->94207) 00002000:00010000:2.0:1762167004.905585:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243306680 00000100:00100000:2.0:1762167004.905610:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2735 00000100:00100000:2.0:1762167004.905618:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451735936:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167004.905747:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451735936:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 128us (332us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167004.905755:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2735 00002000:00100000:2.0:1762167004.905788:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (90112->94207) req@ffff9ee243306680 x1847765451735936/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/4536 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.905797:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243306680 with x1847765451735936 ext(90112->94207) 00002000:00010000:2.0:1762167004.905800:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243306680 00000100:00100000:0.0:1762167004.907949:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.908012:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451736064 00000100:00100000:2.0:1762167004.908020:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451736064 00002000:00100000:2.0:1762167004.908062:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->105680) req@ffff9ee243304a80 x1847765451736064/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.908073:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243304a80 with x1847765451736064 ext(81920->105680) 00002000:00010000:2.0:1762167004.908079:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243304a80 00000100:00100000:2.0:1762167004.908108:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2736 00000100:00100000:2.0:1762167004.908119:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451736064:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:0.0:1762167004.909336:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451736064:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 1215us (1390us total) trans 21474843159 rc 0/0 00000100:00100000:0.0:1762167004.909345:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2736 00002000:00100000:0.0:1762167004.909354:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->105680) req@ffff9ee243304a80 x1847765451736064/t21474843159(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/448 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167004.909365:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243304a80 with x1847765451736064 ext(81920->105680) 00002000:00010000:0.0:1762167004.909370:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243304a80 00000100:00100000:0.0:1762167004.910450:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.910514:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451736192 00000100:00100000:3.0:1762167004.910521:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451736192 00000100:00100000:3.0:1762167004.910573:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16518 00000100:00100000:3.0:1762167004.910582:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451736192:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:2.0:1762167004.923586:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843159 is committed 00000001:00080000:2.0:1762167004.923608:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843148 is committed 00000001:00080000:2.0:1762167004.923621:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843152 is committed 00000001:00080000:2.0:1762167004.923635:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843156 is committed 00000100:00100000:3.0:1762167004.923821:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451736192:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 13234us (13369us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.923832:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16518 00000100:00100000:1.0:1762167004.925539:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.925600:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451736320 00000100:00100000:3.0:1762167004.925610:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451736320 00000100:00100000:3.0:1762167004.925665:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19596 00000100:00100000:3.0:1762167004.925675:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451736320:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167004.925698:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.925715:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d098d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb326f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.925842:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.925856:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.925868:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.925893:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105683 00000004:00200000:3.0:1762167004.925897:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167004.925912:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.925937:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d098d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb326f expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.925955:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb326f expref: 891 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.925968:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:3.0:1762167004.925971:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167004.925975:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167004.926028:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451736320:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 354us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.926036:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19596 00000100:00100000:2.0:1762167004.928716:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.928798:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451736448 00000100:00100000:0.0:1762167004.928811:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451736448 00002000:00100000:0.0:1762167004.928871:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->73727) req@ffff9ee36dce6d80 x1847765451736448/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167004.928882:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce6d80 with x1847765451736448 ext(69632->73727) 00002000:00010000:0.0:1762167004.928889:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce6d80 00000100:00100000:0.0:1762167004.928918:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2737 00000100:00100000:0.0:1762167004.928928:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451736448:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167004.929123:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451736448:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 195us (412us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167004.929131:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2737 00002000:00100000:0.0:1762167004.929138:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->73727) req@ffff9ee36dce6d80 x1847765451736448/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/4536 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167004.929147:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce6d80 with x1847765451736448 ext(69632->73727) 00002000:00010000:0.0:1762167004.929150:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce6d80 00000100:00100000:0.0:1762167004.930490:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.930551:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451736576 00000100:00100000:2.0:1762167004.930558:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451736576 00002000:00100000:2.0:1762167004.930590:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (73728->77823) req@ffff9ee243307800 x1847765451736576/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.930600:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243307800 with x1847765451736576 ext(73728->77823) 00002000:00010000:2.0:1762167004.930604:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243307800 00000100:00100000:2.0:1762167004.930631:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2738 00000100:00100000:2.0:1762167004.930638:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451736576:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167004.930816:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451736576:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 176us (330us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167004.930824:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2738 00002000:00100000:2.0:1762167004.930832:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (73728->77823) req@ffff9ee243307800 x1847765451736576/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/4536 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.930841:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243307800 with x1847765451736576 ext(73728->77823) 00002000:00010000:2.0:1762167004.930844:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243307800 00000100:00100000:1.0:1762167004.932352:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.932442:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451736704 00000100:00100000:2.0:1762167004.932448:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451736704 00002000:00100000:2.0:1762167004.932476:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (77824->81919) req@ffff9ee37f796a00 x1847765451736704/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/0 e 0 to 0 dl 1762167015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.932486:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f796a00 with x1847765451736704 ext(77824->81919) 00002000:00010000:2.0:1762167004.932490:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f796a00 00000100:00100000:2.0:1762167004.932517:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2739 00000100:00100000:2.0:1762167004.932526:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451736704:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167004.932681:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451736704:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 155us (334us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167004.932688:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2739 00002000:00100000:2.0:1762167004.932695:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (77824->81919) req@ffff9ee37f796a00 x1847765451736704/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:35/0 lens 488/4536 e 0 to 0 dl 1762167015 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167004.932701:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f796a00 with x1847765451736704 ext(77824->81919) 00002000:00010000:2.0:1762167004.932704:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f796a00 00000100:00100000:0.0:1762167004.934916:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.935021:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451736960 00000100:00100000:2.0:1762167004.935032:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451736960 00000100:00100000:2.0:1762167004.935077:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7272 00000100:00100000:2.0:1762167004.935086:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451736960:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167004.935330:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451736960:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 245us (427us total) trans 8589952677 rc 0/0 00000100:00100000:2.0:1762167004.935338:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7272 00000100:00100000:0.0:1762167004.945010:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.945117:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451737216 00000100:00100000:3.0:1762167004.945132:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451737216 00000100:00100000:3.0:1762167004.945194:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19597 00000100:00100000:3.0:1762167004.945206:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56187:x1847765451737216:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.945282:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.945302:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d098de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3276 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.945365:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098e5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945377:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098e5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945387:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098e5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945414:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d098ec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945420:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d098ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945431:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d098ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945558:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d098f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945566:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d098f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945573:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d098f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.945582:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105683 00010000:00010000:3.0:1762167004.945655:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098e5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945661:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098e5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945667:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945673:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.945676:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945682:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098e5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945694:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167004.945696:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.945700:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945709:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d098e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945723:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d098ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945728:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d098ec lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945733:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d098ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945737:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167004.945740:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d098ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945745:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d098ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945751:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167004.945753:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167004.945756:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d098ec lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945812:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d098ec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.945852:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d098de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3276 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.945866:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d098f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3276 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.945879:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:3.0:1762167004.945881:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167004.945884:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922a00, rc 0) 00000100:00100000:3.0:1762167004.945944:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56187:x1847765451737216:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 742us (952us total) trans 8589952678 rc 0/0 00000100:00100000:3.0:1762167004.945951:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19597 00000100:00100000:1.0:1762167004.947599:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167004.947684:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451737344 00000100:00100000:0.0:1762167004.947697:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451737344 00000100:00100000:0.0:1762167004.947819:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 628 00000100:00100000:0.0:1762167004.947833:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451737344:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167004.947852:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167004.947879:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d098f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3276 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167004.947900:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:0.0:1762167004.947906:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167004.947976:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2360:x1847765451737344:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 142us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167004.947985:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 628 00000100:00100000:0.0:1762167004.948302:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.948356:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451737600 00000100:00100000:2.0:1762167004.948366:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451737600 00000100:00100000:2.0:1762167004.948417:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7273 00000100:00100000:2.0:1762167004.948425:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56187:x1847765451737600:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167004.948615:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56187:x1847765451737600:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 189us (313us total) trans 8589952679 rc 0/0 00000100:00100000:2.0:1762167004.948624:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7273 00000100:00100000:2.0:1762167004.950223:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.950316:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451737856 00000100:00100000:3.0:1762167004.950327:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451737856 00000100:00100000:3.0:1762167004.950384:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19598 00000100:00100000:3.0:1762167004.950408:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56187:x1847765451737856:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.950439:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.950463:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09901 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb327d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.950581:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09908 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.950598:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09908 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.950612:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09908 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167004.950626:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105683 00010000:00010000:3.0:1762167004.950829:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09901 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb327d expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.950848:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09908 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb327d expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.950858:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:3.0:1762167004.950861:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167004.950865:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000100:00100000:3.0:1762167004.950948:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56187:x1847765451737856:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 556us (732us total) trans 8589952680 rc 0/0 00000100:00100000:3.0:1762167004.950957:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19598 00000100:00100000:1.0:1762167004.953034:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167004.953082:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451738112 00000100:00100000:3.0:1762167004.953098:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451738112 00000100:00100000:3.0:1762167004.953150:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19599 00000100:00100000:3.0:1762167004.953159:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56187:x1847765451738112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167004.953180:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167004.953195:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09916 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3284 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.953282:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0991d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.953293:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb326f expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.953299:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0991d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167004.953331:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb326f expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167004.953342:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb326f expref: 897 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167004.953355:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454397312:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167004.953440:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.954889:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454397312:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167004.954914:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167004.954924:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0991d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167004.954981:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451738240 00000100:00100000:1.0:1762167004.954990:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451738240 00010000:00010000:1.0:1762167004.955023:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb326f expref: 898 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.955051:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7362 00000100:00100000:1.0:1762167004.955059:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451738240:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.955069:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.955074:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb326f expref: 898 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.955082:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb326f expref: 898 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.955099:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d098d7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb326f expref: 898 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.955114:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:1.0:1762167004.955117:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0991d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.955123:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0991d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.955128:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0991d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167004.955144:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.955166:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0991d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.955177:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0991d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167004.955185:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451738240:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 128us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.955191:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7362 00000004:00200000:2.0:1762167004.955193:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105683 00010000:00010000:2.0:1762167004.955370:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09916 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3284 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.955393:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0991d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3284 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.955416:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:2.0:1762167004.955419:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167004.955421:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:2.0:1762167004.955462:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56187:x1847765451738112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2304us (2452us total) trans 8589952681 rc 0/0 00000100:00100000:2.0:1762167004.955470:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19599 00000100:00100000:0.0:1762167004.956845:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.956899:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451738368 00000100:00100000:2.0:1762167004.956909:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451738368 00000100:00100000:2.0:1762167004.956957:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7274 00000100:00100000:2.0:1762167004.956969:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56187:x1847765451738368:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:2.0:1762167004.957105:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56187:x1847765451738368:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 139us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.957117:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7274 00000100:00100000:0.0:1762167004.958137:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.958187:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451738624 00000100:00100000:2.0:1762167004.958197:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451738624 00000100:00100000:2.0:1762167004.958241:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7275 00000100:00100000:2.0:1762167004.958248:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358650450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56187:x1847765451738624:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167004.958484:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358650450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56187:x1847765451738624:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 236us (350us total) trans 8589952682 rc 0/0 00000100:00100000:2.0:1762167004.958490:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7275 00000100:00100000:0.0:1762167004.959940:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.960005:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451738880 00000100:00100000:2.0:1762167004.960011:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451738880 00000100:00100000:2.0:1762167004.960050:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19600 00000100:00100000:2.0:1762167004.960058:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56187:x1847765451738880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.960074:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.960077:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762167004.960097:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0991d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3284 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.960112:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09908 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb327d expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.960120:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:2.0:1762167004.960123:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.960132:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0992b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb328b expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.960212:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09932 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.960225:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09932 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.960234:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09932 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.960246:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105683 00010000:00010000:2.0:1762167004.960343:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0992b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb328b expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.960358:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09932 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb328b expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.960371:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:2.0:1762167004.960373:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167004.960375:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d200, rc 0) 00000100:00100000:2.0:1762167004.960428:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56187:x1847765451738880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 372us (495us total) trans 8589952683 rc 0/0 00000100:00100000:2.0:1762167004.960433:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19600 00000100:00100000:0.0:1762167004.961678:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.961750:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451739136 00000100:00100000:2.0:1762167004.961757:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451739136 00000100:00100000:2.0:1762167004.961863:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7276 00000100:00100000:2.0:1762167004.961874:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56187:x1847765451739136:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167004.961939:0:33886:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09932 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb328b expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.961974:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.961987:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3253 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.961995:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.962031:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3253 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.962046:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3253 expref: 898 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.962069:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454397440:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.962146:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a840 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.963373:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454397440:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.963417:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167004.963574:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.963628:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451739264 00000100:00100000:1.0:1762167004.963634:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451739264 00010000:00010000:1.0:1762167004.963661:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3253 expref: 899 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.963700:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7363 00000100:00100000:1.0:1762167004.963710:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2361:x1847765451739264:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.963723:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.963730:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3253 expref: 899 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.963742:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3253 expref: 899 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.963800:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d098b4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3253 expref: 899 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.963825:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:1.0:1762167004.963830:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.963839:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.963847:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.963871:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.963896:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.963906:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167004.963918:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451739264:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 209us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.963927:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7363 00010000:00010000:2.0:1762167004.964292:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.964301:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.964307:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.964313:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.964319:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.964327:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.964337:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:2.0:1762167004.964340:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167004.964344:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.964351:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09940 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.964366:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:2.0:1762167004.964369:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167004.964373:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09932 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb328b expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.964510:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56187:x1847765451739136:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2637us (2835us total) trans 8589952684 rc -22/-22 00000100:00100000:2.0:1762167004.964517:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7276 00000100:00100000:0.0:1762167004.965395:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.965518:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451739392 00000100:00100000:2.0:1762167004.965524:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451739392 00000100:00100000:2.0:1762167004.965568:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19601 00000100:00100000:2.0:1762167004.965577:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56187:x1847765451739392:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.965597:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.965615:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09947 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3292 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.965660:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09947 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3292 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.965672:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09947 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3292 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.965685:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0a00) 00010000:00010000:2.0:1762167004.965687:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167004.965690:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d000, rc 0) 00000100:00100000:2.0:1762167004.965724:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56187:x1847765451739392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 149us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.965731:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19601 00000100:00100000:0.0:1762167004.967474:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.967543:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451739648 00000100:00100000:2.0:1762167004.967557:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451739648 00000100:00100000:2.0:1762167004.967618:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19602 00000100:00100000:2.0:1762167004.967628:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56187:x1847765451739648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.967650:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.967671:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0994e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3299 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.968324:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x646:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.968337:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x646:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.968346:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x646:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.968355:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x646:0x0]: returning size 0 00010000:00010000:2.0:1762167004.968413:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0994e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3299 expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.968433:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x646:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3299 expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.968441:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x646:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167004.968444:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167004.968447:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167004.968509:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56187:x1847765451739648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 884us (1040us total) trans 8589952685 rc 0/0 00000100:00100000:2.0:1762167004.968515:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19602 00000100:00100000:0.0:1762167004.970065:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.970115:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451739904 00000100:00100000:2.0:1762167004.970123:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451739904 00000100:00100000:2.0:1762167004.970167:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19603 00000100:00100000:2.0:1762167004.970175:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56187:x1847765451739904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.970194:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.970208:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09963 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32a0 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.970286:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0996a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.970296:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0996a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.970303:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0996a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.970317:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105683 00010000:00010000:2.0:1762167004.970422:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09963 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a0 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.970438:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0996a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a0 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.970447:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0a00) 00010000:00010000:2.0:1762167004.970450:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167004.970453:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167004.970506:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56187:x1847765451739904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 332us (448us total) trans 8589952686 rc 0/0 00000100:00100000:2.0:1762167004.970512:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19603 00000100:00100000:0.0:1762167004.971558:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.971602:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451740160 00000100:00100000:2.0:1762167004.971609:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451740160 00000100:00100000:2.0:1762167004.971640:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7277 00000100:00100000:2.0:1762167004.971646:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56187:x1847765451740160:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167004.971689:0:33886:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0996a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a0 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.971707:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.971714:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09947 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3292 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.971720:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.971745:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09947 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3292 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.971757:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09947 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3292 expref: 902 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.971791:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454397568:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.971847:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.972663:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454397568:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.972683:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167004.972834:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.972887:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451740288 00000100:00100000:1.0:1762167004.972893:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451740288 00010000:00010000:1.0:1762167004.972918:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09947 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3292 expref: 903 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.972949:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7364 00000100:00100000:1.0:1762167004.972959:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2360:x1847765451740288:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.972970:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.972977:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09947 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3292 expref: 903 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.972998:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09947 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3292 expref: 903 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.973012:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09947 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3292 expref: 903 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.973023:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0a00) 00010000:00010000:1.0:1762167004.973027:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.973034:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.973039:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.973061:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.973082:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.973090:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167004.973099:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2360:x1847765451740288:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 141us (263us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167004.973107:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x646:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167004.973107:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7364 00010000:00010000:2.0:1762167004.973122:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x646:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3299 expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.973130:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.973149:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x646:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3299 expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.973160:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x646:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3299 expref: 901 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167004.973170:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454397696:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167004.973210:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1762167004.974067:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454397696:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167004.974081:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167004.974379:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.974444:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451740416 00000100:00100000:1.0:1762167004.974449:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451740416 00010000:00010000:1.0:1762167004.974483:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x646:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3299 expref: 902 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167004.974513:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7365 00000100:00100000:1.0:1762167004.974523:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2360:x1847765451740416:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167004.974537:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.974543:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x646:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3299 expref: 902 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.974553:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x646:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3299 expref: 902 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.974568:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09955 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x646:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3299 expref: 902 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167004.974579:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x646:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167004.974583:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.974590:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.974596:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167004.974617:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167004.974643:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.974659:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167004.974660:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:2360:x1847765451740416:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 138us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.974676:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7365 00000100:00100000:2.0:1762167004.975296:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454397824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.975333:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.975358:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.975374:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454397824 00000100:00100000:1.0:1762167004.975380:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454397824 00000100:00100000:1.0:1762167004.975424:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1762167004.975432:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454397824:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.975491:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454397824:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.975496:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:2.0:1762167004.975531:0:33886:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843156 gen 2 00000004:00080000:2.0:1762167004.975537:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccd880, transno 21474843143 00000004:00080000:2.0:1762167004.975558:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccc380, transno 21474843144 00000004:00080000:2.0:1762167004.975561:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccc000, transno 21474843145 00000004:00080000:2.0:1762167004.975563:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcce300, transno 21474843146 00000004:00080000:2.0:1762167004.975565:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345732300, transno 21474843147 00000004:00080000:2.0:1762167004.975568:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345730700, transno 21474843148 00000004:00080000:2.0:1762167004.975571:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345732680, transno 21474843149 00000004:00080000:2.0:1762167004.975574:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242520a80, transno 21474843150 00000004:00080000:2.0:1762167004.975577:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242521180, transno 21474843151 00000004:00080000:2.0:1762167004.975580:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242522a00, transno 21474843152 00000004:00080000:2.0:1762167004.975584:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4f800, transno 21474843153 00000004:00080000:2.0:1762167004.975588:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4e680, transno 21474843154 00000004:00080000:2.0:1762167004.975591:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4e300, transno 21474843155 00000004:00080000:2.0:1762167004.975594:0:33886:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28e00, transno 21474843156 00000100:00100000:2.0:1762167004.975600:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454397824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.975651:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454397952:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.975681:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.975708:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.975721:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454397952 00000100:00100000:1.0:1762167004.975726:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454397952 00000004:00080000:0.0:1762167004.975742:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 3 in progress, 0 in flight, 11 done 00000100:00100000:1.0:1762167004.975783:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1762167004.975794:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454397952:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.975852:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454397952:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 62us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.975858:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000004:00080000:0.0:1762167004.975859:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:2.0:1762167004.975887:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454397952:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.975935:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398080:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.975959:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.975979:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.975999:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454398080 00000100:00100000:1.0:1762167004.976004:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454398080 00000100:00100000:1.0:1762167004.976029:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:1.0:1762167004.976036:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454398080:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.976083:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454398080:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 49us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.976087:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1762167004.976122:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398080:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.976151:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398208:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.976172:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.976192:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.976224:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454398208 00000100:00100000:1.0:1762167004.976229:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454398208 00000100:00100000:1.0:1762167004.976260:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1762167004.976267:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454398208:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.976324:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454398208:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 58us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.976330:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1762167004.976429:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398208:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.976463:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398336:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.976489:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.976508:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.976527:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454398336 00000100:00100000:1.0:1762167004.976533:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454398336 00000100:00100000:1.0:1762167004.976568:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1762167004.976576:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454398336:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.976633:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454398336:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 56us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.976645:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1762167004.976646:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398336:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.976677:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398464:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.976697:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167004.976715:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454398464 00000100:00100000:2.0:1762167004.976717:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167004.976719:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454398464 00000100:00100000:1.0:1762167004.976743:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1762167004.976747:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454398464:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167004.976800:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454398464:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 52us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.976805:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1762167004.976816:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398464:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.976848:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398592:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.976869:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167004.976984:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454398592 00000100:00100000:3.0:1762167004.976988:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454398592 00000100:00100000:2.0:1762167004.976989:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.977016:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1762167004.977023:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454398592:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.977072:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454398592:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 50us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.977078:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1762167004.977084:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398592:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.977111:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398720:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.977131:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.977149:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.977166:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454398720 00000100:00100000:3.0:1762167004.977169:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454398720 00000100:00100000:3.0:1762167004.977191:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1762167004.977198:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454398720:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.977241:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454398720:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.977247:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1762167004.977252:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398720:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.977282:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398848:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.977302:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.977318:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.977334:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454398848 00000100:00100000:3.0:1762167004.977338:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454398848 00000100:00100000:3.0:1762167004.977360:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1762167004.977366:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454398848:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.977420:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454398848:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 54us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.977426:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1762167004.977444:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398848:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.977470:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398976:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.977489:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.977505:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.977528:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454398976 00000100:00100000:3.0:1762167004.977531:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454398976 00000100:00100000:3.0:1762167004.977554:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1762167004.977559:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454398976:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.977601:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454398976:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 41us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.977607:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1762167004.977612:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454398976:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.977641:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454399104:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.977661:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.977677:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.977685:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454399104 00000100:00100000:3.0:1762167004.977688:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454399104 00000100:00100000:3.0:1762167004.977710:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1762167004.977716:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454399104:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.977757:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454399104:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 42us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.977782:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1762167004.977794:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454399104:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.977825:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454399232:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.977844:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.977859:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.977869:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454399232 00000100:00100000:3.0:1762167004.977872:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454399232 00000100:00100000:3.0:1762167004.977895:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1762167004.977902:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454399232:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.977944:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454399232:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 43us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167004.977950:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1762167004.977955:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454399232:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:2.0:1762167004.978151:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].46, 640 off59808 00000001:00080000:2.0:1762167004.978157:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952687 00000100:00100000:2.0:1762167004.978200:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454399360:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.978224:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.978244:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.978275:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454399360 00000100:00100000:3.0:1762167004.978281:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454399360 00000100:00100000:3.0:1762167004.978315:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1762167004.978322:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:33886:x1847765454399360:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.978582:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454399360:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 261us (356us total) trans 21474843160 rc 0/0 00000100:00100000:3.0:1762167004.978591:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1762167004.978606:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454399360:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.978633:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454399488:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167004.978657:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167004.978676:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167004.978698:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454399488 00000100:00100000:3.0:1762167004.978703:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454399488 00000100:00100000:3.0:1762167004.978737:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1762167004.978744:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:33886:x1847765454399488:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167004.978918:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:33886:x1847765454399488:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 173us (259us total) trans 17179875639 rc 0/0 00000100:00100000:3.0:1762167004.978925:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1762167004.978974:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454399488:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:2.0:1762167004.979047:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952688 00010000:00010000:2.0:1762167004.979080:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979094:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979101:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979108:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.979112:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979119:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979136:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x646:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167004.979139:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167004.979144:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979157:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0997f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x646:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979179:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979189:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979195:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979200:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.979203:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979209:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979216:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0a00) 00010000:00010000:2.0:1762167004.979218:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167004.979221:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979226:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09978 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.979237:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0a00) 00010000:00010000:2.0:1762167004.979239:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167004.979245:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0996a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a0 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167004.979334:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56187:x1847765451740160:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7684us (7774us total) trans 8589952689 rc 0/0 00000100:00100000:2.0:1762167004.979343:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7277 00000020:00080000:2.0:1762167004.979348:0:33886:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762167004.980410:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.980458:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451740544 00000100:00100000:2.0:1762167004.980464:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451740544 00000100:00100000:2.0:1762167004.980506:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19604 00000100:00100000:2.0:1762167004.980516:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56187:x1847765451740544:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.980530:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.980547:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09986 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32a7 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.980593:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09986 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a7 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.980619:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09986 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a7 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.980636:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167004.980639:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167004.980642:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:2.0:1762167004.980678:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56187:x1847765451740544:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 164us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.980685:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19604 00000100:00100000:0.0:1762167004.981957:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.982022:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451740800 00000100:00100000:2.0:1762167004.982027:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451740800 00000100:00100000:2.0:1762167004.982067:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7278 00000100:00100000:2.0:1762167004.982077:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56187:x1847765451740800:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762167004.982448:0:33886:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x646:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762167004.982510:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5348, 64 off430992 00000004:00080000:2.0:1762167004.982515:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625774752047ns, next at 626774750597ns, rc = 0 00000040:00080000:2.0:1762167004.982545:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5356, 64 off432112 00000004:00080000:2.0:1762167004.982549:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 625774786454ns, next at 626774785189ns, rc = 0 00000001:00080000:2.0:1762167004.982553:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952690 00010000:00010000:2.0:1762167004.982582:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x646:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.982591:0:33886:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x646:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.982597:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x646:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.982603:0:33886:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x646:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.982607:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x646:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.982611:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x646:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167004.982626:0:33886:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762167004.982659:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167004.982667:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x646:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.982677:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167004.982682:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x646:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.982695:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x646:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.982708:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x646:0x0].0x0 (ffff9ee2429d0900) 00000100:00100000:2.0:1762167004.982712:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56187:x1847765451740800:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 634us (756us total) trans 8589952691 rc 0/0 00010000:00010000:0.0:1762167004.982713:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762167004.982719:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 1/0,0 mode: --/PW res: [0x200000404:0x646:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167004.982724:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7278 00000020:00080000:2.0:1762167004.982731:0:33886:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167004.982731:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0998d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x646:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167004.982751:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167004.982753:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167004.982756:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167004.983637:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.983678:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451741056 00000100:00100000:2.0:1762167004.983684:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451741056 00000100:00100000:2.0:1762167004.983718:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7279 00000100:00100000:2.0:1762167004.983727:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56187:x1847765451741056:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167004.983942:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56187:x1847765451741056:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 216us (305us total) trans 8589952692 rc 0/0 00000100:00100000:2.0:1762167004.983951:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7279 00000100:00100000:3.0:1762167004.992753:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.992833:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451741184 00000100:00100000:2.0:1762167004.992843:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451741184 00000100:00100000:2.0:1762167004.992899:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19605 00000100:00100000:2.0:1762167004.992912:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56188:x1847765451741184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.992949:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.992970:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09994 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32ae expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.993042:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0999b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993056:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0999b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993067:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0999b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993078:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993083:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993087:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993168:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993176:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993182:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.993212:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105681 00000004:00200000:2.0:1762167004.993217:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167004.993233:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993245:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993253:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0999b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993257:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0999b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993261:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0999b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993264:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.993267:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0999b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993272:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0999b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993279:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167004.993281:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167004.993285:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0999b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993288:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0999b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993296:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993301:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099a2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993304:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993313:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167004.993314:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993318:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993322:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0a00) 00010000:00010000:2.0:1762167004.993323:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167004.993325:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099a2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993328:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.993358:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09994 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ae expref: 908 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.993370:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ae expref: 907 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.993376:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167004.993379:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167004.993381:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d200, rc 0) 00000100:00100000:2.0:1762167004.993453:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56188:x1847765451741184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 544us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167004.993462:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19605 00000100:00100000:0.0:1762167004.995460:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.995509:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451741440 00000100:00100000:2.0:1762167004.995516:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451741440 00000100:00100000:2.0:1762167004.995561:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19606 00000100:00100000:2.0:1762167004.995570:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56188:x1847765451741440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.995584:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.995606:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d099b0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32b5 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.995686:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.995697:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.995705:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.995714:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105681 00010000:00010000:2.0:1762167004.995843:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d099b0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32b5 expref: 910 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.995857:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32b5 expref: 909 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.995863:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167004.995866:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762167004.995868:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167004.995918:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56188:x1847765451741440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 349us (462us total) trans 8589952693 rc 0/0 00000100:00100000:2.0:1762167004.995924:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19606 00000100:00100000:0.0:1762167004.997291:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167004.997333:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451741696 00000100:00100000:2.0:1762167004.997340:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451741696 00000100:00100000:2.0:1762167004.997375:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19607 00000100:00100000:2.0:1762167004.997385:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56188:x1847765451741696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167004.997409:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167004.997422:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d099c5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32bc expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.997481:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099cc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.997491:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167004.997500:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167004.997510:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105681 00010000:00010000:2.0:1762167004.997585:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d099c5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32bc expref: 912 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.997601:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099cc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32bc expref: 911 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167004.997609:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167004.997612:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167004.997614:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167004.997657:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56188:x1847765451741696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 274us (369us total) trans 8589952694 rc 0/0 00000100:00100000:2.0:1762167004.997663:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19607 00000100:00100000:3.0:1762167004.998948:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167004.999000:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451741824 00000100:00100000:1.0:1762167004.999007:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451741824 00000100:00100000:1.0:1762167004.999053:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 629 00000100:00100000:1.0:1762167004.999064:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56188:x1847765451741824:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167004.999076:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167004.999094:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099cc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32bc expref: 911 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167004.999118:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167004.999124:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167004.999167:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:56188:x1847765451741824:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 107us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167004.999175:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 629 00000100:00100000:0.0:1762167005.000020:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.000064:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451742080 00000100:00100000:2.0:1762167005.000071:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451742080 00000100:00100000:2.0:1762167005.000109:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7280 00000100:00100000:2.0:1762167005.000119:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358653450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:56188:x1847765451742080:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167005.000296:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358653450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56188:x1847765451742080:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 178us (281us total) trans 8589952695 rc 0/0 00000100:00100000:2.0:1762167005.000303:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7280 00000100:00100000:0.0:1762167005.002983:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.003033:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451742336 00000100:00100000:2.0:1762167005.003043:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451742336 00000100:00080000:0.0:1762167005.003096:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762167005.003111:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19608 00000100:00100000:2.0:1762167005.003136:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56065:x1847765451742336:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167005.003163:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.003184:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099da lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32c3 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.003280:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.003294:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ae expref: 912 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.003303:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.003335:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ae expref: 912 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.003359:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ae expref: 912 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.003372:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454399616:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.003452:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.004366:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454399616:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.004385:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167005.004690:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.004756:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451742464 00000100:00100000:1.0:1762167005.004799:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451742464 00010000:00010000:1.0:1762167005.004830:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ae expref: 913 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167005.004889:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7366 00000100:00100000:1.0:1762167005.004901:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:2360:x1847765451742464:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.004914:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.004926:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ae expref: 913 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.004940:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ae expref: 913 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.004962:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d099a9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ae expref: 913 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.004982:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167005.004987:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.004995:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.005002:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.005028:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167005.005055:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.005063:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167005.005074:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105681 00000100:00100000:1.0:1762167005.005074:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:2360:x1847765451742464:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.005085:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7366 00010000:00010000:2.0:1762167005.005214:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099da lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32c3 expref: 913 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.005230:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32c3 expref: 912 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.005250:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.005253:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167005.005255:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:2.0:1762167005.005289:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56065:x1847765451742336:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2169us (2315us total) trans 8589952696 rc 0/0 00000100:00100000:2.0:1762167005.005300:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19608 00000100:00100000:0.0:1762167005.006459:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.006494:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451742592 00000100:00100000:2.0:1762167005.006500:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451742592 00000100:00100000:2.0:1762167005.006538:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19609 00000100:00100000:2.0:1762167005.006547:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56065:x1847765451742592:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167005.006565:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.006580:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d099ef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32ca expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.006642:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.006651:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32c3 expref: 913 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.006656:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.006678:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32c3 expref: 913 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.006699:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32c3 expref: 913 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.006712:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454399744:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.006821:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.007920:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454399744:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.007939:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167005.008105:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.008144:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451742720 00000100:00100000:1.0:1762167005.008149:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451742720 00010000:00010000:1.0:1762167005.008175:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32c3 expref: 914 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167005.008208:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7367 00000100:00100000:1.0:1762167005.008227:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:2360:x1847765451742720:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.008239:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.008245:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32c3 expref: 914 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.008256:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32c3 expref: 914 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.008273:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d099e1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32c3 expref: 914 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.008283:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167005.008286:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.008292:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.008296:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.008314:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167005.008329:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.008336:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167005.008355:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:2360:x1847765451742720:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 139us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.008364:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7367 00000004:00200000:2.0:1762167005.008366:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 105681 00000004:00200000:2.0:1762167005.008372:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167005.008392:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.008433:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d099ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ca expref: 913 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.008447:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ca expref: 912 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.008455:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.008458:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167005.008461:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167005.008503:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56065:x1847765451742592:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1958us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.008511:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19609 00000100:00100000:0.0:1762167005.011741:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.011812:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451742848 00000100:00100000:2.0:1762167005.011824:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451742848 00000100:00080000:0.0:1762167005.011879:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1762167005.011887:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->86015) req@ffff9ee24732d880 x1847765451742848/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167005.011900:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732d880 with x1847765451742848 ext(69632->86015) 00002000:00010000:2.0:1762167005.011906:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732d880 00000100:00100000:2.0:1762167005.011942:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2740 00000100:00100000:2.0:1762167005.011953:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451742848:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167005.012180:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451742848:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 229us (448us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1762167005.012186:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2740 00002000:00100000:2.0:1762167005.012192:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->86015) req@ffff9ee24732d880 x1847765451742848/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/16824 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167005.012198:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732d880 with x1847765451742848 ext(69632->86015) 00002000:00010000:2.0:1762167005.012200:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732d880 00000100:00100000:3.0:1762167005.014241:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.014285:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451743104 00000100:00100000:2.0:1762167005.014294:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451743104 00000100:00100000:2.0:1762167005.014344:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19610 00000100:00100000:2.0:1762167005.014352:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56065:x1847765451743104:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167005.014394:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.014429:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d099f6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ca expref: 912 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.014446:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.014451:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167005.014660:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.014673:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.014683:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:2.0:1762167005.014738:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952697 00000004:00010000:2.0:1762167005.014813:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007356c667 reply state 00000000f00ae708 transno 8589952698 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.014823:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167005.014909:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56065:x1847765451743104:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 556us (671us total) trans 8589952698 rc 0/0 00000100:00100000:2.0:1762167005.014916:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19610 00000020:00080000:2.0:1762167005.014921:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167005.015743:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.015753:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.015759:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.015781:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.015787:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.015795:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.015807:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:3.0:1762167005.015810:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.015814:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.015820:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d099fd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.016363:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.016437:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451743232 00000100:00100000:3.0:1762167005.016441:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.016449:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451743232 00002000:00010000:2.0:1762167005.016493:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (77401->18446744073709551615) 00002000:00100000:2.0:1762167005.016498:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e628000 with x1847765451743232 ext(77401->18446744073709551615) 00000100:00100000:3.0:1762167005.016508:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:2.0:1762167005.016513:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e628000. 00000100:00100000:1.0:1762167005.016536:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451743360 00000100:00100000:1.0:1762167005.016541:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451743360 00000100:00100000:2.0:1762167005.016553:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2741 00000100:00100000:2.0:1762167005.016565:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451743232:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167005.016586:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451743488 00000100:00100000:3.0:1762167005.016592:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451743488 00002000:00010000:1.0:1762167005.016592:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167005.016599:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e628e00 with x1847765451743360 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167005.016609:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e628e00. 00000100:00080000:0.0:1762167005.016613:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1762167005.016615:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167005.016622:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e629c00 with x1847765451743488 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167005.016631:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e629c00. 00000100:00100000:1.0:1762167005.016637:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2742 00000100:00100000:1.0:1762167005.016649:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451743360:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167005.016651:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2743 00000100:00100000:0.0:1762167005.016671:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451743488:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:0.0:1762167005.016973:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.016974:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.016980:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.016984:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167005.016986:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.016988:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.016991:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167005.016994:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.016996:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.017003:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167005.017060:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 105681 -> 77401 00002000:00010000:2.0:1762167005.017067:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:0.0:1762167005.017067:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451743488:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 401us (557us total) trans 21474843161 rc 0/0 00000100:00100000:1.0:1762167005.017069:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451743360:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 420us (624us total) trans 17179875640 rc 0/0 00002000:00010000:2.0:1762167005.017074:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167005.017082:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.017088:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 177 -> 203 00000100:00100000:0.0:1762167005.017091:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2743 00002000:00010000:0.0:1762167005.017099:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:1.0:1762167005.017100:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2742 00002000:00100000:0.0:1762167005.017104:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e629c00 with x1847765451743488 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167005.017107:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:0.0:1762167005.017111:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e629c00. 00002000:00100000:1.0:1762167005.017112:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e628e00 with x1847765451743360 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167005.017118:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451743232:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 554us (760us total) trans 21474843162 rc 0/0 00002000:00010000:1.0:1762167005.017122:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e628e00. 00000100:00100000:2.0:1762167005.017130:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2741 00002000:00010000:2.0:1762167005.017135:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (77401->18446744073709551615) 00002000:00100000:2.0:1762167005.017138:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e628000 with x1847765451743232 ext(77401->18446744073709551615) 00002000:00010000:2.0:1762167005.017145:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e628000. 00000100:00100000:0.0:1762167005.018381:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.018445:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451743616 00000100:00100000:2.0:1762167005.018452:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451743616 00000100:00100000:2.0:1762167005.018498:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19611 00000100:00100000:2.0:1762167005.018507:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56065:x1847765451743616:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167005.018528:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.018547:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a04 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32d1 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.018643:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a0b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.018658:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.018670:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167005.018698:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 77401 00000004:00200000:2.0:1762167005.018703:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167005.018719:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.018746:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a04 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32d1 expref: 915 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.018802:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32d1 expref: 914 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.018812:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.018816:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167005.018820:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d400, rc 0) 00000100:00100000:2.0:1762167005.018873:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56065:x1847765451743616:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 367us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.018879:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19611 00000100:00100000:3.0:1762167005.022175:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.022272:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451743872 00000100:00100000:2.0:1762167005.022281:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451743872 00000100:00100000:2.0:1762167005.022330:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19612 00000100:00100000:2.0:1762167005.022339:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56065:x1847765451743872:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167005.022393:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.022430:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a0b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32d1 expref: 914 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.022444:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.022448:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167005.022688:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.022702:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.022712:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:2.0:1762167005.022802:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952699 00000004:00010000:2.0:1762167005.022825:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005d37d684 reply state 0000000029bad6b2 transno 8589952700 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.022832:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167005.022921:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56065:x1847765451743872:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 583us (763us total) trans 8589952700 rc 0/0 00000100:00100000:2.0:1762167005.022927:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19612 00000020:00080000:2.0:1762167005.022934:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167005.023896:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.023909:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.023916:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.023922:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167005.023926:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.023940:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.023966:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167005.023969:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167005.023974:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.023980:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a12 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.024508:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.024538:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.024589:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451744000 00000100:00100000:1.0:1762167005.024589:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451744128 00000100:00100000:2.0:1762167005.024598:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451744000 00000100:00100000:1.0:1762167005.024598:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451744128 00000100:00100000:3.0:1762167005.024610:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:2.0:1762167005.024633:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (25313->18446744073709551615) 00002000:00010000:1.0:1762167005.024633:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:2.0:1762167005.024639:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e62a300 with x1847765451744000 ext(25313->18446744073709551615) 00002000:00100000:1.0:1762167005.024639:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e62a680 with x1847765451744128 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167005.024651:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e62a300. 00002000:00010000:1.0:1762167005.024651:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e62a680. 00000100:00100000:1.0:1762167005.024675:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451744256 00000100:00100000:1.0:1762167005.024678:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451744256 00002000:00010000:1.0:1762167005.024690:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:2.0:1762167005.024693:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2744 00002000:00100000:1.0:1762167005.024694:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e628700 with x1847765451744256 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167005.024701:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e628700. 00000100:00100000:2.0:1762167005.024707:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451744128:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167005.024707:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2745 00000100:00100000:3.0:1762167005.024720:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2746 00000100:00100000:0.0:1762167005.024727:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451744000:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167005.024738:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451744256:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167005.024990:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.024990:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.024998:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.024998:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.025006:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167005.025006:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167005.025012:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.025013:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.025019:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167005.025020:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.025084:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451744256:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 348us (470us total) trans 21474843163 rc 0/0 00000100:00100000:2.0:1762167005.025085:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451744128:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 378us (540us total) trans 17179875641 rc 0/0 00000100:00100000:2.0:1762167005.025103:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2744 00002000:00010000:2.0:1762167005.025108:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:3.0:1762167005.025111:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2746 00002000:00100000:2.0:1762167005.025113:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e62a680 with x1847765451744128 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167005.025118:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:2.0:1762167005.025121:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e62a680. 00002000:00100000:3.0:1762167005.025123:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e628700 with x1847765451744256 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167005.025131:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e628700. 00002000:00010000:0.0:1762167005.025196:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 77401 -> 25313 00002000:00010000:0.0:1762167005.025200:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.025203:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167005.025206:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.025208:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 203 -> 203 00000100:00100000:0.0:1762167005.025238:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451744000:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 520us (734us total) trans 21474843164 rc 0/0 00000100:00100000:0.0:1762167005.025243:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2745 00002000:00010000:0.0:1762167005.025245:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (25313->18446744073709551615) 00002000:00100000:0.0:1762167005.025247:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e62a300 with x1847765451744000 ext(25313->18446744073709551615) 00002000:00010000:0.0:1762167005.025251:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e62a300. 00000100:00100000:3.0:1762167005.026511:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.026560:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451744384 00000100:00100000:2.0:1762167005.026567:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451744384 00000100:00100000:2.0:1762167005.026625:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19613 00000100:00100000:2.0:1762167005.026634:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56065:x1847765451744384:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167005.026652:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.026674:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a19 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32d8 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.026825:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a20 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.026840:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.026851:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167005.026885:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 25313 00000004:00200000:2.0:1762167005.026889:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167005.026908:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.026938:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a19 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32d8 expref: 917 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.026954:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32d8 expref: 916 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.026963:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.026966:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167005.026969:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167005.027018:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56065:x1847765451744384:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 385us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.027035:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19613 00000100:00100000:3.0:1762167005.029703:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.029816:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451744512 00000100:00100000:0.0:1762167005.029828:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451744512 00002000:00100000:0.0:1762167005.029883:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (0->28671) req@ffff9ee37fa99f80 x1847765451744512/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167005.029895:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa99f80 with x1847765451744512 ext(0->28671) 00002000:00010000:0.0:1762167005.029902:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa99f80 00000100:00100000:0.0:1762167005.029933:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2747 00000100:00100000:0.0:1762167005.029945:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451744512:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167005.031354:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451744512:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1406us (1653us total) trans 0 rc 28672/28672 00000100:00100000:0.0:1762167005.031371:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2747 00002000:00100000:0.0:1762167005.031381:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (0->28671) req@ffff9ee37fa99f80 x1847765451744512/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/440 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167005.031389:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa99f80 with x1847765451744512 ext(0->28671) 00002000:00010000:0.0:1762167005.031393:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa99f80 00000100:00100000:3.0:1762167005.032977:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.033053:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451744768 00000100:00100000:2.0:1762167005.033060:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451744768 00000100:00100000:2.0:1762167005.033101:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19614 00000100:00100000:2.0:1762167005.033109:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56065:x1847765451744768:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167005.033151:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.033173:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a20 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32d8 expref: 916 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.033187:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.033191:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167005.033368:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.033378:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.033385:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:2.0:1762167005.033436:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952701 00000004:00010000:2.0:1762167005.033454:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008ee0fbf8 reply state 0000000065135ca5 transno 8589952702 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.033460:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167005.033526:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56065:x1847765451744768:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 416us (554us total) trans 8589952702 rc 0/0 00000100:00100000:2.0:1762167005.033534:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19614 00000020:00080000:2.0:1762167005.033538:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167005.034227:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.034238:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.034246:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.034253:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167005.034256:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.034264:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.034281:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:0.0:1762167005.034284:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167005.034288:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.034294:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a27 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.034735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.034806:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451745024 00000100:00100000:0.0:1762167005.034817:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451745024 00002000:00010000:0.0:1762167005.034844:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167005.034848:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa99180 with x1847765451745024 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.034864:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa99180. 00000100:00100000:3.0:1762167005.034870:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.034908:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451745152 00000100:00100000:0.0:1762167005.034912:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451745152 00000100:00100000:3.0:1762167005.034928:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:0.0:1762167005.034931:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:0.0:1762167005.034936:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98700 with x1847765451745152 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.034942:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa98700. 00000100:00100000:1.0:1762167005.034943:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2748 00000100:00100000:1.0:1762167005.034959:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451745024:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167005.034969:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2749 00000100:00100000:0.0:1762167005.034982:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451745152:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167005.035016:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451744896 00000100:00100000:3.0:1762167005.035021:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451744896 00002000:00010000:3.0:1762167005.035042:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (108663->18446744073709551615) 00002000:00100000:3.0:1762167005.035046:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9aa00 with x1847765451744896 ext(108663->18446744073709551615) 00002000:00010000:3.0:1762167005.035053:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa9aa00. 00000100:00100000:3.0:1762167005.035075:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2750 00000100:00100000:3.0:1762167005.035084:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451744896:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:0.0:1762167005.035168:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.035171:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.035173:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:0.0:1762167005.035175:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.035177:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167005.035182:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.035186:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.035190:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167005.035192:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.035195:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167005.035217:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451745152:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 239us (350us total) trans 21474843165 rc 0/0 00000100:00100000:1.0:1762167005.035229:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451745024:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 273us (493us total) trans 17179875642 rc 0/0 00000100:00100000:0.0:1762167005.035229:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2749 00002000:00010000:0.0:1762167005.035234:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:0.0:1762167005.035238:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98700 with x1847765451745152 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.035247:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa98700. 00002000:00010000:3.0:1762167005.035251:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 25313 -> 108663 00000100:00100000:1.0:1762167005.035251:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2748 00002000:00010000:3.0:1762167005.035258:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.035258:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:3.0:1762167005.035262:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00100000:1.0:1762167005.035265:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa99180 with x1847765451745024 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167005.035266:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.035271:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 203 -> 203 00002000:00010000:1.0:1762167005.035273:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa99180. 00000100:00100000:3.0:1762167005.035297:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451744896:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 214us (369us total) trans 21474843166 rc 0/0 00000100:00100000:3.0:1762167005.035305:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2750 00002000:00010000:3.0:1762167005.035308:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (108663->18446744073709551615) 00002000:00100000:3.0:1762167005.035311:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9aa00 with x1847765451744896 ext(108663->18446744073709551615) 00002000:00010000:3.0:1762167005.035315:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa9aa00. 00000100:00100000:3.0:1762167005.037007:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.037055:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451745280 00000100:00100000:1.0:1762167005.037061:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451745280 00002000:00100000:1.0:1762167005.037097:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (28672->110591) req@ffff9ee37fcb4a80 x1847765451745280/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167005.037108:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb4a80 with x1847765451745280 ext(28672->110591) 00002000:00010000:1.0:1762167005.037112:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb4a80 00000100:00100000:1.0:1762167005.037138:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2751 00000100:00100000:1.0:1762167005.037148:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451745280:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167005.038443:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451745280:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1296us (1437us total) trans 0 rc 81920/81920 00000100:00100000:1.0:1762167005.038452:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2751 00002000:00100000:1.0:1762167005.038459:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (28672->110591) req@ffff9ee37fcb4a80 x1847765451745280/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/440 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 81920/81920 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167005.038465:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb4a80 with x1847765451745280 ext(28672->110591) 00002000:00010000:1.0:1762167005.038469:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb4a80 00000100:00100000:3.0:1762167005.041844:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.041907:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451745408 00000100:00100000:1.0:1762167005.041917:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451745408 00002000:00100000:1.0:1762167005.041973:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (65536->108662) req@ffff9ee37fcb6a00 x1847765451745408/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167005.041992:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb6a00 with x1847765451745408 ext(65536->108662) 00002000:00010000:1.0:1762167005.041997:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb6a00 00000100:00100000:1.0:1762167005.042026:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2752 00000100:00100000:1.0:1762167005.042033:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451745408:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:1.0:1762167005.043407:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451745408:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 1361us (1558us total) trans 21474843167 rc 0/0 00000100:00100000:1.0:1762167005.043419:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2752 00002000:00100000:1.0:1762167005.043430:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (65536->108662) req@ffff9ee37fcb6a00 x1847765451745408/t21474843167(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/448 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167005.043439:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb6a00 with x1847765451745408 ext(65536->108662) 00002000:00010000:1.0:1762167005.043444:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb6a00 00000100:00100000:2.0:1762167005.044642:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.044703:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451745536 00000100:00100000:3.0:1762167005.044711:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451745536 00000100:00100000:3.0:1762167005.044794:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16519 00000100:00100000:3.0:1762167005.044804:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451745536:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:2.0:1762167005.054585:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843165 is committed 00000001:00080000:2.0:1762167005.054607:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843167 is committed 00000001:00080000:2.0:1762167005.054624:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843160 is committed 00000100:00100000:3.0:1762167005.054658:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451745536:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 9851us (10015us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.054667:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16519 00000100:00100000:3.0:1762167005.055978:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.056043:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451745664 00000100:00100000:2.0:1762167005.056051:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451745664 00000100:00100000:2.0:1762167005.056101:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19615 00000100:00100000:2.0:1762167005.056113:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:56065:x1847765451745664:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167005.056136:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.056155:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a2e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32df expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.056228:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a35 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.056241:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.056252:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167005.056275:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 108663 00000004:00200000:2.0:1762167005.056279:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167005.056294:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.056317:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a2e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32df expref: 919 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.056333:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32df expref: 918 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.056341:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.056344:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167005.056347:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d000, rc 0) 00000100:00100000:2.0:1762167005.056392:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56065:x1847765451745664:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 281us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.056412:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19615 00000100:00100000:0.0:1762167005.058837:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.058885:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451745920 00000100:00100000:2.0:1762167005.058896:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451745920 00000100:00100000:2.0:1762167005.058936:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19616 00000100:00100000:2.0:1762167005.058946:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56065:x1847765451745920:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167005.058980:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.058997:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a35 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32df expref: 918 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.059008:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.059011:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167005.059162:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.059170:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.059176:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:2.0:1762167005.059209:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952703 00000004:00010000:2.0:1762167005.059225:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000096dcc975 reply state 00000000b3ace7f4 transno 8589952704 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.059230:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167005.059291:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56065:x1847765451745920:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 347us (458us total) trans 8589952704 rc 0/0 00000100:00100000:2.0:1762167005.059298:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19616 00000020:00080000:2.0:1762167005.059302:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167005.060055:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.060064:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.060068:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.060072:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167005.060075:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.060079:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.060085:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.060087:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167005.060089:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.060093:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a3c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167005.060477:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.060508:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.060526:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451746048 00000100:00100000:1.0:1762167005.060532:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451746048 00000100:00100000:0.0:1762167005.060540:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:1.0:1762167005.060552:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (122486->18446744073709551615) 00002000:00100000:1.0:1762167005.060558:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732e300 with x1847765451746048 ext(122486->18446744073709551615) 00002000:00010000:1.0:1762167005.060568:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732e300. 00000100:00100000:1.0:1762167005.060592:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451746176 00000100:00100000:2.0:1762167005.060593:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451746304 00000100:00100000:1.0:1762167005.060595:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451746176 00000100:00100000:2.0:1762167005.060596:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451746304 00000100:00100000:3.0:1762167005.060602:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2753 00002000:00010000:2.0:1762167005.060610:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:1.0:1762167005.060614:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:3.0:1762167005.060616:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451746048:12345-192.168.203.35@tcp:10:fsx.0 00002000:00100000:2.0:1762167005.060617:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732f800 with x1847765451746304 ext(0->18446744073709551615) 00002000:00100000:1.0:1762167005.060617:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732ea00 with x1847765451746176 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167005.060627:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732f800. 00002000:00010000:1.0:1762167005.060627:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732ea00. 00000100:00100000:1.0:1762167005.060648:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2754 00000100:00100000:2.0:1762167005.060654:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2755 00000100:00100000:1.0:1762167005.060657:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2358:x1847765451746176:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167005.060662:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451746304:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167005.060850:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.060854:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.060856:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:1.0:1762167005.060859:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.060862:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167005.060884:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.060887:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.060890:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167004 -> 1762167004 00002000:00010000:2.0:1762167005.060892:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.060895:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167005.060903:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765451746176:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 247us (394us total) trans 17179875643 rc 0/0 00000100:00100000:1.0:1762167005.060911:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2754 00002000:00010000:1.0:1762167005.060915:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:2.0:1762167005.060918:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451746304:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 258us (379us total) trans 21474843168 rc 0/0 00002000:00100000:1.0:1762167005.060918:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732ea00 with x1847765451746176 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167005.060923:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732ea00. 00002000:00010000:3.0:1762167005.060925:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 108663 -> 122486 00000100:00100000:2.0:1762167005.060925:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2755 00002000:00010000:2.0:1762167005.060931:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:3.0:1762167005.060932:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.060939:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167004 -> 1762167005 00002000:00100000:2.0:1762167005.060939:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732f800 with x1847765451746304 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167005.060943:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.060948:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 203 -> 137 00002000:00010000:2.0:1762167005.060948:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732f800. 00000100:00100000:3.0:1762167005.060979:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451746048:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 369us (504us total) trans 21474843169 rc 0/0 00000100:00100000:3.0:1762167005.060986:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2753 00002000:00010000:3.0:1762167005.060990:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (122486->18446744073709551615) 00002000:00100000:3.0:1762167005.060993:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732e300 with x1847765451746048 ext(122486->18446744073709551615) 00002000:00010000:3.0:1762167005.060999:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732e300. 00000100:00100000:1.0:1762167005.064411:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.064551:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451746432 00000100:00100000:3.0:1762167005.064560:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451746432 00002000:00100000:3.0:1762167005.064608:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->122879) req@ffff9ee37f795180 x1847765451746432/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167005.064628:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f795180 with x1847765451746432 ext(110592->122879) 00002000:00010000:3.0:1762167005.064633:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f795180 00000100:00100000:3.0:1762167005.064659:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2756 00000100:00100000:3.0:1762167005.064669:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451746432:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167005.064947:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451746432:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 279us (553us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1762167005.064956:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2756 00002000:00100000:3.0:1762167005.064963:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->122879) req@ffff9ee37f795180 x1847765451746432/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/12728 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167005.064971:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f795180 with x1847765451746432 ext(110592->122879) 00002000:00010000:3.0:1762167005.064975:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f795180 00000100:00100000:0.0:1762167005.067111:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.067200:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451746560 00000100:00100000:3.0:1762167005.067208:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451746560 00002000:00100000:3.0:1762167005.067245:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->122485) req@ffff9ee24732d180 x1847765451746560/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167005.067256:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732d180 with x1847765451746560 ext(69632->122485) 00002000:00010000:3.0:1762167005.067262:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732d180 00000100:00100000:3.0:1762167005.067289:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2757 00000100:00100000:3.0:1762167005.067298:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451746560:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:3.0:1762167005.068737:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451746560:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 1436us (1626us total) trans 21474843170 rc 0/0 00000100:00100000:3.0:1762167005.068748:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2757 00002000:00100000:3.0:1762167005.068758:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->122485) req@ffff9ee24732d180 x1847765451746560/t21474843170(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/448 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167005.068798:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732d180 with x1847765451746560 ext(69632->122485) 00002000:00010000:3.0:1762167005.068803:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732d180 00000100:00100000:1.0:1762167005.069733:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.069793:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451746688 00000100:00100000:3.0:1762167005.069801:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451746688 00000100:00100000:3.0:1762167005.069838:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16520 00000100:00100000:3.0:1762167005.069846:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451746688:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:2.0:1762167005.078561:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843168 is committed 00000001:00080000:2.0:1762167005.078575:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843170 is committed 00000100:00100000:3.0:1762167005.078638:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451746688:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 8789us (8903us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.078647:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16520 00000100:00100000:0.0:1762167005.079988:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.080044:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451746816 00000100:00100000:2.0:1762167005.080052:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451746816 00000100:00100000:2.0:1762167005.080090:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19617 00000100:00100000:2.0:1762167005.080099:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:56065:x1847765451746816:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167005.080121:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.080140:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a43 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32e6 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.080215:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a4a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.080226:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a4a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.080233:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a4a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167005.080251:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 122486 00000004:00200000:2.0:1762167005.080254:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167005.080265:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a4a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.080286:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a43 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32e6 expref: 921 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.080298:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a4a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32e6 expref: 920 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.080303:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.080305:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167005.080308:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d000, rc 0) 00000100:00100000:2.0:1762167005.080349:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56065:x1847765451746816:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 251us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.080355:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19617 00000100:00100000:0.0:1762167005.083343:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.083386:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451747072 00000100:00100000:2.0:1762167005.083394:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451747072 00000100:00100000:2.0:1762167005.083450:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7281 00000100:00100000:2.0:1762167005.083460:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56065:x1847765451747072:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167005.083746:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:56065:x1847765451747072:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 286us (405us total) trans 8589952705 rc 0/0 00000100:00100000:2.0:1762167005.083755:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7281 00000100:00100000:1.0:1762167005.092631:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.092689:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451747328 00000100:00100000:2.0:1762167005.092699:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451747328 00000100:00100000:2.0:1762167005.092756:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19618 00000100:00100000:2.0:1762167005.092805:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:56189:x1847765451747328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.092828:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.092846:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a51 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32ed expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.092919:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a58 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.092932:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a58 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.092942:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a58 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.092956:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.092962:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.092968:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093075:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a66 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093082:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093087:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167005.093094:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00010000:00010000:2.0:1762167005.093167:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a58 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093175:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a58 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093185:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a58 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093191:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167005.093195:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a58 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093202:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a58 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093213:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167005.093216:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167005.093220:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a58 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093225:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09a58 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093235:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093240:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a5f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093245:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093250:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167005.093252:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093258:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a5f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093265:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0100) 00010000:00010000:2.0:1762167005.093268:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167005.093270:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a5f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093276:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09a5f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.093317:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09a51 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ed expref: 924 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.093330:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a66 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ed expref: 923 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.093337:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.093339:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167005.093342:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167005.093519:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:56189:x1847765451747328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 717us (895us total) trans 8589952706 rc 0/0 00000100:00100000:2.0:1762167005.093526:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19618 00000100:00100000:0.0:1762167005.094689:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.094815:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451747456 00000100:00100000:1.0:1762167005.094829:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451747456 00000100:00100000:1.0:1762167005.094905:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 630 00000100:00100000:1.0:1762167005.094918:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:2361:x1847765451747456:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.094937:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.094965:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09a66 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32ed expref: 923 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.094987:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167005.094992:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.095054:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.095068:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:2361:x1847765451747456:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 152us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.095086:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 630 00000100:00100000:3.0:1762167005.095094:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451747712 00000100:00100000:3.0:1762167005.095101:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451747712 00000100:00100000:3.0:1762167005.095148:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19619 00000100:00100000:3.0:1762167005.095158:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:56189:x1847765451747712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.095174:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.095187:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d09a74 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32f4 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.095683:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x647:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.095695:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.095703:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167005.095712:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x647:0x0]: returning size 0 00010000:00010000:3.0:1762167005.095747:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d09a74 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32f4 expref: 925 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.095784:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32f4 expref: 924 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.095793:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167005.095798:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167005.095801:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167005.095840:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+924:56189:x1847765451747712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 684us (789us total) trans 8589952707 rc 0/0 00000100:00100000:3.0:1762167005.095844:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19619 00000100:00100000:2.0:1762167005.096969:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.097011:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451747968 00000100:00100000:3.0:1762167005.097054:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451747968 00000100:00100000:3.0:1762167005.097088:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19620 00000100:00100000:3.0:1762167005.097095:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+924:56189:x1847765451747968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.097108:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.097118:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09a89 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb32fb expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.097166:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.097177:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32f4 expref: 925 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.097185:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.097211:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32f4 expref: 925 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.097223:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32f4 expref: 925 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167005.097235:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454399872:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.097293:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.098309:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454399872:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.098327:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.098489:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.098538:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451748096 00000100:00100000:1.0:1762167005.098547:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451748096 00010000:00010000:1.0:1762167005.098574:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32f4 expref: 926 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167005.098610:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7368 00000100:00100000:1.0:1762167005.098623:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:2361:x1847765451748096:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.098638:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.098644:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32f4 expref: 926 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.098657:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32f4 expref: 926 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.098675:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09a7b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32f4 expref: 926 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.098689:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:1.0:1762167005.098692:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.098699:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.098703:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167005.098723:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.098746:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.098757:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167005.098796:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:2361:x1847765451748096:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 178us (307us total) trans 0 rc 0/0 00000004:00200000:3.0:1762167005.098802:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x647:0x0]: returning size 0 00000100:00100000:1.0:1762167005.098808:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7368 00000004:00080000:3.0:1762167005.099103:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81c:0x0], index 1: 0 00000004:00080000:3.0:1762167005.099116:0:30818:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x819:0x0], index 0: 0 00010000:00010000:3.0:1762167005.099226:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.099234:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.099240:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.099245:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.099249:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.099256:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.099268:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167005.099271:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167005.099275:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.099280:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09a90 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.099320:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09a89 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32fb expref: 925 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.099330:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167005.099332:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762167005.099336:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09a89 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32fb expref: 925 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.099345:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167005.099390:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+924:56189:x1847765451747968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2295us (2421us total) trans 8589952708 rc 301/301 00000100:00100000:3.0:1762167005.099410:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19620 00000100:00100000:2.0:1762167005.100226:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.100272:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451748352 00000100:00100000:0.0:1762167005.100279:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451748352 00000100:00100000:0.0:1762167005.100327:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7282 00000100:00100000:0.0:1762167005.100336:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+924:56189:x1847765451748352:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167005.100525:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:56189:x1847765451748352:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 189us (300us total) trans 8589952709 rc 0/0 00000100:00100000:0.0:1762167005.100532:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7282 00000100:00100000:0.0:1762167005.101821:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.101855:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451748480 00000100:00100000:3.0:1762167005.101861:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451748480 00000100:00100000:3.0:1762167005.101902:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19621 00000100:00100000:3.0:1762167005.101912:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:56189:x1847765451748480:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.101927:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.101945:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09a9e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x647:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3302 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.101992:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09aa5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x647:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.102000:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.102009:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167005.102031:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x647:0x0]: returning size 0 00000004:00200000:3.0:1762167005.102034:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167005.102053:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.102074:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09a9e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3302 expref: 927 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.102089:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3302 expref: 926 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.102097:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:3.0:1762167005.102100:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762167005.102102:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167005.102140:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:56189:x1847765451748480:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 231us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.102148:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19621 00000100:00100000:3.0:1762167005.103133:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.103155:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.103183:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451748608 00000100:00100000:2.0:1762167005.103190:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451748608 00000100:00100000:0.0:1762167005.103208:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451748736 00000100:00100000:0.0:1762167005.103214:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451748736 00000100:00100000:2.0:1762167005.103241:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16521 00000100:00100000:3.0:1762167005.103251:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16522 00000100:00100000:2.0:1762167005.103258:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451748608:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:3.0:1762167005.103263:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451748736:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.103274:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.103275:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.103287:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09aac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3310 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.103292:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09ab3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3309 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167005.103306:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x819:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:2.0:1762167005.103313:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762167005.103318:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.103321:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.103326:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.103327:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09aac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3310 expref: 16 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.103331:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.103339:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3309 expref: 32 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.103343:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09aac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3310 expref: 16 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.103360:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00010000:00010000:2.0:1762167005.103364:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3309 expref: 32 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.103375:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d400, rc 0) 00000100:00100000:3.0:1762167005.103408:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451748736:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 140us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.103413:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451748608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 161us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.103423:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16522 00000100:00100000:2.0:1762167005.103433:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16521 00000100:00100000:2.0:1762167005.104702:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.104738:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451748992 00000100:00100000:3.0:1762167005.104744:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451748992 00000100:00100000:3.0:1762167005.104818:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19622 00000100:00100000:3.0:1762167005.104829:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:56189:x1847765451748992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.104840:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.104852:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3317 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.104927:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09ac1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.104938:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.104947:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167005.104959:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00010000:00010000:3.0:1762167005.105058:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3317 expref: 929 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.105071:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3317 expref: 928 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.105079:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:3.0:1762167005.105082:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167005.105085:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922200, rc 0) 00000100:00100000:3.0:1762167005.105130:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:56189:x1847765451748992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 296us (422us total) trans 8589952710 rc 0/0 00000100:00100000:3.0:1762167005.105137:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19622 00000100:00100000:0.0:1762167005.106940:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.107006:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.107034:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.107036:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451749120 00000100:00100000:2.0:1762167005.107042:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451749120 00000100:00100000:2.0:1762167005.107072:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451749248 00000100:00100000:2.0:1762167005.107075:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451749248 00000100:00100000:0.0:1762167005.107083:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451749376 00000100:00100000:0.0:1762167005.107087:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451749376 00000100:00100000:2.0:1762167005.107103:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16523 00000100:00100000:3.0:1762167005.107112:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16524 00000100:00100000:2.0:1762167005.107114:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451749120:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167005.107138:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451749248:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167005.107149:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.107163:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.107168:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.107190:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167005.107193:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167005.107196:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 32 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.107197:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.107197:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16525 00000100:00100000:0.0:1762167005.107208:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451749376:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167005.107218:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167005.107220:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167005.107222:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.107229:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.107241:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.107244:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 32 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.107262:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.107266:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 17 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167005.107267:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 32 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167005.107277:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.107281:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.107284:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 4/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.107294:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6535:1847765454400128:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.107296:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454400000:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.107306:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 17 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.107315:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 17 pid: 26444 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1762167005.107325:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247859500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454400256:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.107359:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.107359:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.107360:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.108307:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247859500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454400256:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.108320:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6535:1847765454400128:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.108323:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.108341:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.108348:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454400000:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167005.108367:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.108611:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.108629:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.108655:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451749632 00000100:00100000:1.0:1762167005.108660:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451749504 00000100:00100000:3.0:1762167005.108661:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451749632 00000100:00100000:1.0:1762167005.108667:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451749504 00000100:00100000:0.0:1762167005.108679:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167005.108688:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 33 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.108693:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 18 pid: 26444 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.108722:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451749760 00000100:00100000:2.0:1762167005.108727:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451749760 00000100:00100000:3.0:1762167005.108728:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7369 00000100:00100000:3.0:1762167005.108742:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451749632:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762167005.108743:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7370 00002000:00100000:2.0:1762167005.108756:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (131072->154020) req@ffff9ee247859880 x1847765451749760/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1762167005.108760:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451749504:12345-192.168.203.35@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1762167005.108789:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247859880 with x1847765451749760 ext(131072->154020) 00010000:00010000:3.0:1762167005.108791:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.108797:0:26246:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 19 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.108805:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.108817:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 33 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167005.108820:0:26246:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 19 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.108826:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 19 pid: 26444 timeout: 725 lvb_type: 0 00002000:00010000:2.0:1762167005.108840:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee247859880 00010000:00010000:3.0:1762167005.108846:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 33 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.108854:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 19 pid: 26444 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.108864:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 24 00010000:00010000:3.0:1762167005.108871:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d098c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3261 expref: 33 pid: 26444 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.108875:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451749760:12345-192.168.203.35@tcp:4:fsx.0 00010000:00010000:1.0:1762167005.108877:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d098c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3268 expref: 19 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167005.108897:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.108900:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.108901:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.108904:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.108907:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.108910:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.108925:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.108927:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.108956:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.108961:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.108986:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.108993:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451749504:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 237us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.109003:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451749632:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 262us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.109013:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7370 00010000:00010000:0.0:1762167005.109019:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.109024:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7369 00010000:00010000:0.0:1762167005.109047:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.109054:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.109056:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.109061:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.109071:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.109072:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.109077:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.109094:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.109104:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.109109:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09add lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.109110:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.109120:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.109125:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.109129:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167005.109132:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.109137:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.109145:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.109150:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ad6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.109157:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451749376:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1952us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.109164:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16525 00000100:00100000:3.0:1762167005.109269:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451749248:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2145us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.109277:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16524 00000100:00100000:2.0:1762167005.110354:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451749760:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 1479us (1679us total) trans 21474843171 rc 0/0 00000100:00100000:2.0:1762167005.110364:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 24 00002000:00100000:2.0:1762167005.110373:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (131072->154020) req@ffff9ee247859880 x1847765451749760/t21474843171(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/448 e 0 to 0 dl 1762167016 ref 1 fl Complete:H/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167005.110382:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247859880 with x1847765451749760 ext(131072->154020) 00010000:00010000:2.0:1762167005.110390:0:26246:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 18 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167005.110414:0:26246:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 18 pid: 26444 timeout: 725 lvb_type: 0 00002000:00010000:2.0:1762167005.110421:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee247859880 00000100:00100000:1.0:1762167005.111808:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.111847:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451749888 00000100:00100000:3.0:1762167005.111854:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451749888 00010000:00010000:3.0:1762167005.111880:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 18 pid: 26444 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167005.111912:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7371 00000100:00100000:3.0:1762167005.111922:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451749888:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167005.111935:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1762167005.111947:0:29775:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 122486 -> 154021 00002000:00010000:3.0:1762167005.111950:0:29775:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 137 -> 161 00010000:00010000:3.0:1762167005.111956:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 18 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167005.111968:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 18 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167005.111985:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d098bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb325a expref: 18 pid: 26444 timeout: 725 lvb_type: 0 00010000:00010000:3.0:1762167005.111998:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.112000:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.112004:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.112014:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.112044:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167005.112069:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.112084:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451749888:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 160us (276us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167005.112085:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.112102:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7371 00010000:00010000:1.0:1762167005.112115:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.112133:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.112145:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.112152:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.112157:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.112169:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.112177:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.112182:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09acf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.112227:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451749120:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 5117us (5292us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.112231:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16523 00000100:00100000:1.0:1762167005.113469:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.113519:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451750016 00000100:00100000:2.0:1762167005.113525:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451750016 00000100:00100000:2.0:1762167005.113566:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16526 00000100:00100000:2.0:1762167005.113577:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451750016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.113589:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762167005.113596:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167005.113605:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09ae4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb331e expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.113622:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 154021, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888dd, blocks: 0xa1 00000100:00100000:0.0:1762167005.113632:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167005.113636:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.113639:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.113646:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb331e expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.113662:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb331e expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167005.113663:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451750144 00000100:00100000:3.0:1762167005.113669:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451750144 00000100:00100000:1.0:1762167005.113674:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451750272 00010000:00010000:2.0:1762167005.113676:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:1.0:1762167005.113687:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451750272 00000100:00100000:3.0:1762167005.113705:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16527 00000100:00100000:3.0:1762167005.113722:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451750144:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:2.0:1762167005.113722:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451750016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 143us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.113732:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16528 00010000:00010000:3.0:1762167005.113738:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762167005.113742:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16526 00000100:00100000:0.0:1762167005.113748:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451750272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.113753:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3325 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.113759:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.113798:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09af2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb332c expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167005.113813:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888dd, atime: 0x690888dc, ctime: 0x690888dd, blocks: 0x3 00002000:00010000:0.0:1762167005.113815:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888dd, atime: 0x690888dc, ctime: 0x690888dd, blocks: 0x3 00010000:00010000:0.0:1762167005.113828:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.113831:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.113831:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.113835:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.113841:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09af2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb332c expref: 18 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.113846:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3325 expref: 32 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.113868:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09af2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb332c expref: 18 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.113881:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8c00, rc 0) 00010000:00010000:3.0:1762167005.113908:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3325 expref: 32 pid: 6535 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167005.113916:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451750272:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 173us (281us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167005.113924:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:0.0:1762167005.113926:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16528 00000100:00100000:3.0:1762167005.113956:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451750144:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 241us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.113964:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16527 00000100:00100000:0.0:1762167005.138028:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.138099:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451750400 00000100:00100000:2.0:1762167005.138108:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451750400 00000100:00100000:2.0:1762167005.138180:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2758 00000100:00100000:2.0:1762167005.138192:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451750400:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167005.138225:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09af9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.138240:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.138242:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.138247:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09af9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.138261:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09af9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.140368:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09af9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.140384:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09af9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.140392:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09af9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.140411:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.140415:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09af9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.140423:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09af9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.140440:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09af9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.140447:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09af9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.140510:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451750400:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2319us (2491us total) trans 0 rc 154021/154021 00000100:00100000:2.0:1762167005.140517:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2758 00000100:00100000:1.0:1762167005.142088:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.142123:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451750528 00000100:00100000:2.0:1762167005.142131:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451750528 00000100:00100000:2.0:1762167005.142185:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2759 00000100:00100000:2.0:1762167005.142192:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451750528:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:2.0:1762167005.142217:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.142229:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09ab3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3309 expref: 32 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.142235:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.142236:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.142239:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.142262:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3309 expref: 32 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.142271:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3309 expref: 32 pid: 26444 timeout: 725 lvb_type: 1 00000100:00100000:2.0:1762167005.142281:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454400384:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.142332:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.143196:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454400384:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.143213:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.143414:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.143522:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451750656 00000100:00100000:3.0:1762167005.143527:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451750656 00010000:00010000:3.0:1762167005.143554:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3309 expref: 33 pid: 26444 timeout: 725 lvb_type: 1 00000100:00100000:3.0:1762167005.143589:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7372 00000100:00100000:3.0:1762167005.143597:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451750656:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167005.143607:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.143623:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3309 expref: 33 pid: 26444 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167005.143632:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3309 expref: 33 pid: 26444 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167005.143645:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d09ab3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3309 expref: 33 pid: 26444 timeout: 725 lvb_type: 1 00010000:00010000:3.0:1762167005.143654:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.143655:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.143666:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.143674:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.143691:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167005.143718:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451750656:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 122us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.143723:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7372 00010000:00010000:2.0:1762167005.143724:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.143741:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167005.156718:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875637 is committed 00000001:00080000:1.0:1762167005.156727:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875643 is committed 00002000:00010000:2.0:1762167005.156788:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 0 -> 154021 00000001:00080000:1.0:1762167005.156790:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875644 is committed 00002000:00010000:2.0:1762167005.156793:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 0 -> 1762167005 00000001:00080000:3.0:1762167005.156795:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875639 is committed 00002000:00010000:2.0:1762167005.156797:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 0 -> 1762167005 00002000:00010000:2.0:1762167005.156801:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 1 -> 515 00010000:00010000:2.0:1762167005.156813:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.156823:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.156830:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.156834:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.156838:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.156844:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.156860:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.156866:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.156966:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451750528:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14769us (14875us total) trans 17179875644 rc 0/0 00000100:00100000:2.0:1762167005.156978:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2759 00000100:00100000:1.0:1762167005.158386:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.158435:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451750784 00000100:00100000:3.0:1762167005.158444:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451750784 00000100:00100000:3.0:1762167005.158488:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19623 00000100:00100000:3.0:1762167005.158497:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:56189:x1847765451750784:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:1.0:1762167005.171739:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952709 is committed 00000004:00080000:1.0:1762167005.171834:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3470 committed 00000004:00080000:1.0:1762167005.171852:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3457 committed 00000020:00080000:1.0:1762167005.171880:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee349c6a480 refcount 2 committed 0 result 0 batchid 4294969178 00000020:00080000:1.0:1762167005.171885:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f672e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee349c6ae40 00000020:00080000:1.0:1762167005.171889:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f672500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee349c6a240 00000020:00080000:1.0:1762167005.171893:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f672a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3456e3800 00000020:00080000:1.0:1762167005.171897:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].46 00000001:00080000:1.0:1762167005.171938:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952710 is committed 00000100:00100000:3.0:1762167005.171966:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56189:x1847765451750784:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 13455us (13567us total) trans 0 rc 0/0 00000020:00080000:1.0:1762167005.171969:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969178 committed batchid 4294969177 00000100:00100000:3.0:1762167005.171992:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19623 00000100:00100000:2.0:1762167005.172060:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454400640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.172134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.172173:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454400512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.172197:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454400640 00000020:00080000:1.0:1762167005.172202:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969177 00000100:00100000:3.0:1762167005.172209:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454400640 00000100:00100000:2.0:1762167005.172210:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.172285:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454400512 00000100:00100000:3.0:1762167005.172291:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454400512 00000100:00100000:0.0:1762167005.172297:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16529 00000100:00100000:0.0:1762167005.172317:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765454400640:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.172323:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16530 00000100:00100000:2.0:1762167005.172344:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765454400512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762167005.172353:0:33894:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2072 count 1 00002000:00080000:2.0:1762167005.172362:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2075 count 1 00010000:00010000:2.0:1762167005.172381:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167005.172386:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x818:0x0] initial LVB size: 92016, mtime: 0x690888dc, atime: 0x690888dc, ctime: 0x690888dd, blocks: 0x103 00010000:00010000:0.0:1762167005.172409:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.172415:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.172424:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.172429:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.172429:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.172432:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167005.172437:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.172449:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.172466:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.172467:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.172486:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.172493:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 20 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1762167005.172499:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.172512:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242522a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454400768:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.172532:0:33894:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762167005.172587:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00010000:00010000:1.0:1762167005.172790:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167005.172797:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.172805:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.172810:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.172819:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.172834:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.172841:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.172858:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167005.172859:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167005.172861:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167005.172917:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765454400640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 610us (791us total) trans 21474843172 rc 0/0 00000100:00100000:0.0:1762167005.172926:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16529 00000100:00100000:2.0:1762167005.172996:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843160 gen 2 00000004:00080000:2.0:1762167005.173002:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843160 committed transno 21474843160 00000100:00100000:2.0:1762167005.173022:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36dce7100 x1847765454400640/t21474843172(21474843172) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762167021 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762167005.173033:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce7100/2, rc 0, transno 21474843172 00000100:00100000:2.0:1762167005.173037:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454400640:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.173883:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242522a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454400768:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.173903:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.174226:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.174379:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451750912 00000100:00100000:3.0:1762167005.174385:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451750912 00010000:00010000:3.0:1762167005.174424:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 21 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:1.0:1762167005.174495:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7373 00000100:00100000:1.0:1762167005.174507:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451750912:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.174520:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.174526:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 21 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.174540:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 21 pid: 33892 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.174560:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d097f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb321b expref: 21 pid: 33892 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1762167005.174562:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167005.174575:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.174577:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.174581:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.174589:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.174609:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167005.174623:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.174656:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451751040 00000100:00100000:2.0:1762167005.174662:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451751040 00010000:00010000:3.0:1762167005.174666:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.174666:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451750912:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 160us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.174675:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7373 00010000:00010000:3.0:1762167005.174676:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.174684:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.174694:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451751168 00010000:00010000:3.0:1762167005.174697:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.174699:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451751168 00000100:00100000:1.0:1762167005.174705:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16531 00000100:00100000:1.0:1762167005.174715:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451751040:12345-192.168.203.35@tcp:16:lfs.0 00010000:00010000:3.0:1762167005.174717:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762167005.174730:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16532 00000100:00100000:2.0:1762167005.174739:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451751168:12345-192.168.203.35@tcp:16:lfs.0 00010000:00010000:0.0:1762167005.174744:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167005.174750:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.174785:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.174790:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.174798:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.174805:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451751040:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 91us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.174815:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451751168:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 75us (204us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167005.174815:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.174822:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16531 00010000:00010000:0.0:1762167005.174829:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d09b0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.174835:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16532 00010000:00010000:0.0:1762167005.174851:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167005.174853:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167005.174855:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167005.175258:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765454400512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2923us (3052us total) trans 17179875645 rc 0/0 00000100:00100000:3.0:1762167005.175263:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16530 00000100:00100000:2.0:1762167005.175319:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875639 gen 2 00000004:00080000:2.0:1762167005.175324:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242521f80, transno 17179875624 00000004:00080000:2.0:1762167005.175338:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242521500, transno 17179875625 00000004:00080000:2.0:1762167005.175341:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242520700, transno 17179875626 00000004:00080000:2.0:1762167005.175344:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242520e00, transno 17179875627 00000004:00080000:2.0:1762167005.175347:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242520380, transno 17179875628 00000004:00080000:2.0:1762167005.175349:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242521c00, transno 17179875629 00000004:00080000:2.0:1762167005.175352:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242523480, transno 17179875630 00000004:00080000:2.0:1762167005.175354:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc33480, transno 17179875631 00000004:00080000:2.0:1762167005.175356:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcced80, transno 17179875632 00000004:00080000:2.0:1762167005.175360:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240e300, transno 17179875633 00000004:00080000:2.0:1762167005.175363:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243304000, transno 17179875634 00000004:00080000:2.0:1762167005.175366:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fa98e00, transno 17179875635 00000004:00080000:2.0:1762167005.175370:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243305880, transno 17179875636 00000004:00080000:2.0:1762167005.175373:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243305500, transno 17179875637 00000004:00080000:2.0:1762167005.175377:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875639 committed transno 17179875639 00000100:00100000:2.0:1762167005.175392:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee24785ad80 x1847765454400512/t17179875645(17179875645) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762167021 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762167005.175414:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24785ad80/2, rc 0, transno 17179875645 00000100:00100000:2.0:1762167005.175419:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454400512:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1762167005.175548:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 3 in progress, 0 in flight, 12 done 00000100:00100000:0.0:1762167005.182195:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.182227:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.182256:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.182302:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451751296 00000100:00100000:2.0:1762167005.182303:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451751424 00000100:00100000:3.0:1762167005.182313:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451751296 00000100:00100000:2.0:1762167005.182314:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451751424 00000100:00100000:1.0:1762167005.182333:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451751552 00000100:00100000:1.0:1762167005.182339:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451751552 00000100:00100000:2.0:1762167005.182382:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16533 00000100:00100000:3.0:1762167005.182391:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16534 00000100:00100000:2.0:1762167005.182408:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451751424:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167005.182411:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16535 00000100:00100000:3.0:1762167005.182415:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451751296:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167005.182427:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451751552:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167005.182463:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b1c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.182463:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b23 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.182463:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09b15 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.182489:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.182489:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.182490:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.182493:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.182494:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.182495:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.182499:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.182500:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09b15 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.182502:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b23 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.182526:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.182527:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09b15 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.182529:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b23 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.182567:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b1c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.182567:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09b15 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.182570:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b23 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.182593:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.182593:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09b15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.182594:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b23 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.182617:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.182620:0:33894:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09b15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.182622:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.182639:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.182640:0:33894:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.182643:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.182648:0:33894:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09b15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.182649:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.182650:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.182674:0:33894:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09b15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.182678:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.182678:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.182699:0:33894:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09b15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.182706:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.182706:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.182709:0:33894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d09b15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.182733:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.182733:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.182819:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451751296:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 421us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.182825:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451751424:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 429us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.182825:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451751552:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 397us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.182831:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16534 00000100:00100000:1.0:1762167005.182844:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16535 00000100:00100000:2.0:1762167005.182853:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16533 00000100:00100000:1.0:1762167005.184008:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.184052:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451751808 00000100:00100000:3.0:1762167005.184059:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451751808 00000100:00100000:3.0:1762167005.184107:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19624 00000100:00100000:3.0:1762167005.184116:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56189:x1847765451751808:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167005.184174:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.184197:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09aa5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x647:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3302 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.184222:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:3.0:1762167005.184231:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.184279:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x647:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.184291:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.184299:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:3.0:1762167005.184472:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b31240ca reply state 00000000d1e7199e transno 8589952711 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.184480:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167005.184567:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56189:x1847765451751808:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 452us (560us total) trans 8589952711 rc 0/0 00000100:00100000:3.0:1762167005.184575:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19624 00010000:00010000:3.0:1762167005.185471:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.185481:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.185486:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.185489:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.185492:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.185499:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.185508:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:3.0:1762167005.185511:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.185515:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.185520:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09b2a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x647:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167005.185676:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.185822:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451751936 00000100:00100000:3.0:1762167005.185828:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451751936 00000100:00100000:3.0:1762167005.185864:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19625 00000100:00100000:3.0:1762167005.185873:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56189:x1847765451751936:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.185889:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.185903:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b31 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x647:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3333 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.185959:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b31 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3333 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.185976:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b31 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3333 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.185993:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23d00) 00010000:00010000:3.0:1762167005.185997:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167005.185999:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:3.0:1762167005.186033:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56189:x1847765451751936:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 161us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.186040:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19625 00000100:00100000:0.0:1762167005.187310:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.187358:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.187430:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451752064 00000100:00100000:2.0:1762167005.187437:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451752064 00000100:00100000:1.0:1762167005.187454:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451752192 00000100:00100000:1.0:1762167005.187460:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451752192 00000100:00100000:2.0:1762167005.187486:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16536 00000100:00100000:2.0:1762167005.187496:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451752064:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167005.187506:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16537 00000100:00100000:1.0:1762167005.187516:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451752192:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167005.187748:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.187752:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 0 -> 1762167005 00002000:00010000:1.0:1762167005.187754:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 0 -> 1762167005 00002000:00010000:1.0:1762167005.187757:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 0 -> 1762167005 00002000:00010000:1.0:1762167005.187759:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167005.187789:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451752064:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 269us (458us total) trans 17179875646 rc 0/0 00000100:00100000:2.0:1762167005.187798:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16536 00000100:00100000:1.0:1762167005.187807:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451752192:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 292us (448us total) trans 21474843173 rc 0/0 00000100:00100000:1.0:1762167005.187819:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16537 00000100:00100000:0.0:1762167005.188743:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.188869:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451752448 00000100:00100000:3.0:1762167005.188875:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451752448 00000100:00100000:3.0:1762167005.188910:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19626 00000100:00100000:3.0:1762167005.188919:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56189:x1847765451752448:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:3.0:1762167005.188962:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b38 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x647:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.188975:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b38 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.188995:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b38 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.189013:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b38 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.189020:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b38 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.189026:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b38 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.189032:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.189036:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b38 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.189042:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b38 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.189050:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23d00) 00010000:00010000:3.0:1762167005.189052:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1762167005.189055:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b38 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x647:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.189059:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b38 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x647:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.189105:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56189:x1847765451752448:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 187us (362us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762167005.189112:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19626 00000100:00100000:3.0:1762167005.190283:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.190334:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451752704 00000100:00100000:2.0:1762167005.190339:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451752704 00000100:00100000:2.0:1762167005.190384:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19627 00000100:00100000:2.0:1762167005.190393:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56189:x1847765451752704:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167005.190439:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.190459:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09a4a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32e6 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.190470:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.190473:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167005.190500:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.190510:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.190519:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:2.0:1762167005.190650:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000989e7564 reply state 00000000a4c223a1 transno 8589952712 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.190658:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167005.190728:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56189:x1847765451752704:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 335us (446us total) trans 8589952712 rc 0/0 00000100:00100000:2.0:1762167005.190735:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19627 00010000:00010000:2.0:1762167005.191837:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.191849:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.191857:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.191863:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167005.191867:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.191875:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.191893:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.191896:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167005.191900:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.191906:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09b3f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.191997:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.192034:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.192063:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.192090:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451752832 00000100:00100000:1.0:1762167005.192096:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451752832 00000100:00100000:2.0:1762167005.192112:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451752960 00000100:00100000:2.0:1762167005.192118:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451752960 00000100:00100000:1.0:1762167005.192131:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451753088 00000100:00100000:1.0:1762167005.192136:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451753088 00000100:00100000:2.0:1762167005.192174:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16538 00000100:00100000:0.0:1762167005.192187:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16539 00000100:00100000:2.0:1762167005.192188:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451752832:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167005.192202:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16540 00000100:00100000:0.0:1762167005.192208:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451752960:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167005.192221:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451753088:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762167005.192327:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 154021 -> 154021 00002000:00010000:2.0:1762167005.192331:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.192334:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.192335:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.192337:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 161 -> 161 00002000:00010000:1.0:1762167005.192371:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.192375:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167005.192380:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451752832:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 195us (382us total) trans 21474843174 rc 0/0 00002000:00010000:1.0:1762167005.192380:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167004 -> 1762167005 00002000:00010000:1.0:1762167005.192382:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.192386:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.192390:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.192406:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167005.192411:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16538 00002000:00010000:0.0:1762167005.192412:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167004 -> 1762167005 00002000:00010000:0.0:1762167005.192417:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.192420:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167005.192431:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451753088:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 220us (366us total) trans 21474843175 rc 0/0 00000100:00100000:1.0:1762167005.192440:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16540 00000100:00100000:0.0:1762167005.192451:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451752960:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 247us (414us total) trans 17179875647 rc 0/0 00000100:00100000:0.0:1762167005.192461:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16539 00000100:00100000:0.0:1762167005.193826:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.193877:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451753344 00000100:00100000:2.0:1762167005.193883:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451753344 00000100:00100000:2.0:1762167005.193933:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7283 00000100:00100000:2.0:1762167005.193941:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56189:x1847765451753344:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167005.194004:0:33886:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3317 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.194036:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.194049:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09986 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a7 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.194057:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32b5 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.194064:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.194110:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32b5 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.194123:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32b5 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.194137:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454400896:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.194232:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09986 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a7 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.194242:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09986 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a7 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.194251:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242523100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454401024:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.194276:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.195357:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454400896:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.195369:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242523100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454401024:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.195387:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167005.195470:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.195523:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451753728 00000100:00100000:0.0:1762167005.195528:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.195529:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451753728 00010000:00010000:1.0:1762167005.195553:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09986 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a7 expref: 896 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.195567:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451753600 00000100:00100000:2.0:1762167005.195572:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451753600 00000100:00100000:1.0:1762167005.195590:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7374 00000100:00100000:1.0:1762167005.195600:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451753728:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167005.195613:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7284 00010000:00010000:1.0:1762167005.195614:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.195624:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09986 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a7 expref: 897 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.195629:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:49238:x1847765451753600:12345-192.168.203.35@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1762167005.195651:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09986 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a7 expref: 897 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.195682:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09986 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32a7 expref: 897 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:1.0:1762167005.195698:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167005.195703:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167005.195711:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167005.195717:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167005.195759:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451753728:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 160us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.195788:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7374 00000100:00100000:2.0:1762167005.195822:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:49238:x1847765451753600:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 198us (292us total) trans 8589952713 rc 0/0 00000100:00100000:2.0:1762167005.195831:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7284 00000100:00100000:1.0:1762167005.196837:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.196917:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451753856 00000100:00100000:2.0:1762167005.196922:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451753856 00010000:00010000:2.0:1762167005.196942:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32b5 expref: 896 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.196971:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7375 00000100:00100000:2.0:1762167005.196978:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451753856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.196987:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.196992:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32b5 expref: 896 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167005.197009:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32b5 expref: 896 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167005.197025:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d099b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb32b5 expref: 896 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167005.197037:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167005.197041:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.197049:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.197055:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.197083:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.197106:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.197117:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167005.197126:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451753856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 144us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.197135:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7375 00010000:00010000:3.0:1762167005.197137:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.197150:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b31 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3333 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.197158:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.197187:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b31 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3333 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.197200:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b31 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3333 expref: 894 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:3.0:1762167005.197213:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454401152:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.197322:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.198295:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454401152:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.198316:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167005.198356:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.198410:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451753984 00000100:00100000:2.0:1762167005.198416:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451753984 00010000:00010000:2.0:1762167005.198438:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b31 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3333 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00000100:00100000:2.0:1762167005.198470:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7376 00000100:00100000:2.0:1762167005.198479:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451753984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.198493:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.198498:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b31 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3333 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167005.198511:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b31 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3333 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167005.198526:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09b31 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x647:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3333 expref: 895 pid: 30818 timeout: 725 lvb_type: 0 00010000:00010000:2.0:1762167005.198538:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23d00) 00010000:00010000:2.0:1762167005.198542:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.198550:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.198555:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.198577:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.198596:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.198603:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167005.198611:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451753984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 134us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.198616:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7376 00000100:00100000:3.0:1762167005.199138:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401280:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.199184:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.199215:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.199237:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454401280 00000100:00100000:2.0:1762167005.199243:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454401280 00000100:00100000:2.0:1762167005.199277:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1762167005.199284:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401280:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.199350:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401280:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.199358:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:3.0:1762167005.199382:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401280:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.199434:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401408:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.199459:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.199482:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72840 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.199509:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454401408 00000100:00100000:2.0:1762167005.199514:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454401408 00000100:00100000:2.0:1762167005.199547:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1762167005.199554:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401408:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.199608:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401408:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.199615:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1762167005.199625:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401408:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.199668:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401536:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.199692:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.199714:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.199714:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454401536 00000100:00100000:1.0:1762167005.199720:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454401536 00000100:00100000:1.0:1762167005.199794:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1762167005.199803:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401536:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167005.199856:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401536:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.199863:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1762167005.199875:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401536:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.199911:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401664:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.199934:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.199952:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee243596e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.199973:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454401664 00000100:00100000:2.0:1762167005.199978:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454401664 00000100:00100000:2.0:1762167005.200082:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1762167005.200090:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401664:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.200153:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401664:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 64us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.200161:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1762167005.200173:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401664:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.200203:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401792:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.200221:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.200242:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.200242:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454401792 00000100:00100000:2.0:1762167005.200247:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454401792 00000100:00100000:2.0:1762167005.200282:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1762167005.200290:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401792:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.200342:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401792:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.200348:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1762167005.200354:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401792:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.200387:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401920:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.200418:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.200436:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.200450:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454401920 00000100:00100000:2.0:1762167005.200455:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454401920 00000100:00100000:2.0:1762167005.200483:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:2.0:1762167005.200489:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401920:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.200539:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454401920:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 48us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.200546:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1762167005.200551:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454401920:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.200578:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402048:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.200592:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.200604:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.200624:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454402048 00000100:00100000:2.0:1762167005.200629:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454402048 00000100:00100000:2.0:1762167005.200654:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1762167005.200662:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402048:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.200713:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402048:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.200719:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1762167005.200731:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402048:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.200793:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402176:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.200819:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.200836:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.200839:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454402176 00000100:00100000:2.0:1762167005.200845:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454402176 00000100:00100000:2.0:1762167005.200882:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1762167005.200890:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402176:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.200941:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402176:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 52us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.200948:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1762167005.200955:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402176:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.200998:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402304:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.201027:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.201049:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731f00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.201066:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454402304 00000100:00100000:1.0:1762167005.201072:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454402304 00000100:00100000:1.0:1762167005.201113:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:1.0:1762167005.201123:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402304:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167005.201187:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402304:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 65us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.201195:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1762167005.201198:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402304:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.201227:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402432:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.201248:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.201264:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.201270:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454402432 00000100:00100000:1.0:1762167005.201276:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454402432 00000100:00100000:1.0:1762167005.201308:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1762167005.201314:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402432:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167005.201377:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402432:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 62us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.201385:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1762167005.201392:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402432:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.201436:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402560:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.201457:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.201511:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731f00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.201553:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454402560 00000100:00100000:1.0:1762167005.201557:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454402560 00000100:00100000:1.0:1762167005.201588:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1762167005.201595:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402560:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167005.201647:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402560:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 52us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.201653:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1762167005.201703:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402560:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.201730:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402688:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.201749:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.201811:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.201818:0:32133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454402688 00000100:00100000:1.0:1762167005.201823:0:32133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454402688 00000100:00100000:1.0:1762167005.201851:0:32133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1762167005.201858:0:32133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402688:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762167005.201909:0:32133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402688:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.201916:0:32133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1762167005.201922:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402688:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.201960:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402816:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.201984:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.202013:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454402816 00000100:00100000:3.0:1762167005.202017:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.202018:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454402816 00000100:00100000:2.0:1762167005.202057:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1762167005.202066:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402816:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.202119:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402816:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.202129:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1762167005.202157:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402816:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.202194:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402944:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.202217:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.202241:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.202281:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454402944 00000100:00100000:2.0:1762167005.202286:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454402944 00000100:00100000:2.0:1762167005.202321:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1762167005.202328:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402944:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.202388:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454402944:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 60us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.202409:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1762167005.202424:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454402944:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:3.0:1762167005.202735:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].47, 816 off60624 00000001:00080000:3.0:1762167005.202748:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952714 00000100:00100000:3.0:1762167005.202853:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454403072:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.202884:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.202903:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.202920:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454403072 00000100:00100000:2.0:1762167005.202926:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454403072 00000100:00100000:2.0:1762167005.202956:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1762167005.202964:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454403072:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.203223:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33886:x1847765454403072:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 260us (337us total) trans 21474843176 rc 0/0 00000100:00100000:2.0:1762167005.203230:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:3.0:1762167005.203264:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454403072:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.203286:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc32d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454403200:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762167005.203309:0:33886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.203337:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.203363:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454403200 00000100:00100000:2.0:1762167005.203369:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454403200 00000100:00100000:2.0:1762167005.203402:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1762167005.203409:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:33886:x1847765454403200:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762167005.203556:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:33886:x1847765454403200:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 147us (246us total) trans 17179875648 rc 0/0 00000100:00100000:2.0:1762167005.203561:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1762167005.203589:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc32d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:33886:1847765454403200:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762167005.203671:0:33886:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952715 00010000:00010000:3.0:1762167005.203700:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203711:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203718:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203725:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.203729:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203737:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203753:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23d00) 00010000:00010000:3.0:1762167005.203756:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762167005.203783:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203795:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b4d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x647:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203815:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203821:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203826:0:33886:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203830:0:33886:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.203833:0:33886:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203839:0:33886:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203848:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:3.0:1762167005.203850:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762167005.203854:0:33886:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203860:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09b46 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.203872:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0f00) 00010000:00010000:3.0:1762167005.203875:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167005.203881:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09ac1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3317 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.203985:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56189:x1847765451753344:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 10044us (10169us total) trans 8589952716 rc 0/0 00000100:00100000:3.0:1762167005.203994:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7283 00000020:00080000:3.0:1762167005.203998:0:33886:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762167005.206500:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.206584:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451754112 00000100:00100000:2.0:1762167005.206592:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451754112 00000100:00100000:0.0:1762167005.206799:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19628 00000100:00100000:0.0:1762167005.206813:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56189:x1847765451754112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.206836:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.206861:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09b54 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb333a expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.206928:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09b54 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb333a expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.206943:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09b54 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb333a expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.206962:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167005.206965:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167005.206969:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9c00, rc 0) 00000100:00100000:0.0:1762167005.207017:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56189:x1847765451754112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 209us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.207027:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19628 00000100:00100000:1.0:1762167005.209053:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.209097:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451754368 00000100:00100000:3.0:1762167005.209141:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451754368 00000100:00100000:3.0:1762167005.209192:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7285 00000100:00100000:3.0:1762167005.209199:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56189:x1847765451754368:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167005.209462:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56189:x1847765451754368:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 261us (414us total) trans 8589952717 rc 0/0 00000100:00100000:3.0:1762167005.209471:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7285 00000100:00100000:1.0:1762167005.210871:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.211009:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451754624 00000100:00100000:3.0:1762167005.211016:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451754624 00000100:00100000:3.0:1762167005.211058:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7286 00000100:00100000:3.0:1762167005.211066:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56189:x1847765451754624:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:3.0:1762167005.211297:0:33886:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x647:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762167005.211422:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x647:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.211436:0:33886:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.211449:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.211456:0:33886:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.211462:0:33886:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.211481:0:33886:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.211506:0:33886:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762167005.211597:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1762167005.211601:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56189:x1847765451754624:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 534us (731us total) trans 8589952718 rc 0/0 00010000:00010000:1.0:1762167005.211604:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167005.211608:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7286 00010000:00010000:1.0:1762167005.211611:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.211615:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167005.211622:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x647:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167005.211634:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x647:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:1.0:1762167005.211638:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762167005.211643:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 1/0,0 mode: --/PW res: [0x200000404:0x647:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167005.211649:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09b5b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x647:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167005.211669:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167005.211671:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167005.211673:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167005.222563:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.222639:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451754752 00000100:00100000:0.0:1762167005.222651:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451754752 00000100:00100000:0.0:1762167005.222721:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19629 00000100:00100000:0.0:1762167005.222731:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56190:x1847765451754752:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.222757:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.222807:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09b62 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3341 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.222879:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b69 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.222894:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b69 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.222904:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b69 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.222918:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09b70 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.222925:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09b70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.222932:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09b70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223037:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223045:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223053:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167005.223085:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000004:00200000:0.0:1762167005.223090:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167005.223106:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223117:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223125:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b69 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223130:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b69 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223136:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b69 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223142:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167005.223146:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b69 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223152:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b69 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223163:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167005.223166:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167005.223171:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b69 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223178:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09b69 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223191:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09b70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223197:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09b70 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223202:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09b70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223207:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167005.223209:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09b70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223214:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09b70 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223221:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2446b8c00) 00010000:00010000:0.0:1762167005.223224:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167005.223227:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09b70 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223239:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09b70 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.223270:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09b62 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3341 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.223283:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3341 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.223291:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167005.223293:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167005.223296:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:0.0:1762167005.223359:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56190:x1847765451754752:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 630us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.223366:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19629 00000100:00100000:0.0:1762167005.225419:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.225497:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451755008 00000100:00100000:3.0:1762167005.225506:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451755008 00000100:00100000:3.0:1762167005.225612:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19630 00000100:00100000:3.0:1762167005.225622:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56190:x1847765451755008:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.225641:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.225659:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09b7e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3348 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.225755:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b85 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.225812:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b85 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.225823:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b85 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167005.225834:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00010000:00010000:3.0:1762167005.225976:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09b7e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3348 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.225993:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b85 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3348 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.226001:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.226004:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167005.226007:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167005.226060:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56190:x1847765451755008:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 439us (665us total) trans 8589952719 rc 0/0 00000100:00100000:3.0:1762167005.226068:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19630 00000100:00100000:3.0:1762167005.227578:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.227635:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451755264 00000100:00100000:0.0:1762167005.227642:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451755264 00000100:00100000:0.0:1762167005.227698:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19631 00000100:00100000:0.0:1762167005.227708:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56190:x1847765451755264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.227729:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.227747:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09b93 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb334f expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.227848:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09b9a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.227859:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09b9a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.227866:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09b9a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167005.227875:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00010000:00010000:0.0:1762167005.227952:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09b93 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb334f expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.227964:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09b9a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb334f expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.227973:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167005.227976:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167005.227977:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8600, rc 0) 00000100:00100000:0.0:1762167005.228020:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56190:x1847765451755264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 315us (448us total) trans 8589952720 rc 0/0 00000100:00100000:0.0:1762167005.228024:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19631 00000100:00100000:1.0:1762167005.253294:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.253414:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451755392 00000100:00100000:2.0:1762167005.253429:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451755392 00000100:00100000:2.0:1762167005.253508:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2760 00000100:00100000:2.0:1762167005.253519:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451755392:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167005.253556:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09ba8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.253571:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.253573:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.253578:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09ba8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.253593:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09ba8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.255819:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09ba8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.255836:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09ba8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.255866:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09ba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.255874:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.255878:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09ba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.255888:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09ba8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.255907:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09ba8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.255916:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09ba8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.256000:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451755392:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2481us (2717us total) trans 0 rc 154021/154021 00000100:00100000:2.0:1762167005.256012:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2760 00000100:00100000:3.0:1762167005.258303:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.258352:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451755520 00000100:00100000:2.0:1762167005.258361:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451755520 00000100:00100000:2.0:1762167005.258439:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2761 00000100:00100000:2.0:1762167005.258450:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451755520:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:2.0:1762167005.258497:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 154021, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:2.0:1762167005.258507:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09baf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.258520:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.258523:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.258528:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09baf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.258542:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09baf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.260120:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09baf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.260135:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09baf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.260150:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.260158:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.260172:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.260185:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09baf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.260201:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09baf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.260209:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09baf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.260271:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451755520:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1820us (1971us total) trans 0 rc 154021/154021 00000100:00100000:2.0:1762167005.260282:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2761 00000100:00100000:1.0:1762167005.267263:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.267340:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451755648 00000100:00100000:2.0:1762167005.267353:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451755648 00000100:00100000:2.0:1762167005.267456:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 631 00000100:00100000:2.0:1762167005.267468:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56190:x1847765451755648:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762167005.267487:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.267519:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09b9a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb334f expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.267551:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167005.267557:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.267626:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56190:x1847765451755648:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 160us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.267634:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 631 00000100:00100000:3.0:1762167005.269026:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.269109:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451755904 00000100:00100000:2.0:1762167005.269118:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451755904 00000100:00100000:2.0:1762167005.269171:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7287 00000100:00100000:2.0:1762167005.269181:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56190:x1847765451755904:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167005.269417:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56190:x1847765451755904:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 238us (399us total) trans 8589952721 rc 0/0 00000100:00100000:2.0:1762167005.269426:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7287 00000100:00100000:0.0:1762167005.271811:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.271907:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451756160 00000100:00100000:3.0:1762167005.271916:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451756160 00000100:00100000:3.0:1762167005.271983:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19632 00000100:00100000:3.0:1762167005.271993:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451756160:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167005.272014:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.272032:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bb6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3356 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.272124:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.272139:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3341 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.272147:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.272179:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3341 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.272192:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3341 expref: 904 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:3.0:1762167005.272205:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454403328:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.272277:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.273255:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454403328:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.273273:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167005.273600:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.273675:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451756288 00000100:00100000:2.0:1762167005.273681:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451756288 00010000:00010000:2.0:1762167005.273709:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3341 expref: 905 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.273744:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7377 00000100:00100000:2.0:1762167005.273755:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2360:x1847765451756288:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.273788:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.273799:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3341 expref: 905 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.273813:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3341 expref: 905 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.273837:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09b77 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3341 expref: 905 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.273853:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167005.273858:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.273867:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.273875:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.273902:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.273933:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.273942:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167005.273950:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2360:x1847765451756288:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 197us (349us total) trans 0 rc 0/0 00000004:00200000:3.0:1762167005.273958:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000100:00100000:2.0:1762167005.273959:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7377 00010000:00010000:3.0:1762167005.274100:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bb6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3356 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.274115:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3356 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.274122:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.274124:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167005.274125:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167005.274161:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451756160:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2170us (2358us total) trans 8589952722 rc 0/0 00000100:00100000:3.0:1762167005.274213:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19632 00000100:00100000:0.0:1762167005.275797:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.275843:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451756416 00000100:00100000:3.0:1762167005.275852:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451756416 00000100:00100000:3.0:1762167005.275896:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19633 00000100:00100000:3.0:1762167005.275905:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451756416:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167005.275922:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.275949:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09bcb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb335d expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.276018:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.276031:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3356 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.276039:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.276066:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3356 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.276077:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3356 expref: 905 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:3.0:1762167005.276090:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454403456:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.276152:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.276989:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454403456:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.277007:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167005.277241:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.277281:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451756544 00000100:00100000:2.0:1762167005.277287:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451756544 00010000:00010000:2.0:1762167005.277311:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3356 expref: 906 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.277340:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7378 00000100:00100000:2.0:1762167005.277347:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2361:x1847765451756544:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.277357:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.277362:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3356 expref: 906 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.277378:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3356 expref: 906 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.277413:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d09bbd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3356 expref: 906 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.277429:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167005.277434:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.277441:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.277449:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.277471:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.277502:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.277512:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167005.277514:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2361:x1847765451756544:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.277529:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7378 00000004:00200000:3.0:1762167005.277554:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000004:00200000:3.0:1762167005.277559:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167005.277577:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.277603:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09bcb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb335d expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.277617:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb335d expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.277623:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.277626:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167005.277628:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167005.277666:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451756416:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1762us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.277675:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19633 00000100:00100000:0.0:1762167005.279691:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.279747:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.279815:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451756800 00000100:00100000:1.0:1762167005.279824:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451756800 00000100:00100000:3.0:1762167005.279872:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451756672 00000100:00100000:1.0:1762167005.279878:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16541 00000100:00100000:3.0:1762167005.279879:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451756672 00000100:00100000:1.0:1762167005.279891:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451756800:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167005.279910:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167005.279918:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16542 00010000:00010000:1.0:1762167005.279926:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09bd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb336b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.279941:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451756672:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167005.279952:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167005.279960:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.279964:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.279967:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09be0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3364 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.279973:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb336b expref: 22 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167005.279996:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb336b expref: 22 pid: 6532 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1762167005.280000:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 154021, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:1.0:1762167005.280010:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7bc00, rc 0) 00010000:00010000:3.0:1762167005.280015:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.280019:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.280026:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09be0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3364 expref: 23 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.280040:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09be0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3364 expref: 23 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.280049:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:1.0:1762167005.280071:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451756800:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 179us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.280079:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451756672:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 150us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.280086:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16541 00000100:00100000:3.0:1762167005.280095:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16542 00000100:00100000:0.0:1762167005.281576:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.281625:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451757056 00000100:00100000:2.0:1762167005.281631:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451757056 00000100:00100000:2.0:1762167005.281674:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7288 00000100:00100000:2.0:1762167005.281683:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451757056:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167005.281909:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451757056:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 227us (336us total) trans 8589952723 rc 0/0 00000100:00100000:2.0:1762167005.281917:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7288 00000100:00100000:0.0:1762167005.290973:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.291039:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451757184 00000100:00100000:3.0:1762167005.291048:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451757184 00000100:00100000:3.0:1762167005.291092:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19634 00000100:00100000:3.0:1762167005.291099:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56191:x1847765451757184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.291119:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.291139:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09be7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3372 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.291202:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bee lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291215:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291225:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291240:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09bf5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291247:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291253:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291381:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09bfc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291390:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09bfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291411:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09bfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167005.291442:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000004:00200000:3.0:1762167005.291446:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167005.291462:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09bfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291473:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09bfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291481:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291487:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bee lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291496:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291501:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.291504:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291509:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291517:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167005.291520:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.291523:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291526:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09bee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291534:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291538:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09bf5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291541:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291544:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.291545:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291548:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291553:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23100) 00010000:00010000:3.0:1762167005.291556:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.291559:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09bf5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291563:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09bf5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.291597:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09be7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3372 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.291610:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09bfc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3372 expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.291616:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.291619:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167005.291621:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000100:00100000:3.0:1762167005.291682:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56191:x1847765451757184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 584us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.291689:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19634 00000100:00100000:0.0:1762167005.293169:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.293225:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451757312 00000100:00100000:2.0:1762167005.293233:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451757312 00000100:00100000:2.0:1762167005.293290:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 632 00000100:00100000:2.0:1762167005.293301:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2360:x1847765451757312:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.293315:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.293335:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09bfc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3372 expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.293351:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167005.293355:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.293416:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2360:x1847765451757312:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.293424:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 632 00000100:00100000:0.0:1762167005.293602:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.293686:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451757568 00000100:00100000:3.0:1762167005.293697:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451757568 00000100:00100000:3.0:1762167005.293743:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19635 00000100:00100000:3.0:1762167005.293750:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56191:x1847765451757568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.293795:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.293813:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c03 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3379 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.293936:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.293953:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb335d expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.293961:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.294002:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb335d expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.294017:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb335d expref: 906 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:3.0:1762167005.294033:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454403584:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.294120:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.295273:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454403584:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.295300:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167005.295322:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.295381:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451757696 00000100:00100000:2.0:1762167005.295389:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451757696 00010000:00010000:2.0:1762167005.295427:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb335d expref: 907 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.295463:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7379 00000100:00100000:2.0:1762167005.295474:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:2361:x1847765451757696:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.295487:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.295492:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb335d expref: 907 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.295504:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb335d expref: 907 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.295521:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d09bd2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb335d expref: 907 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.295538:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167005.295543:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.295550:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.295557:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.295580:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.295600:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.295610:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167005.295628:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000100:00100000:2.0:1762167005.295628:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2361:x1847765451757696:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.295639:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7379 00010000:00010000:3.0:1762167005.295847:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c03 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3379 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.295867:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3379 expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.295875:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.295878:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167005.295881:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167005.295924:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56191:x1847765451757568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2173us (2323us total) trans 8589952724 rc 0/0 00000100:00100000:3.0:1762167005.295931:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19635 00000100:00100000:0.0:1762167005.297199:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.297245:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451757824 00000100:00100000:3.0:1762167005.297253:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451757824 00000100:00100000:3.0:1762167005.297297:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19636 00000100:00100000:3.0:1762167005.297306:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56191:x1847765451757824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.297322:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.297337:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09c18 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3380 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.297429:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.297441:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3379 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.297446:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.297467:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3379 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.297476:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3379 expref: 907 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:3.0:1762167005.297486:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454403712:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.297536:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.298635:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454403712:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.298667:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167005.298883:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.298921:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451757952 00000100:00100000:2.0:1762167005.298933:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451757952 00010000:00010000:2.0:1762167005.298961:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3379 expref: 908 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.298991:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7380 00000100:00100000:2.0:1762167005.299000:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2361:x1847765451757952:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.299012:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.299018:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3379 expref: 908 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.299030:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3379 expref: 908 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.299052:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09c0a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3379 expref: 908 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.299067:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167005.299071:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.299078:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.299085:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.299109:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.299130:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.299140:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167005.299152:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:2361:x1847765451757952:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 153us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.299160:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7380 00000004:00200000:3.0:1762167005.299178:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000004:00200000:3.0:1762167005.299183:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167005.299202:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.299239:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09c18 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3380 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.299254:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3380 expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.299262:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.299265:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167005.299267:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:3.0:1762167005.299303:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56191:x1847765451757824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1999us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.299310:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19636 00000100:00100000:0.0:1762167005.300583:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.300624:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451758208 00000100:00100000:2.0:1762167005.300629:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451758208 00000100:00100000:2.0:1762167005.300659:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7289 00000100:00100000:2.0:1762167005.300664:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56191:x1847765451758208:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167005.300849:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56191:x1847765451758208:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 184us (270us total) trans 8589952725 rc 0/0 00000100:00100000:2.0:1762167005.300854:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7289 00000100:00100000:1.0:1762167005.301947:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.302007:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451758464 00000100:00100000:3.0:1762167005.302011:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451758464 00000100:00100000:3.0:1762167005.302040:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19637 00000100:00100000:3.0:1762167005.302046:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56191:x1847765451758464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.302058:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.302060:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1762167005.302077:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09b85 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3348 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.302087:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.302090:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.302097:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09c26 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3387 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.302149:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09c2d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.302157:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09c2d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.302162:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09c2d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167005.302170:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00010000:00010000:3.0:1762167005.302231:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09c26 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3387 expref: 909 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.302243:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09c2d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3387 expref: 908 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.302248:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.302250:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167005.302251:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167005.302282:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56191:x1847765451758464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 236us (342us total) trans 8589952726 rc 0/0 00000100:00100000:3.0:1762167005.302286:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19637 00000100:00100000:0.0:1762167005.303470:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.303537:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.303576:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451758592 00000100:00100000:3.0:1762167005.303584:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451758592 00000100:00100000:1.0:1762167005.303616:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451758720 00000100:00100000:1.0:1762167005.303622:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451758720 00000100:00100000:3.0:1762167005.303634:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16543 00000100:00100000:3.0:1762167005.303645:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451758592:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167005.303671:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16544 00010000:00010000:3.0:1762167005.303678:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.303687:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451758720:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167005.303701:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09be0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3364 expref: 23 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.303710:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.303713:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.303715:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.303717:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.303739:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09aac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3310 expref: 22 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.303753:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09bd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb336b expref: 22 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.303759:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.303790:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.303793:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.303799:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09be0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3364 expref: 23 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.303821:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09be0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3364 expref: 23 pid: 12400 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.303835:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb336b expref: 22 pid: 6532 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167005.303838:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454403840:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.303853:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09bd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb336b expref: 22 pid: 6532 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167005.303866:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242523100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454403968:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.303917:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00010000:00010000:2.0:1762167005.303925:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09aac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3310 expref: 22 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.303933:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09aac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3310 expref: 22 pid: 6535 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167005.303940:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454404096:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.303959:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.305267:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12400:1847765454403840:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.305282:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242523100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454403968:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.305294:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454404096:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.305313:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.305379:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.305381:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.305422:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.305444:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.305445:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451758848 00000100:00100000:2.0:1762167005.305452:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451758848 00000100:00100000:3.0:1762167005.305461:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451758976 00000100:00100000:3.0:1762167005.305467:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451758976 00010000:00010000:2.0:1762167005.305479:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09be0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3364 expref: 24 pid: 12400 timeout: 726 lvb_type: 1 00010000:00010000:3.0:1762167005.305489:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09aac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3310 expref: 23 pid: 6535 timeout: 726 lvb_type: 1 00000100:00100000:1.0:1762167005.305499:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451759104 00000100:00100000:1.0:1762167005.305504:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451759104 00000100:00100000:2.0:1762167005.305520:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7381 00010000:00010000:1.0:1762167005.305526:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09bd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb336b expref: 24 pid: 6532 timeout: 726 lvb_type: 1 00000100:00100000:3.0:1762167005.305532:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7382 00000100:00100000:2.0:1762167005.305535:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451758848:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762167005.305547:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451758976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.305554:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.305559:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762167005.305570:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7383 00010000:00010000:3.0:1762167005.305581:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09aac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3310 expref: 24 pid: 6535 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.305581:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09be0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3364 expref: 24 pid: 12400 timeout: 726 lvb_type: 1 00000100:00100000:1.0:1762167005.305582:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451759104:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.305597:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.305612:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09aac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3310 expref: 24 pid: 6535 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.305614:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09be0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3364 expref: 24 pid: 12400 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.305639:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09bd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb336b expref: 24 pid: 6532 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.305651:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d09be0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3364 expref: 24 pid: 12400 timeout: 726 lvb_type: 1 00010000:00010000:3.0:1762167005.305652:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09aac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3310 expref: 24 pid: 6535 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.305654:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb336b expref: 24 pid: 6532 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.305685:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.305687:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.305690:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.305690:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09bd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x819:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb336b expref: 23 pid: 6532 timeout: 726 lvb_type: 1 00010000:00010000:3.0:1762167005.305691:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.305698:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.305699:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.305720:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.305727:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.305731:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.305752:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167005.305758:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.305786:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.305802:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451759104:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 221us (354us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167005.305804:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.305810:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451758976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 264us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.305818:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451758848:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 286us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.305825:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7383 00000100:00100000:3.0:1762167005.305836:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7382 00000100:00100000:2.0:1762167005.305843:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7381 00010000:00010000:0.0:1762167005.305844:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.305855:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.305862:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.305867:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.305872:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.305873:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.305888:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.305889:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.305914:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.305920:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.305924:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09c42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.305951:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.305960:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.305967:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.305970:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.305983:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.305994:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.306001:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d09c3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.306003:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451758720:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2321us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.306019:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16544 00000100:00100000:2.0:1762167005.306048:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451758592:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2405us (2587us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.306056:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16543 00000100:00100000:0.0:1762167005.307201:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.307237:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451759360 00000100:00100000:3.0:1762167005.307244:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451759360 00000100:00100000:3.0:1762167005.307285:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19638 00000100:00100000:3.0:1762167005.307293:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56191:x1847765451759360:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167005.307329:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762167005.307344:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3380 expref: 908 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.307360:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09b54 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb333a expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.307373:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.307377:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.307417:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.307429:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.307437:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000040:00080000:3.0:1762167005.307888:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5349, 88 off431080 00000004:00080000:3.0:1762167005.307898:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626100134552ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.307973:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5357, 88 off432200 00000004:00080000:3.0:1762167005.307981:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626100218408ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.308013:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5358, 88 off432288 00000004:00080000:3.0:1762167005.308018:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626100255060ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.308051:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5350, 88 off431168 00000004:00080000:3.0:1762167005.308056:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626100293540ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.308086:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5359, 88 off432376 00000004:00080000:3.0:1762167005.308091:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626100327973ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.308113:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5351, 88 off431256 00000004:00080000:3.0:1762167005.308116:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626100353410ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.308146:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5352, 88 off431344 00000004:00080000:3.0:1762167005.308149:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626100386110ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.308160:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5360, 88 off432464 00000004:00080000:3.0:1762167005.308162:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626100399647ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.308175:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5361, 88 off432552 00000004:00080000:3.0:1762167005.308177:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626100414481ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.308185:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5353, 88 off431432 00000004:00080000:3.0:1762167005.308188:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626100425393ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.308202:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5362, 88 off432640 00000004:00080000:3.0:1762167005.308206:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626100442747ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.308221:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5354, 88 off431520 00000004:00080000:3.0:1762167005.308226:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626100463161ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.308249:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5363, 88 off432728 00000004:00080000:3.0:1762167005.308253:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626100490427ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.308278:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5355, 88 off431608 00000004:00080000:3.0:1762167005.308282:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626100519383ns, next at 626774750597ns, rc = 0 00000001:00080000:1.0:1762167005.318895:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952720 is committed 00000004:00010000:3.0:1762167005.318900:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e6587e89 reply state 00000000328cd685 transno 8589952727 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167005.318914:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000020:00080000:1.0:1762167005.318919:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969178 batchid updated 00000001:00080000:1.0:1762167005.318947:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952725 is committed 00000020:00080000:0.0:1762167005.318962:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969178 00000001:00080000:1.0:1762167005.318967:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952727 is committed 00000004:00080000:1.0:1762167005.318973:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3464 committed 00000004:00080000:1.0:1762167005.318987:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3477 committed 00000004:00080000:1.0:1762167005.318998:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3463 committed 00000004:00080000:1.0:1762167005.319001:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3476 committed 00000004:00080000:1.0:1762167005.319003:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3462 committed 00000004:00080000:1.0:1762167005.319007:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3475 committed 00000004:00080000:1.0:1762167005.319010:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3474 committed 00000004:00080000:1.0:1762167005.319014:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3461 committed 00010000:00080000:3.0:1762167005.319017:0:32138:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000004:00080000:1.0:1762167005.319018:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3460 committed 00000004:00080000:1.0:1762167005.319024:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3473 committed 00000004:00080000:1.0:1762167005.319028:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3459 committed 00000004:00080000:1.0:1762167005.319033:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3472 committed 00000004:00080000:1.0:1762167005.319039:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3471 committed 00000100:00100000:3.0:1762167005.319040:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56191:x1847765451759360:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 11741us (11833us total) trans 8589952727 rc 0/0 00000004:00080000:1.0:1762167005.319046:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3458 committed 00000100:00100000:3.0:1762167005.319053:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19638 00000020:00080000:1.0:1762167005.319085:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee242a72a80 refcount 2 committed 0 result 0 batchid 4294969179 00000020:00080000:1.0:1762167005.319095:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f670b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3482d7000 00000020:00080000:1.0:1762167005.319099:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f670d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee3479d76c0 00000020:00080000:1.0:1762167005.319102:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f670100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee346a0fc00 00000020:00080000:1.0:1762167005.319105:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].47 00000100:00100000:1.0:1762167005.319161:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454404480:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167005.319200:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00000020:00080000:0.0:1762167005.319203:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969178 cancel update log [0x200000bd0:0x1:0x0].46: rc = 0 00010000:00010000:3.0:1762167005.319215:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167005.319216:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1762167005.319219:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969179 committed batchid 4294969178 00000100:00100000:2.0:1762167005.319222:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454404352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.319258:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454404992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.319270:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167005.319281:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.319286:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.319290:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167005.319299:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167005.319301:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167005.319302:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454404864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.319329:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1762167005.319331:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.319336:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762167005.319339:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454404608:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167005.319343:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167005.319345:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167005.319354:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c49 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167005.319379:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.319381:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000020:00080000:0.0:1762167005.319389:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969178 00000100:00100000:2.0:1762167005.319391:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454404224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.319439:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.319449:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762167005.319460:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454405120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.319474:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454404736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.319493:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.319494:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454404480 00000100:00100000:3.0:1762167005.319502:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454404480 00000100:00100000:2.0:1762167005.319514:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.319517:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454405504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.319544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.319546:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454404352 00000100:00100000:3.0:1762167005.319551:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454404352 00000100:00100000:2.0:1762167005.319552:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454405376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.319560:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762167005.319560:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454404992 00000100:00100000:0.0:1762167005.319566:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454404992 00000100:00100000:1.0:1762167005.319568:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454405632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.319577:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454404864 00000100:00100000:3.0:1762167005.319582:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454404864 00000100:00100000:2.0:1762167005.319591:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.319593:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454404608 00000100:00100000:0.0:1762167005.319596:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454404608 00000100:00100000:1.0:1762167005.319621:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.319622:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454404224 00000100:00100000:0.0:1762167005.319622:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454405120 00000100:00100000:2.0:1762167005.319623:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454405888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.319626:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454405120 00000100:00100000:3.0:1762167005.319629:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454404224 00000100:00100000:0.0:1762167005.319648:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454404736 00000100:00100000:0.0:1762167005.319651:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454404736 00000100:00100000:3.0:1762167005.319658:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454405504 00000100:00100000:2.0:1762167005.319662:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.319665:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454405504 00000100:00100000:0.0:1762167005.319667:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454405376 00000100:00100000:0.0:1762167005.319671:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454405376 00000100:00100000:2.0:1762167005.319687:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1762167005.319691:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454405632 00000100:00100000:0.0:1762167005.319694:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454405888 00000100:00100000:3.0:1762167005.319697:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454405632 00000100:00100000:2.0:1762167005.319698:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454405248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.319700:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454405888 00000100:00100000:3.0:1762167005.319733:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16545 00000100:00100000:2.0:1762167005.319734:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.319743:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16546 00000100:00100000:3.0:1762167005.319748:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454404480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.319753:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454405760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.319759:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454404352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.319808:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.319845:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454405248 00000100:00100000:2.0:1762167005.319849:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454405248 00000100:00100000:2.0:1762167005.319870:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454405760 00000100:00100000:2.0:1762167005.319872:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454405760 00000100:00100000:2.0:1762167005.319888:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16547 00000100:00100000:2.0:1762167005.319896:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454404992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167005.320000:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.320004:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320007:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320010:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320013:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167005.320046:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.320051:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167005.320054:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167005.320057:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167004 -> 1762167004 00002000:00010000:3.0:1762167005.320060:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167005.320065:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454404352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 311us (794us total) trans 21474843177 rc 0/0 00000100:00100000:2.0:1762167005.320074:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454404992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (779us total) trans 21474843178 rc 0/0 00000100:00100000:0.0:1762167005.320076:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16546 00000100:00100000:2.0:1762167005.320087:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16547 00000004:00080000:1.0:1762167005.320096:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242523100/2, rc 0, transno 21474843177 00000100:00100000:0.0:1762167005.320102:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16548 00000100:00100000:1.0:1762167005.320107:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454404352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.320110:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454404480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 365us (893us total) trans 21474843179 rc 0/0 00000100:00100000:2.0:1762167005.320115:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16549 00000100:00100000:0.0:1762167005.320116:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454404864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.320126:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16545 00000100:00100000:2.0:1762167005.320131:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454404608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167005.320249:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.320253:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320255:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167005.320257:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320260:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:0.0:1762167005.320309:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454404864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (967us total) trans 21474843180 rc 0/0 00000100:00100000:2.0:1762167005.320315:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454404608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (934us total) trans 21474843181 rc 0/0 00000100:00100000:0.0:1762167005.320323:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16548 00000004:00080000:1.0:1762167005.320329:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242520700/2, rc 0, transno 21474843180 00000100:00100000:2.0:1762167005.320330:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16549 00000100:00100000:1.0:1762167005.320339:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454404864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.320340:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16550 00000100:00100000:0.0:1762167005.320350:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16551 00000100:00100000:3.0:1762167005.320354:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454405120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.320361:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16552 00000100:00100000:0.0:1762167005.320366:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454404224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.320375:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454404736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167005.320492:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.320495:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167005.320497:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762167005.320499:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167005.320500:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.320512:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 154021 -> 154021 00002000:00010000:0.0:1762167005.320515:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320518:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320520:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320522:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 161 -> 161 00000100:00100000:3.0:1762167005.320529:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454405120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (1036us total) trans 17179875649 rc 0/0 00000100:00100000:3.0:1762167005.320535:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16550 00002000:00010000:2.0:1762167005.320536:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.320541:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.320545:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:2.0:1762167005.320547:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000100:00100000:3.0:1762167005.320549:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16553 00002000:00010000:2.0:1762167005.320554:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.320560:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454405504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.320560:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454404224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (1121us total) trans 21474843182 rc 0/0 00000100:00100000:0.0:1762167005.320571:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16551 00000100:00100000:0.0:1762167005.320591:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16554 00000004:00080000:1.0:1762167005.320597:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242521880/2, rc 0, transno 21474843182 00000100:00100000:2.0:1762167005.320601:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454404736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (1086us total) trans 21474843183 rc 0/0 00000100:00100000:0.0:1762167005.320601:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454405376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.320606:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454404224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.320618:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16552 00000004:00080000:1.0:1762167005.320626:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242521500/2, rc 0, transno 21474843183 00000100:00100000:1.0:1762167005.320632:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454404736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.320642:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16555 00000100:00100000:2.0:1762167005.320651:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454405632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167005.320681:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.320685:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.320688:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167005.320690:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.320693:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.320728:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454405504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (1184us total) trans 17179875650 rc 0/0 00000100:00100000:3.0:1762167005.320735:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16553 00000100:00100000:0.0:1762167005.320753:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454405376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (1161us total) trans 17179875651 rc 0/0 00000100:00100000:3.0:1762167005.320758:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16556 00000004:00080000:1.0:1762167005.320792:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccd180/2, rc 0, transno 17179875651 00000100:00100000:0.0:1762167005.320793:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16554 00000100:00100000:3.0:1762167005.320794:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454405888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.320802:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454405376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.320822:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16557 00002000:00010000:2.0:1762167005.320828:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 92016 -> 92016 00002000:00010000:2.0:1762167005.320832:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.320836:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00000100:00100000:0.0:1762167005.320836:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454405248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167005.320840:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.320845:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:2.0:1762167005.320872:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454405632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (1252us total) trans 17179875652 rc 0/0 00000100:00100000:2.0:1762167005.320879:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16555 00000100:00100000:2.0:1762167005.320899:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16558 00000100:00100000:2.0:1762167005.320909:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454405760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.320927:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454405888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (1265us total) trans 17179875653 rc 0/0 00000100:00100000:3.0:1762167005.320935:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16556 00000004:00080000:1.0:1762167005.320955:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345730700/2, rc 0, transno 17179875653 00000100:00100000:1.0:1762167005.320962:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454405888:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167005.320975:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.320980:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320983:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320985:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.320988:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167005.321029:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454405248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 197us (1297us total) trans 17179875654 rc 0/0 00000100:00100000:0.0:1762167005.321035:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16557 00000004:00080000:1.0:1762167005.321046:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcce680/2, rc 0, transno 17179875654 00000100:00100000:1.0:1762167005.321053:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454405248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.321066:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454405760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (1256us total) trans 17179875655 rc 0/0 00000004:00080000:1.0:1762167005.321069:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345732300/2, rc 0, transno 17179875655 00000100:00100000:1.0:1762167005.321077:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454405760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.321078:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16558 00000100:00100000:0.0:1762167005.321124:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000004:00080000:2.0:1762167005.321131:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccf100/2, rc 0, transno 17179875652 00000100:00100000:2.0:1762167005.321136:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454405632:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167005.321148:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccd500/2, rc 0, transno 17179875650 00000100:00100000:2.0:1762167005.321151:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454405504:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167005.321164:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccdc00/2, rc 0, transno 17179875649 00000100:00100000:3.0:1762167005.321166:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451759488 00000100:00100000:2.0:1762167005.321169:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454405120:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167005.321181:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242521f80/2, rc 0, transno 21474843181 00000100:00100000:2.0:1762167005.321184:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454404608:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.321191:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242520e00/2, rc 0, transno 21474843178 00000100:00100000:2.0:1762167005.321194:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454404992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.321203:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242522680/2, rc 0, transno 21474843179 00000100:00100000:3.0:1762167005.321207:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451759488 00000100:00100000:2.0:1762167005.321207:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454404480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.321242:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19639 00000100:00100000:3.0:1762167005.321247:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56191:x1847765451759488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.321257:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.321269:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c50 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb338e expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.321302:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c50 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb338e expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.321311:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c50 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb338e expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.321327:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.321330:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167005.321332:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:3.0:1762167005.321367:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56191:x1847765451759488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 119us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.321374:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19639 00000100:00100000:1.0:1762167005.322831:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.322868:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451759616 00000100:00100000:3.0:1762167005.322879:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451759616 00000100:00100000:3.0:1762167005.322917:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19640 00000100:00100000:3.0:1762167005.322925:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56191:x1847765451759616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.322936:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.322946:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c57 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3395 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.322995:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09c5e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.323006:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09c5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.323012:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09c5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167005.323029:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000004:00200000:3.0:1762167005.323031:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167005.323043:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09c5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.323065:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c57 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3395 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.323082:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09c5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3395 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.323090:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.323093:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167005.323096:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922200, rc 0) 00000100:00100000:3.0:1762167005.323132:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56191:x1847765451759616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 209us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.323136:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19640 00000100:00100000:1.0:1762167005.347380:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.347449:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451759744 00000100:00100000:2.0:1762167005.347458:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451759744 00000100:00100000:1.0:1762167005.347485:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.347531:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451759872 00000100:00100000:2.0:1762167005.347535:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451759872 00000100:00100000:2.0:1762167005.347570:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16559 00000100:00100000:2.0:1762167005.347583:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451759744:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:0.0:1762167005.347583:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16560 00000100:00100000:0.0:1762167005.347602:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451759872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.347610:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.347614:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.347638:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09c6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33a3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.347639:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09c65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb339c expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.347674:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 154021, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888dd, blocks: 0x203 00002000:00010000:0.0:1762167005.347675:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x819:0x0] initial LVB size: 0, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888dd, blocks: 0x1 00010000:00010000:0.0:1762167005.347697:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.347698:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.347700:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.347702:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.347711:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb339c expref: 23 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.347712:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33a3 expref: 21 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.347737:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb339c expref: 23 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.347748:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00010000:00010000:0.0:1762167005.347750:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33a3 expref: 21 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.347793:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9400, rc 0) 00000100:00100000:2.0:1762167005.347834:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451759744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 250us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.347834:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451759872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 233us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.347848:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16560 00000100:00100000:2.0:1762167005.347856:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16559 00000100:00100000:0.0:1762167005.349132:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.349179:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451760000 00000100:00100000:2.0:1762167005.349184:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451760000 00000100:00100000:2.0:1762167005.349229:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2762 00000100:00100000:2.0:1762167005.349238:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451760000:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167005.349263:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c73 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.349271:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.349272:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.349275:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.349282:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.350742:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.350756:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.350787:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.350795:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.350799:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.350809:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.350823:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.350830:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.350884:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451760000:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1646us (1752us total) trans 0 rc 154021/154021 00000100:00100000:2.0:1762167005.350892:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2762 00000100:00100000:1.0:1762167005.352744:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.352809:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451760128 00000100:00100000:2.0:1762167005.352818:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451760128 00000100:00100000:2.0:1762167005.352870:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2763 00000100:00100000:2.0:1762167005.352877:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765451760128:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167005.352921:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 92016, mtime: 0x690888dc, atime: 0x690888d5, ctime: 0x690888dc, blocks: 0x203 00010000:00010000:2.0:1762167005.352927:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.352939:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.352941:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.352945:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.352964:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167005.367246:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875654 is committed 00000001:00080000:0.0:1762167005.367266:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875647 is committed 00000001:00080000:0.0:1762167005.367274:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875656 is committed 00000001:00080000:0.0:1762167005.367282:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875655 is committed 00002000:00010000:2.0:1762167005.367422:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 92016 -> 155648 00002000:00010000:2.0:1762167005.367432:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167004 -> 1762167005 00002000:00010000:2.0:1762167005.367435:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167004 -> 1762167005 00010000:00010000:2.0:1762167005.367453:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.367465:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.367474:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.367482:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.367489:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.367498:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.367520:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.367528:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.367661:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451760128:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14777us (14918us total) trans 17179875656 rc 0/0 00000100:00100000:2.0:1762167005.367678:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2763 00000100:00100000:1.0:1762167005.369742:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.369847:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451760256 00000100:00100000:2.0:1762167005.369859:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451760256 00000100:00100000:2.0:1762167005.369940:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2764 00000100:00100000:2.0:1762167005.369950:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451760256:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167005.370003:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 92016, mtime: 0x690888dd, atime: 0x690888db, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:2.0:1762167005.370012:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.370026:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.370028:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.370033:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.370046:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762167005.382263:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843182 is committed 00000001:00080000:2.0:1762167005.382295:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843175 is committed 00000001:00080000:2.0:1762167005.382305:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843184 is committed 00000001:00080000:2.0:1762167005.382315:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843183 is committed 00002000:00010000:3.0:1762167005.382381:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 92016 -> 155648 00010000:00010000:3.0:1762167005.382405:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.382414:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.382424:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.382429:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167005.382432:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.382439:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.382457:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.382464:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09c81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.382560:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451760256:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 12607us (12822us total) trans 21474843184 rc 0/0 00000100:00100000:3.0:1762167005.382571:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2764 00000100:00100000:0.0:1762167005.384519:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.384560:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451760384 00000100:00100000:3.0:1762167005.384568:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451760384 00000100:00100000:3.0:1762167005.384629:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2765 00000100:00100000:3.0:1762167005.384639:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451760384:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762167005.384681:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.384693:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0989f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb324c expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.384699:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.384701:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.384703:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.384727:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0989f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb324c expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.384737:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0989f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb324c expref: 21 pid: 7858 timeout: 726 lvb_type: 1 00000100:00100000:3.0:1762167005.384747:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454406016:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.384818:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242943240 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.385670:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454406016:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.385689:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.385835:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.385902:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451760512 00000100:00100000:2.0:1762167005.385909:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451760512 00010000:00010000:2.0:1762167005.385934:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0989f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb324c expref: 22 pid: 7858 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167005.385978:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7384 00000100:00100000:2.0:1762167005.385988:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451760512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.385999:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.386024:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0989f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb324c expref: 22 pid: 7858 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.386036:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0989f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb324c expref: 22 pid: 7858 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.386057:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0989f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb324c expref: 22 pid: 7858 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.386071:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.386073:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.386077:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.386086:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.386112:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.386146:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.386154:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451760512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (316us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167005.386160:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.386168:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7384 00000001:00080000:0.0:1762167005.396283:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875657 is committed 00002000:00010000:3.0:1762167005.396308:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 92016 -> 155648 00002000:00010000:3.0:1762167005.396313:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 259 -> 515 00010000:00010000:3.0:1762167005.396324:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.396333:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.396339:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.396343:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167005.396346:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.396351:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.396362:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.396367:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d09c88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.396471:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451760384:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 11829us (11952us total) trans 17179875657 rc 0/0 00000100:00100000:3.0:1762167005.396482:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2765 00000100:00100000:1.0:1762167005.398384:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.398436:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451760640 00000100:00100000:3.0:1762167005.398445:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451760640 00000100:00100000:3.0:1762167005.398499:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2766 00000100:00100000:3.0:1762167005.398506:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451760640:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167005.398542:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 92016, mtime: 0x690888dd, atime: 0x690888db, ctime: 0x690888dd, blocks: 0x103 00010000:00010000:3.0:1762167005.398551:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.398564:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.398566:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.398577:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.398590:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167005.409321:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875658 is committed 00002000:00010000:3.0:1762167005.409347:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 92016 -> 155648 00002000:00010000:3.0:1762167005.409353:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 259 -> 515 00010000:00010000:3.0:1762167005.409366:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.409377:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.409386:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.409404:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167005.409409:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.409418:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.409437:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.409445:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.409535:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451760640:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 11025us (11155us total) trans 17179875658 rc 0/0 00000100:00100000:3.0:1762167005.409544:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2766 00000100:00100000:1.0:1762167005.416874:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.416929:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451760896 00000100:00100000:3.0:1762167005.416940:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451760896 00000100:00100000:3.0:1762167005.417002:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19641 00000100:00100000:3.0:1762167005.417012:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56191:x1847765451760896:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167005.417065:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.417099:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09c5e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3395 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.417119:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.417123:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.417380:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.417408:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.417419:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:3.0:1762167005.417478:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952728 00000004:00010000:3.0:1762167005.417505:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ea163a55 reply state 0000000083a652c7 transno 8589952729 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167005.417520:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167005.417604:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56191:x1847765451760896:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 593us (739us total) trans 8589952729 rc 0/0 00000100:00100000:3.0:1762167005.417612:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19641 00000020:00080000:3.0:1762167005.417616:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167005.418289:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.418304:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.418310:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.418317:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167005.418321:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.418328:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.418336:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167005.418339:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167005.418341:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.418345:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09c96 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167005.418615:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.418652:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451761024 00000100:00100000:2.0:1762167005.418657:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451761024 00000100:00100000:2.0:1762167005.418700:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16561 00000100:00100000:2.0:1762167005.418709:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56191:x1847765451761024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.418720:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.418735:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33aa expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.418753:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 155648, mtime: 0x690888dd, atime: 0x690888d5, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:2.0:1762167005.418789:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.418792:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.418799:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33aa expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.418821:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33aa expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.418829:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:2.0:1762167005.418862:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56191:x1847765451761024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.418868:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16561 00000100:00100000:0.0:1762167005.419695:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.419744:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451761152 00000100:00100000:3.0:1762167005.419749:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451761152 00002000:00010000:3.0:1762167005.419802:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (154021->18446744073709551615) 00002000:00100000:3.0:1762167005.419807:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee345733800 with x1847765451761152 ext(154021->18446744073709551615) 00002000:00010000:3.0:1762167005.419816:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee345733800. 00000100:00100000:1.0:1762167005.419830:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.419838:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2767 00000100:00100000:3.0:1762167005.419848:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451761152:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167005.419856:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451761280 00000100:00100000:0.0:1762167005.419872:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451761280 00002000:00010000:0.0:1762167005.419895:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:0.0:1762167005.419899:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e445880 with x1847765451761280 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.419907:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e445880. 00000100:00100000:0.0:1762167005.419932:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2768 00000100:00100000:0.0:1762167005.419940:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451761280:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167005.420195:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 155648 -> 154021 00002000:00010000:3.0:1762167005.420198:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.420200:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167005.420202:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.420204:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167005.420218:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.420221:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167004 -> 1762167005 00002000:00010000:0.0:1762167005.420223:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167005.420225:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167004 -> 1762167005 00002000:00010000:0.0:1762167005.420227:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.420245:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451761152:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 398us (551us total) trans 17179875659 rc 0/0 00000100:00100000:0.0:1762167005.420251:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451761280:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 310us (422us total) trans 21474843185 rc 0/0 00000100:00100000:3.0:1762167005.420260:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2767 00002000:00010000:3.0:1762167005.420265:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (154021->18446744073709551615) 00002000:00100000:3.0:1762167005.420268:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee345733800 with x1847765451761152 ext(154021->18446744073709551615) 00000100:00100000:0.0:1762167005.420269:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2768 00002000:00010000:0.0:1762167005.420275:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00010000:3.0:1762167005.420276:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee345733800. 00002000:00100000:0.0:1762167005.420278:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e445880 with x1847765451761280 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.420284:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e445880. 00000100:00100000:0.0:1762167005.421369:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.421447:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451761408 00000100:00100000:3.0:1762167005.421451:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451761408 00000100:00100000:3.0:1762167005.421491:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19642 00000100:00100000:3.0:1762167005.421501:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56191:x1847765451761408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.421519:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.421532:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09ca4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33b1 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.421585:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09cab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.421595:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09cab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.421602:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09cab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167005.421620:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000004:00200000:3.0:1762167005.421623:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167005.421633:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09cab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.421649:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09ca4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b1 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.421662:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09cab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b1 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.421667:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.421670:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167005.421672:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167005.421704:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56191:x1847765451761408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 206us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.421715:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19642 00000100:00100000:1.0:1762167005.423017:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.423104:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451761664 00000100:00100000:3.0:1762167005.423109:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451761664 00000100:00100000:3.0:1762167005.423155:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19643 00000100:00100000:3.0:1762167005.423165:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56191:x1847765451761664:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167005.423200:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.423218:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09cab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b1 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.423229:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.423231:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.423430:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.423442:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.423449:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:3.0:1762167005.423500:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952730 00000004:00010000:3.0:1762167005.423522:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000edb92222 reply state 000000006d2da68b transno 8589952731 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167005.423528:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167005.423599:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56191:x1847765451761664:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 435us (586us total) trans 8589952731 rc 0/0 00000100:00100000:3.0:1762167005.423607:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19643 00000020:00080000:3.0:1762167005.423612:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167005.424329:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.424339:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.424345:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.424350:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.424355:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.424362:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.424374:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.424378:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.424383:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.424389:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cb2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167005.424462:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.424512:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451761792 00000100:00100000:2.0:1762167005.424518:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451761792 00000100:00100000:2.0:1762167005.424556:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16562 00000100:00100000:2.0:1762167005.424565:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56191:x1847765451761792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.424578:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.424595:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09cb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33b8 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.424618:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 155648, mtime: 0x690888dd, atime: 0x690888db, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:2.0:1762167005.424636:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.424638:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.424645:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09cb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b8 expref: 18 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.424661:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09cb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b8 expref: 18 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.424669:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167005.424716:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56191:x1847765451761792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 152us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.424723:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16562 00000100:00100000:1.0:1762167005.425720:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.425744:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.425794:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451761920 00000100:00100000:0.0:1762167005.425800:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451761920 00000100:00100000:3.0:1762167005.425808:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451762048 00000100:00100000:3.0:1762167005.425813:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451762048 00002000:00010000:0.0:1762167005.425828:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (154021->18446744073709551615) 00002000:00010000:3.0:1762167005.425829:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167005.425834:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e445f80 with x1847765451761920 ext(154021->18446744073709551615) 00002000:00100000:3.0:1762167005.425836:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e444700 with x1847765451762048 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.425845:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e445f80. 00002000:00010000:3.0:1762167005.425847:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e444700. 00000100:00100000:0.0:1762167005.425880:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2769 00000100:00100000:0.0:1762167005.425890:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451761920:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167005.425898:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2770 00000100:00100000:3.0:1762167005.425912:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451762048:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167005.426141:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.426145:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.426148:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167005.426151:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.426153:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.426177:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 155648 -> 154021 00002000:00010000:0.0:1762167005.426181:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.426184:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167005.426185:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.426187:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167005.426199:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765451762048:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 287us (452us total) trans 17179875660 rc 0/0 00000100:00100000:0.0:1762167005.426210:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451761920:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 321us (490us total) trans 21474843186 rc 0/0 00000100:00100000:3.0:1762167005.426212:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2770 00002000:00010000:3.0:1762167005.426219:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00000100:00100000:0.0:1762167005.426222:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2769 00002000:00100000:3.0:1762167005.426226:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e444700 with x1847765451762048 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.426227:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (154021->18446744073709551615) 00002000:00100000:0.0:1762167005.426232:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e445f80 with x1847765451761920 ext(154021->18446744073709551615) 00002000:00010000:3.0:1762167005.426235:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e444700. 00002000:00010000:0.0:1762167005.426237:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e445f80. 00000100:00100000:0.0:1762167005.427183:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.427223:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451762176 00000100:00100000:3.0:1762167005.427227:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451762176 00000100:00100000:3.0:1762167005.427263:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19644 00000100:00100000:3.0:1762167005.427271:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56191:x1847765451762176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.427287:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.427301:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09cc0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33bf expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.427362:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09cc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.427372:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.427388:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167005.427424:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000004:00200000:3.0:1762167005.427428:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167005.427443:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.427466:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09cc0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33bf expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.427479:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33bf expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.427486:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.427489:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167005.427492:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922a00, rc 0) 00000100:00100000:3.0:1762167005.427528:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56191:x1847765451762176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 257us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.427534:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19644 00000100:00100000:1.0:1762167005.428599:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.428687:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451762432 00000100:00100000:3.0:1762167005.428693:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451762432 00000100:00100000:3.0:1762167005.428727:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19645 00000100:00100000:3.0:1762167005.428736:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56191:x1847765451762432:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167005.428787:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.428807:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09cc7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33bf expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.428822:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.428826:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.429003:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.429014:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.429021:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:3.0:1762167005.429061:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952732 00000004:00010000:3.0:1762167005.429077:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005e0598c7 reply state 000000005678a8e3 transno 8589952733 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167005.429083:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167005.429139:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56191:x1847765451762432:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 401us (542us total) trans 8589952733 rc 0/0 00000100:00100000:3.0:1762167005.429145:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19645 00000020:00080000:3.0:1762167005.429150:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167005.429908:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.429920:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.429927:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.429934:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.429938:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.429959:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.429974:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.429978:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.429982:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.429993:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09cce lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167005.430194:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.430243:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451762560 00000100:00100000:2.0:1762167005.430249:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451762560 00000100:00100000:2.0:1762167005.430291:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16563 00000100:00100000:2.0:1762167005.430299:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56191:x1847765451762560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.430318:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.430337:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09cd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33c6 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.430358:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 155648, mtime: 0x690888dd, atime: 0x690888da, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:2.0:1762167005.430373:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.430376:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.430382:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33c6 expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.430409:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33c6 expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.430417:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167005.430447:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56191:x1847765451762560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 151us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.430452:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16563 00000100:00100000:1.0:1762167005.431322:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.431350:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.431370:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451762688 00000100:00100000:0.0:1762167005.431375:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451762688 00000100:00100000:3.0:1762167005.431382:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451762816 00000100:00100000:3.0:1762167005.431387:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451762816 00002000:00010000:0.0:1762167005.431409:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2072 (154021->18446744073709551615) 00002000:00100000:0.0:1762167005.431414:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e445c00 with x1847765451762688 ext(154021->18446744073709551615) 00002000:00010000:3.0:1762167005.431419:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2069 (0->18446744073709551615) 00002000:00010000:0.0:1762167005.431420:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e445c00. 00002000:00100000:3.0:1762167005.431426:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e446a00 with x1847765451762816 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167005.431433:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e446a00. 00000100:00100000:0.0:1762167005.431447:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2771 00000100:00100000:0.0:1762167005.431459:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451762688:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167005.431464:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2772 00000100:00100000:3.0:1762167005.431476:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451762816:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167005.431709:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.431713:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.431717:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167005.431720:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.431722:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.431725:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 155648 -> 154021 00002000:00010000:0.0:1762167005.431730:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.431733:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167005.431735:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.431738:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167005.431777:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451762816:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 287us (409us total) trans 21474843187 rc 0/0 00000100:00100000:3.0:1762167005.431787:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2772 00002000:00010000:3.0:1762167005.431791:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2069 (0->18446744073709551615) 00002000:00100000:3.0:1762167005.431794:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e446a00 with x1847765451762816 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167005.431800:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451762688:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 343us (476us total) trans 17179875661 rc 0/0 00000100:00100000:0.0:1762167005.431810:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2771 00002000:00010000:3.0:1762167005.431813:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e446a00. 00002000:00010000:0.0:1762167005.431814:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2072 (154021->18446744073709551615) 00002000:00100000:0.0:1762167005.431821:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e445c00 with x1847765451762688 ext(154021->18446744073709551615) 00002000:00010000:0.0:1762167005.431828:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e445c00. 00000100:00100000:0.0:1762167005.432946:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.432993:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451762944 00000100:00100000:3.0:1762167005.433000:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451762944 00000100:00100000:3.0:1762167005.433033:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19646 00000100:00100000:3.0:1762167005.433039:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56191:x1847765451762944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.433052:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.433063:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09cdc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33cd expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.433127:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09ce3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.433141:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.433151:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167005.433173:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000004:00200000:3.0:1762167005.433176:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167005.433187:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.433206:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09cdc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33cd expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.433217:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33cd expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.433222:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.433224:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167005.433226:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:3.0:1762167005.433264:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56191:x1847765451762944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 225us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.433271:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19646 00000100:00100000:1.0:1762167005.434565:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.434632:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451763200 00000100:00100000:3.0:1762167005.434638:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451763200 00000100:00100000:3.0:1762167005.434672:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19647 00000100:00100000:3.0:1762167005.434679:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56191:x1847765451763200:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167005.434714:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.434729:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09ce3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33cd expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.434742:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.434746:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.434924:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.434933:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.434939:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:3.0:1762167005.434980:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952734 00000004:00010000:3.0:1762167005.435003:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000adc94bc0 reply state 00000000243c1db1 transno 8589952735 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167005.435011:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167005.435062:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56191:x1847765451763200:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 383us (501us total) trans 8589952735 rc 0/0 00000100:00100000:3.0:1762167005.435067:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19647 00000020:00080000:3.0:1762167005.435070:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167005.435603:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.435611:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.435618:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.435623:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.435627:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.435634:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.435643:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.435646:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.435649:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.435654:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09cea lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167005.435885:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.435924:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451763328 00000100:00100000:2.0:1762167005.435931:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451763328 00000100:00100000:2.0:1762167005.435976:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16564 00000100:00100000:2.0:1762167005.435986:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56191:x1847765451763328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.435996:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.436008:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09cf1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33d4 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.436021:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 155648, mtime: 0x690888dd, atime: 0x690888db, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:2.0:1762167005.436032:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.436033:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.436038:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33d4 expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.436047:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33d4 expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.436054:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00000100:00100000:2.0:1762167005.436080:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56191:x1847765451763328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 98us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.436084:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16564 00000100:00100000:1.0:1762167005.436875:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.436902:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.436924:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451763456 00000100:00100000:0.0:1762167005.436931:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451763456 00000100:00100000:3.0:1762167005.436942:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451763584 00000100:00100000:3.0:1762167005.436953:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451763584 00002000:00010000:0.0:1762167005.436955:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (154021->18446744073709551615) 00002000:00100000:0.0:1762167005.436961:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab2300 with x1847765451763456 ext(154021->18446744073709551615) 00002000:00010000:0.0:1762167005.436969:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374ab2300. 00002000:00010000:3.0:1762167005.436972:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:3.0:1762167005.436977:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab3b80 with x1847765451763584 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167005.436984:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee374ab3b80. 00000100:00100000:0.0:1762167005.436999:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2773 00000100:00100000:0.0:1762167005.437006:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451763456:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167005.437017:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2774 00000100:00100000:3.0:1762167005.437027:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451763584:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167005.437274:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.437277:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.437279:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167005.437281:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.437281:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 155648 -> 154021 00002000:00010000:3.0:1762167005.437287:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.437287:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.437294:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167005.437298:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.437300:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167005.437332:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451763584:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 308us (430us total) trans 21474843188 rc 0/0 00000100:00100000:3.0:1762167005.437338:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2774 00002000:00010000:3.0:1762167005.437340:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:3.0:1762167005.437344:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab3b80 with x1847765451763584 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167005.437346:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451763456:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 336us (468us total) trans 17179875662 rc 0/0 00002000:00010000:3.0:1762167005.437348:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee374ab3b80. 00000100:00100000:0.0:1762167005.437359:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2773 00002000:00010000:0.0:1762167005.437364:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (154021->18446744073709551615) 00002000:00100000:0.0:1762167005.437367:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab2300 with x1847765451763456 ext(154021->18446744073709551615) 00002000:00010000:0.0:1762167005.437373:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374ab2300. 00000100:00100000:0.0:1762167005.438330:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.438373:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451763840 00000100:00100000:3.0:1762167005.438378:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451763840 00000100:00100000:3.0:1762167005.438423:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19648 00000100:00100000:3.0:1762167005.438432:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56191:x1847765451763840:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167005.438498:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.438513:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.438523:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:3.0:1762167005.438610:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000076865bc2 reply state 000000009684c18e transno 8589952736 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167005.438619:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167005.438686:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56191:x1847765451763840:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 254us (358us total) trans 8589952736 rc 0/0 00000100:00100000:3.0:1762167005.438693:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19648 00010000:00010000:3.0:1762167005.439499:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.439513:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.439519:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.439525:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.439528:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.439535:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.439547:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167005.439549:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.439551:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.439555:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09cf8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167005.439863:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.439893:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.439926:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451764096 00000100:00100000:2.0:1762167005.439934:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451764096 00000100:00100000:2.0:1762167005.439982:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451763968 00000100:00100000:2.0:1762167005.439987:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451763968 00000100:00100000:1.0:1762167005.440015:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16565 00000100:00100000:0.0:1762167005.440032:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16566 00000100:00100000:1.0:1762167005.440041:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451764096:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:0.0:1762167005.440053:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451763968:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762167005.440225:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 154021 -> 154021 00002000:00010000:0.0:1762167005.440228:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.440230:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.440232:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.440233:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167005.440274:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451763968:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 232us (381us total) trans 17179875663 rc 0/0 00000100:00100000:0.0:1762167005.440280:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16566 00002000:00010000:1.0:1762167005.440286:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.440292:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.440295:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.440298:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.440301:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167005.440352:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451764096:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 322us (489us total) trans 21474843189 rc 0/0 00000100:00100000:1.0:1762167005.440358:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16565 00000100:00100000:1.0:1762167005.441163:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.441218:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451764352 00000100:00100000:2.0:1762167005.441224:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451764352 00000100:00100000:2.0:1762167005.441266:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7290 00000100:00100000:2.0:1762167005.441275:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358652050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56191:x1847765451764352:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167005.441319:0:33886:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09c2d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3387 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.441352:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.441364:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c50 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb338e expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.441372:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.441413:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c50 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb338e expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.441426:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c50 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb338e expref: 900 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.441441:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454406144:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.441498:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.442214:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454406144:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.442230:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167005.442461:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.442532:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451764480 00000100:00100000:2.0:1762167005.442537:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451764480 00010000:00010000:2.0:1762167005.442558:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c50 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb338e expref: 901 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.442593:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7385 00000100:00100000:2.0:1762167005.442603:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:2361:x1847765451764480:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.442614:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.442621:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c50 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb338e expref: 901 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.442630:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c50 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb338e expref: 901 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.442645:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d09c50 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb338e expref: 901 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.442659:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167005.442663:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.442670:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.442677:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167005.442703:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167005.442722:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.442731:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167005.442749:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2361:x1847765451764480:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 147us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.442758:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7385 00000040:00080000:3.0:1762167005.443258:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5356, 88 off431696 00000004:00080000:3.0:1762167005.443265:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626235502013ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.443309:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5364, 88 off432816 00000004:00080000:3.0:1762167005.443315:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626235551839ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.443351:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5365, 88 off432904 00000004:00080000:3.0:1762167005.443358:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626235594718ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.443379:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5357, 88 off431784 00000004:00080000:3.0:1762167005.443384:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626235621717ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.443434:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5366, 88 off432992 00000004:00080000:3.0:1762167005.443438:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626235675759ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.443466:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5358, 88 off431872 00000004:00080000:3.0:1762167005.443470:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626235707596ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.443502:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5359, 88 off431960 00000004:00080000:3.0:1762167005.443507:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626235743869ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.443524:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5367, 88 off433080 00000004:00080000:3.0:1762167005.443528:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626235765111ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.443555:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5368, 88 off433168 00000004:00080000:3.0:1762167005.443559:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626235796537ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.443587:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5360, 88 off432048 00000004:00080000:3.0:1762167005.443592:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626235829229ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.443616:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5369, 88 off433256 00000004:00080000:3.0:1762167005.443621:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626235857764ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.443649:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5361, 88 off432136 00000004:00080000:3.0:1762167005.443654:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626235890904ns, next at 626774750597ns, rc = 0 00000040:00080000:3.0:1762167005.443682:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5370, 88 off433344 00000004:00080000:3.0:1762167005.443690:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626235927579ns, next at 626774785189ns, rc = 0 00000040:00080000:3.0:1762167005.443718:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5362, 88 off432224 00000004:00080000:3.0:1762167005.443723:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626235960167ns, next at 626774750597ns, rc = 0 00000020:00080000:1.0:1762167005.453320:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969179 batchid updated 00000004:00010000:3.0:1762167005.453333:0:33886:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dc696fde reply state 00000000e080fc58 transno 8589952737 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167005.453349:0:33886:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000020:00080000:0.0:1762167005.453353:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969179 00000001:00080000:1.0:1762167005.453359:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952737 is committed 00010000:00010000:3.0:1762167005.453361:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00000004:00080000:1.0:1762167005.453368:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3471 committed 00010000:00010000:3.0:1762167005.453372:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1762167005.453383:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3484 committed 00010000:00010000:3.0:1762167005.453384:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09c2d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3387 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167005.453409:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3470 committed 00000004:00080000:1.0:1762167005.453415:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3483 committed 00000004:00080000:1.0:1762167005.453417:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3469 committed 00000004:00080000:1.0:1762167005.453419:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3482 committed 00000004:00080000:1.0:1762167005.453422:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3481 committed 00000004:00080000:1.0:1762167005.453423:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3468 committed 00000004:00080000:1.0:1762167005.453425:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3467 committed 00000004:00080000:1.0:1762167005.453426:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3480 committed 00000004:00080000:1.0:1762167005.453427:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3466 committed 00000004:00080000:1.0:1762167005.453429:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3479 committed 00000004:00080000:1.0:1762167005.453431:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3478 committed 00000004:00080000:1.0:1762167005.453434:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3465 committed 00010000:00080000:3.0:1762167005.453528:0:33886:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1762167005.453546:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358652050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56191:x1847765451764352:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 12271us (12384us total) trans 8589952737 rc 0/0 00000100:00100000:3.0:1762167005.453559:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7290 00000020:00080000:0.0:1762167005.453607:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969179 cancel update log [0x200000bd0:0x1:0x0].47: rc = 0 00000100:00100000:2.0:1762167005.453609:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454406272:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1762167005.453620:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969179 00010000:00010000:3.0:1762167005.453627:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.453637:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167005.453642:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454406656:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167005.453644:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.453650:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.453653:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.453658:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.453672:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00000100:00100000:2.0:1762167005.453677:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167005.453678:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167005.453684:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167005.453690:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09cff lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167005.453712:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454406272 00000100:00100000:1.0:1762167005.453718:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454406272 00000100:00100000:2.0:1762167005.453728:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454406784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.453728:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.453758:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454406656 00000100:00100000:2.0:1762167005.453791:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.453792:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454407168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.453793:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454406656 00000100:00100000:2.0:1762167005.453819:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454407424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.453829:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454406784 00000100:00100000:1.0:1762167005.453834:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454406784 00000100:00100000:0.0:1762167005.453834:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.453858:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.453864:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454407680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.453875:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454407168 00000100:00100000:1.0:1762167005.453880:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454407168 00000100:00100000:2.0:1762167005.453895:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454407808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.453895:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.453909:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454407424 00000100:00100000:1.0:1762167005.453913:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454407424 00000100:00100000:0.0:1762167005.453919:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1762167005.453928:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454406528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.453930:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454407680 00000100:00100000:1.0:1762167005.453934:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454407680 00000100:00100000:2.0:1762167005.453935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.453952:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454407808 00000100:00100000:1.0:1762167005.453956:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454407808 00000100:00100000:2.0:1762167005.453963:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1762167005.453969:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.453974:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16567 00000100:00100000:2.0:1762167005.453975:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454406400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.453987:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454407040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.453990:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454406528 00000100:00100000:3.0:1762167005.453991:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454406272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.453997:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454406528 00000100:00100000:2.0:1762167005.454010:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.454018:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454406400 00000100:00100000:1.0:1762167005.454022:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454406400 00000100:00100000:0.0:1762167005.454027:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.454031:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454406912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.454043:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454407040 00000100:00100000:0.0:1762167005.454047:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454407552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.454048:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454407040 00000100:00100000:2.0:1762167005.454057:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.454071:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454406912 00000100:00100000:2.0:1762167005.454074:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454407296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.454077:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454406912 00000100:00100000:0.0:1762167005.454085:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.454102:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454407552 00000100:00100000:1.0:1762167005.454106:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454407552 00000100:00100000:2.0:1762167005.454112:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.454118:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454407296 00000100:00100000:0.0:1762167005.454123:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454407296 00000100:00100000:1.0:1762167005.454132:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16568 00000100:00100000:2.0:1762167005.454133:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454407936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.454146:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454406656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.454153:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16569 00000100:00100000:0.0:1762167005.454163:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454406784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.454166:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.454206:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454407936 00002000:00010000:3.0:1762167005.454209:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 154021 -> 154021 00000100:00100000:2.0:1762167005.454211:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454407936 00002000:00010000:3.0:1762167005.454214:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.454219:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.454222:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.454224:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 161 -> 211 00000100:00100000:2.0:1762167005.454241:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16570 00000100:00100000:2.0:1762167005.454250:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454407168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167005.454315:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.454320:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.454323:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.454326:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.454327:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.454332:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.454333:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.454339:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167005.454341:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.454344:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.454374:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454406272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 387us (697us total) trans 21474843190 rc 0/0 00002000:00010000:2.0:1762167005.454377:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.454383:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.454386:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:3.0:1762167005.454391:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16567 00000100:00100000:0.0:1762167005.454391:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454406784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (625us total) trans 21474843192 rc 0/0 00002000:00010000:2.0:1762167005.454404:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.454410:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167005.454411:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454406656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 252us (668us total) trans 21474843191 rc 0/0 00000100:00100000:0.0:1762167005.454419:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16569 00000100:00100000:3.0:1762167005.454426:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16571 00000100:00100000:1.0:1762167005.454435:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16568 00000100:00100000:3.0:1762167005.454437:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454407424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.454444:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16572 00000100:00100000:2.0:1762167005.454446:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454407168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (613us total) trans 21474843193 rc 0/0 00000100:00100000:0.0:1762167005.454456:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454407680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.454457:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16570 00000100:00100000:1.0:1762167005.454469:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16573 00000100:00100000:2.0:1762167005.454483:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16574 00000100:00100000:1.0:1762167005.454484:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454407808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.454495:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454406528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167005.454600:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 154021 -> 154021 00002000:00010000:0.0:1762167005.454604:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.454606:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167005.454609:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.454611:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:3.0:1762167005.454638:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.454643:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.454648:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000100:00100000:0.0:1762167005.454649:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454407680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (752us total) trans 17179875664 rc 0/0 00002000:00010000:3.0:1762167005.454653:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.454658:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167005.454659:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16572 00002000:00010000:1.0:1762167005.454661:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 154021 -> 154021 00002000:00010000:1.0:1762167005.454666:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.454669:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167005.454671:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.454673:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167005.454683:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16575 00002000:00010000:2.0:1762167005.454692:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167005.454694:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454406400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167005.454697:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:3.0:1762167005.454702:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454407424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 266us (843us total) trans 21474843194 rc 0/0 00002000:00010000:2.0:1762167005.454703:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.454710:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000100:00100000:1.0:1762167005.454711:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454407808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 233us (779us total) trans 17179875665 rc 0/0 00002000:00010000:2.0:1762167005.454714:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.454716:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16571 00000100:00100000:1.0:1762167005.454726:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16573 00000100:00100000:3.0:1762167005.454743:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16576 00000100:00100000:1.0:1762167005.454750:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16577 00000100:00100000:3.0:1762167005.454755:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454407040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.454783:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454406912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.454785:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454406528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 268us (793us total) trans 17179875666 rc 0/0 00000100:00100000:2.0:1762167005.454795:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16574 00000100:00100000:2.0:1762167005.454816:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16578 00000100:00100000:2.0:1762167005.454826:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454407552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167005.454847:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.454852:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167005.454854:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762167005.454856:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167005.454859:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167005.454891:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454406400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 199us (880us total) trans 17179875667 rc 0/0 00000100:00100000:0.0:1762167005.454898:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16575 00000100:00100000:0.0:1762167005.454918:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16579 00002000:00010000:1.0:1762167005.454921:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 154021 -> 154021 00002000:00010000:1.0:1762167005.454926:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:0.0:1762167005.454930:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454407296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167005.454931:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167005.454938:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.454939:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.454944:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.454945:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167005.454948:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167005.454951:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.454953:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167005.454994:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167005.454996:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454406912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 237us (937us total) trans 21474843195 rc 0/0 00002000:00010000:3.0:1762167005.455001:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167005.455001:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454407552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (914us total) trans 17179875668 rc 0/0 00002000:00010000:3.0:1762167005.455009:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00000100:00100000:1.0:1762167005.455013:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16577 00002000:00010000:3.0:1762167005.455015:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.455020:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167005.455024:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16578 00000100:00100000:1.0:1762167005.455040:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16580 00002000:00010000:0.0:1762167005.455046:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 154021 -> 154021 00002000:00010000:0.0:1762167005.455051:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:1.0:1762167005.455055:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454407936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167005.455056:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00000100:00100000:3.0:1762167005.455058:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454407040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 306us (1030us total) trans 21474843196 rc 0/0 00002000:00010000:0.0:1762167005.455064:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.455070:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167005.455075:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16576 00000100:00100000:2.0:1762167005.455098:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875655 gen 2 00000004:00080000:2.0:1762167005.455105:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24785ad80, transno 17179875645 00000100:00100000:0.0:1762167005.455106:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454407296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (995us total) trans 17179875669 rc 0/0 00000100:00100000:0.0:1762167005.455115:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16579 00000004:00080000:2.0:1762167005.455126:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875648 committed transno 17179875655 00000004:00080000:2.0:1762167005.455148:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccdc00, transno 17179875649 00000004:00080000:2.0:1762167005.455154:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccd500, transno 17179875650 00000004:00080000:2.0:1762167005.455157:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccd180, transno 17179875651 00000004:00080000:2.0:1762167005.455160:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccf100, transno 17179875652 00000004:00080000:2.0:1762167005.455162:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345730700, transno 17179875653 00000004:00080000:2.0:1762167005.455165:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcce680, transno 17179875654 00000004:00080000:2.0:1762167005.455170:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345732300, transno 17179875655 00000100:00100000:2.0:1762167005.455179:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee374ab1180 x1847765454406400/t17179875667(17179875667) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167021 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762167005.455190:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab1180/2, rc 0, transno 17179875667 00002000:00010000:1.0:1762167005.455190:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 154021 -> 154021 00002000:00010000:1.0:1762167005.455196:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167005.455197:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454406400:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167005.455201:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.455205:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.455208:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167005.455218:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843183 gen 2 00000004:00080000:2.0:1762167005.455222:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce7100, transno 21474843172 00000004:00080000:2.0:1762167005.455234:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843176 committed transno 21474843183 00000100:00100000:1.0:1762167005.455250:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454407936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 200us (1084us total) trans 17179875670 rc 0/0 00000004:00080000:2.0:1762167005.455252:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242523100, transno 21474843177 00000004:00080000:2.0:1762167005.455260:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242520e00, transno 21474843178 00000100:00100000:1.0:1762167005.455262:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16580 00000004:00080000:2.0:1762167005.455267:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242522680, transno 21474843179 00000004:00080000:2.0:1762167005.455272:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242520700, transno 21474843180 00000004:00080000:2.0:1762167005.455277:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242521f80, transno 21474843181 00000004:00080000:2.0:1762167005.455282:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242521880, transno 21474843182 00000004:00080000:2.0:1762167005.455286:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242521500, transno 21474843183 00000100:00100000:2.0:1762167005.455293:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37fcb4700 x1847765454406912/t21474843195(21474843195) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167021 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762167005.455301:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb4700/2, rc 0, transno 21474843195 00000100:00100000:2.0:1762167005.455307:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454406912:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167005.455322:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab3480/2, rc 0, transno 17179875666 00000004:00080000:2.0:1762167005.455326:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab1500/2, rc 0, transno 17179875669 00000100:00100000:1.0:1762167005.455330:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454406528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.455332:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454407296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167005.455353:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb6680/2, rc 0, transno 21474843196 00000004:00080000:2.0:1762167005.455356:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab1f80/2, rc 0, transno 17179875670 00000100:00100000:1.0:1762167005.455362:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454407040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.455364:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454407936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167005.455385:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab3100/2, rc 0, transno 17179875668 00000004:00080000:2.0:1762167005.455389:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab3800/2, rc 0, transno 17179875665 00000100:00100000:1.0:1762167005.455402:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454407552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.455408:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454407808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167005.455421:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb6d80/2, rc 0, transno 21474843191 00000100:00100000:1.0:1762167005.455426:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454406656:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.455432:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb7b80/2, rc 0, transno 21474843190 00000100:00100000:2.0:1762167005.455441:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454406272:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167005.455445:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb5880/2, rc 0, transno 21474843193 00000004:00080000:3.0:1762167005.455449:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 7 in progress, 1 in flight, 7 done 00000100:00100000:1.0:1762167005.455452:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454407168:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.455458:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb6300/2, rc 0, transno 21474843192 00000100:00100000:2.0:1762167005.455464:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454406784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167005.455474:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab0e00/2, rc 0, transno 17179875664 00000004:00080000:2.0:1762167005.455481:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb5180/2, rc 0, transno 21474843194 00000100:00100000:1.0:1762167005.455482:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454407680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.455491:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454407424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167005.455580:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 7 in progress, 0 in flight, 6 done 00000100:00100000:1.0:1762167005.455601:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.455641:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451764608 00000100:00100000:3.0:1762167005.455646:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451764608 00000100:00100000:0.0:1762167005.455693:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19649 00000100:00100000:0.0:1762167005.455701:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56191:x1847765451764608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.455715:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.455732:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09d06 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33db expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.455806:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09d06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33db expref: 890 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.455819:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09d06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33db expref: 890 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.455834:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167005.455837:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167005.455839:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8a00, rc 0) 00000100:00100000:0.0:1762167005.455874:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56191:x1847765451764608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.455881:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19649 00000100:00100000:3.0:1762167005.457346:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.457413:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451764864 00000100:00100000:2.0:1762167005.457418:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451764864 00000100:00100000:2.0:1762167005.457450:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7291 00000100:00100000:2.0:1762167005.457456:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56191:x1847765451764864:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167005.457610:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56191:x1847765451764864:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 152us (264us total) trans 8589952738 rc 0/0 00000100:00100000:2.0:1762167005.457617:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7291 00000100:00100000:2.0:1762167005.466625:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.466736:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451764992 00000100:00100000:0.0:1762167005.466746:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451764992 00000100:00100000:0.0:1762167005.466835:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19650 00000100:00100000:0.0:1762167005.466848:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56192:x1847765451764992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.466872:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.466892:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d0d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33e2 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.466976:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09d14 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.466991:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09d14 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467002:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09d14 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467017:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d1b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467023:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467030:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467133:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467141:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467148:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167005.467179:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000004:00200000:0.0:1762167005.467183:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167005.467200:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467211:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467219:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09d14 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467226:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09d14 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467233:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09d14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467246:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167005.467253:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09d14 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467260:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09d14 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467270:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167005.467273:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167005.467278:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09d14 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467284:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09d14 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467296:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467301:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d1b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467307:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d1b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467313:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167005.467316:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d1b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467322:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d1b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467328:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.467330:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167005.467333:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d1b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467338:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d1b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.467363:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d0d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e2 expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.467378:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e2 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.467385:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167005.467386:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167005.467388:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9a00, rc 0) 00000100:00100000:0.0:1762167005.467445:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56192:x1847765451764992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 601us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.467450:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19650 00000100:00100000:1.0:1762167005.468906:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.468943:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451765248 00000100:00100000:0.0:1762167005.468950:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451765248 00000100:00100000:0.0:1762167005.468990:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19651 00000100:00100000:0.0:1762167005.468998:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56192:x1847765451765248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.469012:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.469022:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d29 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33e9 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.469080:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09d30 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.469088:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09d30 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.469094:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09d30 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167005.469101:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00010000:00010000:0.0:1762167005.469209:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d29 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e9 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.469225:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09d30 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e9 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.469233:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167005.469236:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762167005.469239:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8600, rc 0) 00000100:00100000:0.0:1762167005.469283:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56192:x1847765451765248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 285us (380us total) trans 8589952739 rc 0/0 00000100:00100000:0.0:1762167005.469289:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19651 00000100:00100000:3.0:1762167005.470272:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.470308:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451765504 00000100:00100000:0.0:1762167005.470314:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451765504 00000100:00100000:0.0:1762167005.470348:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19652 00000100:00100000:0.0:1762167005.470355:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56192:x1847765451765504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.470367:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.470376:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d3e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33f0 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.470438:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09d45 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.470448:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09d45 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.470462:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09d45 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167005.470471:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00010000:00010000:0.0:1762167005.470531:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f0 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.470542:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09d45 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f0 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.470547:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167005.470549:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167005.470550:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9800, rc 0) 00000100:00100000:0.0:1762167005.470581:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56192:x1847765451765504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 227us (310us total) trans 8589952740 rc 0/0 00000100:00100000:0.0:1762167005.470584:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19652 00000100:00100000:2.0:1762167005.495501:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.495606:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451765632 00000100:00100000:0.0:1762167005.495618:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451765632 00000100:00100000:0.0:1762167005.495698:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2775 00000100:00100000:0.0:1762167005.495711:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451765632:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167005.495759:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d53 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.495806:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.495808:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.495814:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.495828:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.497501:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.497512:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.497518:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.497523:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.497526:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.497534:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.497550:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.497563:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.497622:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451765632:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1913us (2132us total) trans 0 rc 154021/154021 00000100:00100000:0.0:1762167005.497629:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2775 00000100:00100000:3.0:1762167005.499490:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.499542:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451765760 00000100:00100000:0.0:1762167005.499551:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451765760 00000100:00100000:0.0:1762167005.499612:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2776 00000100:00100000:0.0:1762167005.499622:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451765760:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167005.499650:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.499667:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33aa expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.499674:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.499677:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.499680:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.499712:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33aa expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.499726:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33aa expref: 28 pid: 12402 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167005.499746:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454408064:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.499839:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.500735:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454408064:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.500754:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.500856:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.500909:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451765888 00000100:00100000:2.0:1762167005.500914:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451765888 00010000:00010000:2.0:1762167005.500948:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33aa expref: 29 pid: 12402 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.500983:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7386 00000100:00100000:2.0:1762167005.500992:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451765888:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.501005:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.501026:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33aa expref: 29 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.501040:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33aa expref: 29 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.501060:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d09c9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33aa expref: 29 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.501074:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.501076:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.501080:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.501089:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.501111:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.501133:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.501143:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.501145:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451765888:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 153us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.501160:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7386 00010000:00010000:0.0:1762167005.502245:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.502253:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.502258:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.502262:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.502264:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.502270:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.502280:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.502285:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.502329:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451765760:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2709us (2846us total) trans 0 rc 154021/154021 00000100:00100000:0.0:1762167005.502335:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2776 00000100:00100000:2.0:1762167005.504164:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.504213:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451766016 00000100:00100000:0.0:1762167005.504222:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451766016 00000100:00100000:0.0:1762167005.504283:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2777 00000100:00100000:0.0:1762167005.504291:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451766016:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167005.504317:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.504331:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09cb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b8 expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.504337:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.504339:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.504341:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.504364:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09cb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b8 expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.504376:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b8 expref: 22 pid: 12402 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167005.504386:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:14122:1847765454408192:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.504466:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.505253:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:14122:1847765454408192:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.505274:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.505437:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.505484:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451766144 00000100:00100000:1.0:1762167005.505488:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451766144 00010000:00010000:1.0:1762167005.505510:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b8 expref: 23 pid: 12402 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167005.505538:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7387 00000100:00100000:1.0:1762167005.505543:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451766144:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.505553:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.505574:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09cb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b8 expref: 23 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.505593:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09cb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b8 expref: 23 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.505614:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09cb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33b8 expref: 23 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.505628:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.505631:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.505634:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.505645:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.505673:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.505701:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.505712:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.505720:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451766144:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 174us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.505730:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7387 00010000:00010000:0.0:1762167005.506837:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.506850:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.506857:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.506863:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.506867:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.506877:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.506891:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.506899:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.506961:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451766016:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2669us (2802us total) trans 0 rc 154021/154021 00000100:00100000:0.0:1762167005.506971:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2777 00000100:00100000:1.0:1762167005.508875:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.508940:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451766272 00000100:00100000:0.0:1762167005.508953:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451766272 00000100:00100000:0.0:1762167005.509014:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2778 00000100:00100000:0.0:1762167005.509023:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451766272:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167005.509054:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.509072:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33c6 expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.509080:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.509082:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.509085:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.509122:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33c6 expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.509135:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09cd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33c6 expref: 27 pid: 12402 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167005.509149:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454408320:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.509216:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.510126:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454408320:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.510147:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.510261:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.510311:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451766400 00000100:00100000:2.0:1762167005.510317:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451766400 00010000:00010000:2.0:1762167005.510344:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09cd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33c6 expref: 28 pid: 12402 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.510377:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7388 00000100:00100000:2.0:1762167005.510387:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451766400:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.510412:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.510433:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09cd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33c6 expref: 28 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.510446:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33c6 expref: 28 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.510468:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09cd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33c6 expref: 28 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.510482:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.510484:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.510488:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.510498:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.510525:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.510551:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.510562:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.510571:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451766400:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 184us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.510581:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7388 00010000:00010000:0.0:1762167005.511751:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.511797:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.511806:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.511818:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.511823:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.511831:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.511845:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.511852:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.511907:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451766272:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2883us (3034us total) trans 0 rc 154021/154021 00000100:00100000:0.0:1762167005.511916:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2778 00000100:00100000:1.0:1762167005.513697:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.513779:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451766528 00000100:00100000:0.0:1762167005.513787:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451766528 00000100:00100000:0.0:1762167005.513843:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2779 00000100:00100000:0.0:1762167005.513852:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451766528:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167005.513879:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.513896:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09cf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33d4 expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.513908:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.513910:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.513913:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.513942:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33d4 expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.513951:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09cf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33d4 expref: 26 pid: 12402 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167005.513962:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454408448:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.514027:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.514871:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454408448:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.514889:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.515056:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.515095:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451766656 00000100:00100000:2.0:1762167005.515101:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451766656 00010000:00010000:2.0:1762167005.515126:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09cf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33d4 expref: 27 pid: 12402 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.515157:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7389 00000100:00100000:2.0:1762167005.515167:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451766656:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.515176:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.515191:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09cf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33d4 expref: 27 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.515200:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33d4 expref: 27 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.515214:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09cf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33d4 expref: 27 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.515223:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.515225:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.515227:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.515233:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.515254:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.515279:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.515289:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.515294:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451766656:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.515309:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7389 00010000:00010000:0.0:1762167005.516296:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.516314:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.516322:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.516328:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.516332:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.516341:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.516358:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.516362:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.516427:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765451766528:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2575us (2733us total) trans 0 rc 154021/154021 00000100:00100000:0.0:1762167005.516437:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2779 00000100:00100000:3.0:1762167005.518151:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.518198:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451766784 00000100:00100000:0.0:1762167005.518204:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451766784 00000100:00100000:0.0:1762167005.518260:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2780 00000100:00100000:0.0:1762167005.518271:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765451766784:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167005.518298:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d76 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.518309:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.518311:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.518315:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.518325:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.519510:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.519522:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.519530:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.519534:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.519538:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.519547:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.519557:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.519563:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.519620:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765451766784:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1351us (1472us total) trans 0 rc 154021/154021 00000100:00100000:0.0:1762167005.519628:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2780 00000100:00100000:1.0:1762167005.526564:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.526631:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451766912 00000100:00100000:2.0:1762167005.526642:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451766912 00000100:00100000:2.0:1762167005.526720:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 633 00000100:00100000:2.0:1762167005.526739:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56192:x1847765451766912:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762167005.526787:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.526813:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09d45 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f0 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.526829:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:2.0:1762167005.526832:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.526883:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56192:x1847765451766912:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 154us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.526892:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 633 00000100:00100000:3.0:1762167005.527703:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.527755:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451767168 00000100:00100000:2.0:1762167005.527780:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451767168 00000100:00100000:2.0:1762167005.527824:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7292 00000100:00100000:2.0:1762167005.527833:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56192:x1847765451767168:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167005.528016:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56192:x1847765451767168:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 184us (314us total) trans 8589952741 rc 0/0 00000100:00100000:2.0:1762167005.528025:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7292 00000100:00100000:1.0:1762167005.529884:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.529934:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451767424 00000100:00100000:0.0:1762167005.529942:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451767424 00000100:00100000:0.0:1762167005.529989:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19653 00000100:00100000:0.0:1762167005.529998:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451767424:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167005.530014:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.530031:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33f7 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.530112:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.530126:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e2 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.530133:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.530164:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e2 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.530177:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e2 expref: 897 pid: 30818 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167005.530189:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454408576:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.530259:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7540 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.531284:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.531297:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454408576:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.531318:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.531337:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451767552 00000100:00100000:2.0:1762167005.531343:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451767552 00010000:00010000:2.0:1762167005.531365:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e2 expref: 898 pid: 30818 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.531408:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7390 00000100:00100000:2.0:1762167005.531414:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765451767552:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.531422:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.531426:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e2 expref: 898 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.531439:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e2 expref: 898 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.531454:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09d22 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e2 expref: 898 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.531466:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:2.0:1762167005.531468:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.531474:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.531478:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.531495:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.531521:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.531522:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451767552:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 109us (242us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167005.531535:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.531537:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7390 00000004:00200000:0.0:1762167005.531549:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00010000:00010000:0.0:1762167005.531648:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09d7d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f7 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.531657:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f7 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.531662:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167005.531664:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167005.531666:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9000, rc 0) 00000100:00100000:0.0:1762167005.531691:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451767424:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1695us (1811us total) trans 8589952742 rc 0/0 00000100:00100000:0.0:1762167005.531698:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19653 00000100:00100000:1.0:1762167005.532883:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.532920:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451767680 00000100:00100000:0.0:1762167005.532927:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451767680 00000100:00100000:0.0:1762167005.532960:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19654 00000100:00100000:0.0:1762167005.532966:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451767680:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167005.532980:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.532992:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d92 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb33fe expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.533057:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.533068:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f7 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.533076:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.533101:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f7 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.533113:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f7 expref: 898 pid: 30818 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167005.533127:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454408704:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.533178:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.534017:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454408704:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.534033:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167005.534814:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.534942:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451767808 00000100:00100000:2.0:1762167005.534948:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451767808 00010000:00010000:2.0:1762167005.534975:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f7 expref: 899 pid: 30818 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.535009:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7391 00000100:00100000:2.0:1762167005.535018:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2361:x1847765451767808:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.535030:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.535037:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f7 expref: 899 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.535047:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f7 expref: 899 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.535065:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09d84 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33f7 expref: 899 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.535080:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:2.0:1762167005.535084:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.535092:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.535099:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.535134:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.535176:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.535177:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451767808:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 157us (362us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167005.535193:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.535194:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7391 00000004:00200000:0.0:1762167005.535248:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154021 00000004:00200000:0.0:1762167005.535253:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167005.535276:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.535305:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09d92 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33fe expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.535320:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33fe expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.535327:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167005.535330:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167005.535333:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:0.0:1762167005.535372:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451767680:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2404us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.535379:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19654 00000100:00100000:1.0:1762167005.536662:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.536714:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451767936 00000100:00100000:3.0:1762167005.536720:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451767936 00000100:00100000:3.0:1762167005.536785:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16581 00000100:00100000:3.0:1762167005.536796:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765451767936:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167005.536812:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.536831:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09da0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3405 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167005.536854:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 154021, mtime: 0x690888dd, atime: 0x690888da, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:3.0:1762167005.536869:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.536870:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.536877:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3405 expref: 26 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.536887:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3405 expref: 26 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.536897:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167005.536931:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451767936:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 140us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.536936:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16581 00000100:00100000:3.0:1762167005.538375:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.538432:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451768064 00000100:00100000:0.0:1762167005.538437:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451768064 00002000:00100000:0.0:1762167005.538469:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x818:0x0] (12288->16383) req@ffff9ee24240b800 x1847765451768064/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167005.538477:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240b800 with x1847765451768064 ext(12288->16383) 00002000:00010000:0.0:1762167005.538480:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240b800 00000100:00100000:0.0:1762167005.538500:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2781 00000100:00100000:0.0:1762167005.538506:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451768064:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167005.538675:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451768064:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 168us (305us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167005.538683:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2781 00002000:00100000:0.0:1762167005.538690:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x818:0x0] (12288->16383) req@ffff9ee24240b800 x1847765451768064/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/4536 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167005.538699:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240b800 with x1847765451768064 ext(12288->16383) 00002000:00010000:0.0:1762167005.538703:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240b800 00000100:00100000:1.0:1762167005.539865:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.539914:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451768192 00000100:00100000:0.0:1762167005.539920:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451768192 00002000:00100000:0.0:1762167005.539948:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x818:0x0] (16384->20479) req@ffff9ee247869500 x1847765451768192/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167005.539958:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247869500 with x1847765451768192 ext(16384->20479) 00002000:00010000:0.0:1762167005.539963:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee247869500 00000100:00100000:0.0:1762167005.539984:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2782 00000100:00100000:0.0:1762167005.539992:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451768192:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167005.540120:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451768192:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 128us (259us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167005.540127:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2782 00002000:00100000:0.0:1762167005.540133:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x818:0x0] (16384->20479) req@ffff9ee247869500 x1847765451768192/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/4536 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167005.540142:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247869500 with x1847765451768192 ext(16384->20479) 00002000:00010000:0.0:1762167005.540145:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee247869500 00000100:00100000:1.0:1762167005.541541:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.541585:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451768320 00000100:00100000:0.0:1762167005.541593:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451768320 00002000:00100000:0.0:1762167005.541624:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x818:0x0] (4096->69631) req@ffff9ee247869180 x1847765451768320/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 504/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167005.541633:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247869180 with x1847765451768320 ext(4096->69631) 00002000:00010000:0.0:1762167005.541638:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee247869180 00000100:00100000:0.0:1762167005.541666:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2783 00000100:00100000:0.0:1762167005.541675:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451768320:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167005.542738:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451768320:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1053us (1191us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1762167005.542752:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2783 00002000:00100000:0.0:1762167005.542760:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x818:0x0] (4096->69631) req@ffff9ee247869180 x1847765451768320/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 504/440 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167005.542790:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247869180 with x1847765451768320 ext(4096->69631) 00002000:00010000:0.0:1762167005.542796:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee247869180 00000100:00100000:1.0:1762167005.544227:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.544264:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451768448 00000100:00100000:0.0:1762167005.544272:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451768448 00002000:00100000:0.0:1762167005.544303:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x818:0x0] (69632->106495) req@ffff9ee24786b480 x1847765451768448/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167005.544310:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24786b480 with x1847765451768448 ext(69632->106495) 00002000:00010000:0.0:1762167005.544314:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24786b480 00000100:00100000:0.0:1762167005.544335:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2784 00000100:00100000:0.0:1762167005.544342:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451768448:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167005.545574:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451768448:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1227us (1346us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1762167005.545581:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2784 00002000:00100000:0.0:1762167005.545588:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x818:0x0] (69632->106495) req@ffff9ee24786b480 x1847765451768448/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/440 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 36864/36864 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167005.545595:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24786b480 with x1847765451768448 ext(69632->106495) 00002000:00010000:0.0:1762167005.545599:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24786b480 00000100:00100000:3.0:1762167005.547176:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.547221:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451768704 00000100:00100000:0.0:1762167005.547230:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451768704 00000100:00100000:0.0:1762167005.547281:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19655 00000100:00100000:0.0:1762167005.547289:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451768704:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167005.547344:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167005.547374:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09d99 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33fe expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.547416:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167005.547422:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.547670:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.547683:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.547699:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167005.547759:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952743 00000004:00010000:0.0:1762167005.547815:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008dc248ea reply state 000000003dc6fe24 transno 8589952744 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167005.547824:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167005.547909:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451768704:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 615us (733us total) trans 8589952744 rc 0/0 00000100:00100000:0.0:1762167005.547916:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19655 00000020:00080000:0.0:1762167005.547922:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167005.548878:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.548891:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.548898:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.548904:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.548908:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.548916:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.549004:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:3.0:1762167005.549008:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.549013:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.549020:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09da7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.549153:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.549191:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451768960 00000100:00100000:3.0:1762167005.549198:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451768960 00000100:00100000:3.0:1762167005.549279:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7293 00000100:00100000:3.0:1762167005.549288:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451768960:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:3.0:1762167005.549502:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451768960:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 215us (350us total) trans 8589952745 rc 0/0 00000100:00100000:3.0:1762167005.549510:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7293 00000100:00100000:1.0:1762167005.550835:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.550867:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451769216 00000100:00100000:0.0:1762167005.550874:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451769216 00000100:00100000:0.0:1762167005.550920:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19656 00000100:00100000:0.0:1762167005.550929:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451769216:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167005.550945:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.550949:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762167005.550971:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09d30 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33e9 expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.550991:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09d06 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33db expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.551001:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167005.551011:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.551026:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09dae lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb340c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.551066:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09db5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.551076:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09db5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.551082:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09db5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000040:00080000:0.0:1762167005.551589:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5363, 88 off432312 00000004:00080000:0.0:1762167005.551598:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626343834419ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.551659:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5371, 88 off433432 00000004:00080000:0.0:1762167005.551665:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626343901876ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.551715:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5372, 88 off433520 00000004:00080000:0.0:1762167005.551721:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626343957926ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.551739:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5364, 88 off432400 00000004:00080000:0.0:1762167005.551742:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626343979914ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.551806:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5373, 88 off433608 00000004:00080000:0.0:1762167005.551812:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626344049034ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.551834:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5365, 88 off432488 00000004:00080000:0.0:1762167005.551838:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626344075269ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.551853:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5366, 88 off432576 00000004:00080000:0.0:1762167005.551857:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626344094562ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.551872:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5374, 88 off433696 00000004:00080000:0.0:1762167005.551876:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626344113230ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.551902:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5375, 88 off433784 00000004:00080000:0.0:1762167005.551906:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626344143252ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.551939:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5367, 88 off432664 00000004:00080000:0.0:1762167005.551943:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626344179910ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.551966:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5376, 88 off433872 00000004:00080000:0.0:1762167005.551971:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626344208019ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.551996:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5368, 88 off432752 00000004:00080000:0.0:1762167005.552001:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626344237964ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.552024:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5377, 88 off433960 00000004:00080000:0.0:1762167005.552027:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626344264524ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.552049:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5369, 88 off432840 00000004:00080000:0.0:1762167005.552053:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626344290212ns, next at 626774750597ns, rc = 0 00000001:00080000:1.0:1762167005.561462:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952746 is committed 00000004:00080000:1.0:1762167005.561474:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3478 committed 00000004:00080000:1.0:1762167005.561488:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3491 committed 00000004:00080000:1.0:1762167005.561500:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3477 committed 00000004:00080000:1.0:1762167005.561504:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3490 committed 00010000:00010000:3.0:1762167005.561508:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09db5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb340c expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167005.561508:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3476 committed 00000004:00080000:1.0:1762167005.561512:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3489 committed 00000004:00080000:1.0:1762167005.561517:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3488 committed 00000004:00080000:1.0:1762167005.561521:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3475 committed 00000004:00080000:1.0:1762167005.561526:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3474 committed 00010000:00010000:3.0:1762167005.561529:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00000004:00080000:1.0:1762167005.561530:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3487 committed 00000004:00080000:1.0:1762167005.561535:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3473 committed 00010000:00010000:3.0:1762167005.561536:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1762167005.561539:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3486 committed 00000004:00080000:1.0:1762167005.561543:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3485 committed 00000004:00080000:1.0:1762167005.561545:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3472 committed 00010000:00010000:3.0:1762167005.561557:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09dae lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb340c expref: 898 pid: 30818 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1762167005.561579:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09db5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb340c expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.561615:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167005.561619:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762167005.561623:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:1.0:1762167005.561625:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454408960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.561693:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454408832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.561695:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.561708:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451769216:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 10778us (10873us total) trans 8589952746 rc 0/0 00000100:00100000:3.0:1762167005.561720:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19656 00000100:00100000:0.0:1762167005.561732:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454409088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.561733:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.561740:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454409472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.561756:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454409344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.561806:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.561825:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454408960 00000100:00100000:1.0:1762167005.561832:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454408960 00000100:00100000:3.0:1762167005.561839:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454409216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.561849:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454409600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.561875:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454408832 00000100:00100000:3.0:1762167005.561876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.561881:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454408832 00000100:00100000:0.0:1762167005.561900:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454409088 00000100:00100000:0.0:1762167005.561905:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454409088 00000100:00100000:1.0:1762167005.561908:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454409216 00000100:00100000:1.0:1762167005.561914:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454409216 00000100:00100000:3.0:1762167005.561920:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454409728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.561946:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16582 00000100:00100000:3.0:1762167005.561953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.561956:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16583 00000100:00100000:0.0:1762167005.561961:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454408960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.561966:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16584 00000100:00100000:1.0:1762167005.561969:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454408832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.561974:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454409088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.562045:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454410240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.562073:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.562104:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454409728 00000100:00100000:3.0:1762167005.562108:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454409728 00000100:00100000:3.0:1762167005.562129:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454410240 00000100:00100000:3.0:1762167005.562132:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454410240 00000100:00100000:3.0:1762167005.562151:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16585 00000100:00100000:3.0:1762167005.562161:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3296:x1847765454409216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167005.562177:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.562177:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 154021 -> 154021 00002000:00010000:0.0:1762167005.562180:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.562182:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.562182:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.562186:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167005.562188:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.562188:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.562193:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167005.562194:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.562195:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.562200:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167005.562201:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167005.562201:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 211 -> 211 00002000:00010000:0.0:1762167005.562206:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167005.562243:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454409088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 268us (437us total) trans 17179875671 rc 0/0 00000100:00100000:1.0:1762167005.562244:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454408832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 279us (512us total) trans 21474843197 rc 0/0 00000100:00100000:1.0:1762167005.562251:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16583 00000100:00100000:0.0:1762167005.562257:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454408960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 299us (560us total) trans 17179875672 rc 0/0 00000100:00100000:2.0:1762167005.562259:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16584 00000100:00100000:0.0:1762167005.562271:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16582 00000100:00100000:1.0:1762167005.562278:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16586 00000100:00100000:2.0:1762167005.562282:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16587 00000100:00100000:1.0:1762167005.562287:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454409728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.562289:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454410240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.562318:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454409216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (440us total) trans 17179875673 rc 0/0 00000100:00100000:3.0:1762167005.562327:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16585 00000004:00080000:3.0:1762167005.562375:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4dc00/2, rc 0, transno 17179875673 00000100:00100000:3.0:1762167005.562381:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454409216:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167005.562410:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 154021 -> 154021 00002000:00010000:1.0:1762167005.562410:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.562415:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.562415:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.562418:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167005.562418:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:2.0:1762167005.562421:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.562421:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.562425:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167005.562425:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167005.562434:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.562466:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454409856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.562468:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454410240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (392us total) trans 17179875674 rc 0/0 00000100:00100000:1.0:1762167005.562468:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454409728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (515us total) trans 21474843198 rc 0/0 00000100:00100000:3.0:1762167005.562471:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454409344 00000100:00100000:3.0:1762167005.562478:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454409344 00000100:00100000:2.0:1762167005.562482:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16587 00000100:00100000:1.0:1762167005.562486:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16586 00000100:00100000:0.0:1762167005.562498:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.562510:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454409856 00000100:00100000:2.0:1762167005.562515:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454409856 00000100:00100000:0.0:1762167005.562528:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454410368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.562538:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16588 00000100:00100000:2.0:1762167005.562546:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454409856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.562553:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167005.562566:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce5180/2, rc 0, transno 21474843198 00000100:00100000:1.0:1762167005.562574:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454409728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167005.562585:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce4380/2, rc 0, transno 21474843197 00000004:00080000:1.0:1762167005.562590:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4df80/2, rc 0, transno 17179875674 00000100:00100000:0.0:1762167005.562592:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454408832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.562599:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454410240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.562602:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454410368 00000100:00100000:3.0:1762167005.562607:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454410368 00000100:00100000:1.0:1762167005.562626:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16589 00000100:00100000:0.0:1762167005.562627:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.562638:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3293:x1847765454409344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.562643:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454409600 00002000:00010000:2.0:1762167005.562646:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167005.562648:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454409600 00002000:00010000:2.0:1762167005.562652:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:0.0:1762167005.562653:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454410112:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167005.562659:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167005.562664:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.562666:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.562681:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16590 00000100:00100000:0.0:1762167005.562688:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.562694:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3293:x1847765454410368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.562715:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3293:x1847765454409856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (218us total) trans 21474843199 rc 0/0 00000100:00100000:2.0:1762167005.562724:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16588 00000004:00080000:0.0:1762167005.562726:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4f800/2, rc 0, transno 17179875671 00000100:00100000:0.0:1762167005.562733:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454409088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.562741:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454410112 00000100:00100000:2.0:1762167005.562746:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454410112 00002000:00010000:1.0:1762167005.562753:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.562756:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.562759:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.562786:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000004:00080000:0.0:1762167005.562787:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce4e00/2, rc 0, transno 21474843199 00002000:00010000:1.0:1762167005.562789:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167005.562792:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16591 00000100:00100000:0.0:1762167005.562795:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454409856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.562803:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454409600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.562820:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16592 00000100:00100000:1.0:1762167005.562830:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454409344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (396us total) trans 21474843200 rc 0/0 00000100:00100000:0.0:1762167005.562834:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454410112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.562843:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16589 00000100:00100000:3.0:1762167005.562878:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3293:x1847765454410368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (322us total) trans 17179875675 rc 0/0 00000004:00080000:1.0:1762167005.562886:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4c700/2, rc 0, transno 17179875675 00000100:00100000:3.0:1762167005.562887:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16590 00000100:00100000:1.0:1762167005.562895:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454410368:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167005.562907:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce7800/2, rc 0, transno 21474843200 00000100:00100000:1.0:1762167005.562911:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454409344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.562931:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.562952:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1847765454409600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (328us total) trans 21474843201 rc 0/0 00000100:00100000:1.0:1762167005.562954:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454409984:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167005.562956:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.562960:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167005.562961:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16591 00002000:00010000:0.0:1762167005.562965:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.562969:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000004:00080000:3.0:1762167005.562972:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce6a00/2, rc 0, transno 21474843201 00002000:00010000:0.0:1762167005.562972:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167005.562978:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454409472 00000100:00100000:1.0:1762167005.562980:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.562983:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454409472 00000100:00100000:3.0:1762167005.562984:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454409600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.563008:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454410496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.563010:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454409984 00000100:00100000:2.0:1762167005.563013:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454409984 00000100:00100000:3.0:1762167005.563017:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16593 00000100:00100000:0.0:1762167005.563025:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3295:x1847765454410112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (336us total) trans 21474843202 rc 0/0 00000100:00100000:3.0:1762167005.563031:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454409472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.563039:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.563044:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16592 00000100:00100000:2.0:1762167005.563053:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16594 00000100:00100000:2.0:1762167005.563061:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454409984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.563064:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454410496 00000004:00080000:1.0:1762167005.563067:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4e300/2, rc 0, transno 17179875672 00000100:00100000:0.0:1762167005.563070:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454410496 00000100:00100000:1.0:1762167005.563074:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454408960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.563106:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16595 00000100:00100000:0.0:1762167005.563115:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454410496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167005.563166:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.563171:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.563174:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167005.563176:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.563179:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167005.563195:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.563199:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.563202:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167005.563205:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.563207:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.563222:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454409472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (288us total) trans 21474843203 rc 0/0 00000100:00100000:3.0:1762167005.563231:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16593 00002000:00010000:0.0:1762167005.563243:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 154021 -> 154021 00000004:00080000:1.0:1762167005.563244:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce4700/2, rc 0, transno 21474843203 00000100:00100000:2.0:1762167005.563245:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454409984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (265us total) trans 17179875676 rc 0/0 00000100:00100000:1.0:1762167005.563251:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454409472:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167005.563251:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167005.563256:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16594 00002000:00010000:0.0:1762167005.563259:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.563262:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000004:00080000:1.0:1762167005.563264:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4ed80/2, rc 0, transno 17179875676 00002000:00010000:0.0:1762167005.563265:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167005.563271:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454409984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.563308:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454410496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (270us total) trans 17179875677 rc 0/0 00000100:00100000:0.0:1762167005.563316:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16595 00000004:00080000:1.0:1762167005.563321:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4d180/2, rc 0, transno 17179875677 00000100:00100000:1.0:1762167005.563328:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454410496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167005.563348:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce5f80/2, rc 0, transno 21474843202 00000100:00100000:0.0:1762167005.563354:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454410112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.564048:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.564094:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451769344 00000100:00100000:0.0:1762167005.564100:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451769344 00000100:00100000:0.0:1762167005.564130:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16596 00000100:00100000:0.0:1762167005.564138:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56065:x1847765451769344:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167005.564148:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.564163:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3413 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.564185:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09ae4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb331e expref: 22 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.564193:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.564195:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.564199:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.564223:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb331e expref: 22 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.564236:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09ae4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb331e expref: 22 pid: 26444 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1762167005.564246:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454410624:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.564301:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.565196:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454410624:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.565219:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.565238:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8a00, rc 0) 00000100:00100000:0.0:1762167005.565281:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56065:x1847765451769344:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1143us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.565288:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16596 00000100:00100000:1.0:1762167005.565411:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.565448:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451769472 00000100:00100000:2.0:1762167005.565455:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451769472 00010000:00010000:2.0:1762167005.565476:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09ae4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb331e expref: 22 pid: 26444 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167005.565503:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7392 00000100:00100000:2.0:1762167005.565511:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451769472:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.565522:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.565538:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09ae4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb331e expref: 22 pid: 26444 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.565551:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb331e expref: 22 pid: 26444 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.565570:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d09ae4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb331e expref: 22 pid: 26444 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.565582:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.565584:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.565590:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.565599:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.565625:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.565637:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454410752:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167005.565690:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a780 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.567201:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.567271:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454410752:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167005.567284:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451769600 00010000:00010000:1.0:1762167005.567292:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167005.567293:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451769600 00000100:00100000:0.0:1762167005.567339:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16597 00000100:00100000:1.0:1762167005.567350:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451769472:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1835us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.567350:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56065:x1847765451769600:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167005.567365:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167005.567366:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7392 00010000:00010000:0.0:1762167005.567381:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb341a expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.567424:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aeb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3325 expref: 27 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.567433:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.567435:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.567439:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.567464:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3325 expref: 27 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.567477:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3325 expref: 27 pid: 6535 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1762167005.567496:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454410880:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.567551:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.568850:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454410880:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.568879:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.568894:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:0.0:1762167005.568932:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451769600:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1587us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.568941:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16597 00000100:00100000:3.0:1762167005.569066:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.569127:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451769728 00000100:00100000:1.0:1762167005.569132:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451769728 00010000:00010000:1.0:1762167005.569156:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3325 expref: 27 pid: 6535 timeout: 726 lvb_type: 1 00000100:00100000:1.0:1762167005.569184:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7393 00000100:00100000:1.0:1762167005.569193:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451769728:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.569205:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.569223:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3325 expref: 27 pid: 6535 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.569235:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3325 expref: 27 pid: 6535 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.569253:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d09aeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3325 expref: 27 pid: 6535 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.569266:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.569268:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.569274:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 26 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.569281:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 26 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.569306:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 26 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.569323:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454411008:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167005.569375:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.570300:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454411008:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167005.570318:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167005.570357:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451769728:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1164us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.570367:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7393 00000100:00100000:2.0:1762167005.570471:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.570536:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451769856 00000100:00100000:0.0:1762167005.570541:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451769856 00000100:00100000:0.0:1762167005.570584:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16598 00000100:00100000:0.0:1762167005.570593:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56065:x1847765451769856:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167005.570605:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.570619:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3421 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.570642:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09af2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb332c expref: 22 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.570650:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.570652:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.570669:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.570698:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09af2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb332c expref: 22 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.570711:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09af2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb332c expref: 22 pid: 33894 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1762167005.570723:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454411136:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.570809:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.571881:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.571967:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451769984 00000100:00100000:1.0:1762167005.571975:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451769984 00000100:00100000:0.0:1762167005.571975:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454411136:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.571998:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.572002:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09af2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb332c expref: 23 pid: 33894 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1762167005.572024:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:1.0:1762167005.572043:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7394 00000100:00100000:1.0:1762167005.572055:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451769984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.572067:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762167005.572073:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56065:x1847765451769856:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1479us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.572081:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16598 00010000:00010000:1.0:1762167005.572089:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09af2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb332c expref: 23 pid: 33894 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.572104:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09af2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb332c expref: 22 pid: 33894 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.572126:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09af2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb332c expref: 22 pid: 33894 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.572143:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.572146:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.572150:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.572160:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.572194:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.572206:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454411264:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167005.572254:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.573304:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454411264:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167005.573316:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167005.573345:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451769984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1295us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.573351:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7394 00000100:00100000:3.0:1762167005.573939:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.574064:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451770112 00000100:00100000:0.0:1762167005.574071:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451770112 00002000:00010000:0.0:1762167005.574099:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (154055->18446744073709551615) 00000100:00100000:3.0:1762167005.574106:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00100000:0.0:1762167005.574107:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242408700 with x1847765451770112 ext(154055->18446744073709551615) 00002000:00010000:0.0:1762167005.574117:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242408700. 00000100:00100000:0.0:1762167005.574145:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451770240 00000100:00100000:0.0:1762167005.574148:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451770240 00002000:00010000:0.0:1762167005.574160:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167005.574163:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242408380 with x1847765451770240 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.574171:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242408380. 00000100:00100000:1.0:1762167005.574175:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2785 00000100:00100000:1.0:1762167005.574185:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451770112:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167005.574203:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2786 00000100:00100000:0.0:1762167005.574212:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451770240:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167005.574380:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.574451:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451770368 00000100:00100000:3.0:1762167005.574457:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451770368 00002000:00010000:1.0:1762167005.574467:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 154021 -> 154055 00002000:00010000:0.0:1762167005.574467:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.574472:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.574473:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.574476:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:0.0:1762167005.574476:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.574483:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00100000:3.0:1762167005.574485:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab2d80 with x1847765451770368 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167005.574486:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.574489:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167005.574493:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.574495:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee374ab2d80. 00002000:00010000:1.0:1762167005.574499:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 211 -> 211 00000100:00100000:3.0:1762167005.574533:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2787 00000100:00100000:1.0:1762167005.574542:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451770112:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 353us (599us total) trans 21474843204 rc 0/0 00000100:00100000:0.0:1762167005.574542:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451770240:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 324us (432us total) trans 17179875678 rc 0/0 00000100:00100000:3.0:1762167005.574550:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451770368:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167005.574562:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2785 00002000:00010000:1.0:1762167005.574566:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (154055->18446744073709551615) 00002000:00100000:1.0:1762167005.574570:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242408700 with x1847765451770112 ext(154055->18446744073709551615) 00000100:00100000:0.0:1762167005.574573:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2786 00002000:00010000:1.0:1762167005.574577:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242408700. 00002000:00010000:0.0:1762167005.574579:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167005.574584:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242408380 with x1847765451770240 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.574590:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242408380. 00002000:00010000:3.0:1762167005.574687:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.574691:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.574694:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.574696:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.574699:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.574799:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451770368:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 253us (419us total) trans 21474843205 rc 0/0 00000100:00100000:3.0:1762167005.574808:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2787 00002000:00010000:3.0:1762167005.574812:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167005.574816:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab2d80 with x1847765451770368 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167005.574821:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee374ab2d80. 00000100:00100000:2.0:1762167005.576997:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.577060:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451770496 00000100:00100000:3.0:1762167005.577068:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451770496 00002000:00100000:3.0:1762167005.577105:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (90112->155647) req@ffff9ee374ab0700 x1847765451770496/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167005.577116:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab0700 with x1847765451770496 ext(90112->155647) 00002000:00010000:3.0:1762167005.577121:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee374ab0700 00000100:00100000:3.0:1762167005.577144:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2788 00000100:00100000:3.0:1762167005.577151:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765451770496:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762167005.578369:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765451770496:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1215us (1376us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1762167005.578378:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2788 00002000:00100000:3.0:1762167005.578386:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (90112->155647) req@ffff9ee374ab0700 x1847765451770496/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/440 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 65536/65536 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167005.578408:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab0700 with x1847765451770496 ext(90112->155647) 00002000:00010000:3.0:1762167005.578413:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee374ab0700 00000100:00100000:1.0:1762167005.581240:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.581293:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451770624 00000100:00100000:3.0:1762167005.581303:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451770624 00002000:00100000:3.0:1762167005.581345:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (118784->154054) req@ffff9ee348255500 x1847765451770624/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/0 e 0 to 0 dl 1762167016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167005.581357:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348255500 with x1847765451770624 ext(118784->154054) 00002000:00010000:3.0:1762167005.581362:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348255500 00000100:00100000:3.0:1762167005.581409:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2789 00000100:00100000:3.0:1762167005.581419:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765451770624:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:3.0:1762167005.582950:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765451770624:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 1527us (1713us total) trans 21474843206 rc 0/0 00000100:00100000:3.0:1762167005.582964:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2789 00002000:00100000:3.0:1762167005.582975:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (118784->154054) req@ffff9ee348255500 x1847765451770624/t21474843206(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:36/0 lens 488/448 e 0 to 0 dl 1762167016 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167005.582985:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348255500 with x1847765451770624 ext(118784->154054) 00002000:00010000:3.0:1762167005.582990:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348255500 00000100:00100000:2.0:1762167005.584275:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.584428:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451770752 00000100:00100000:0.0:1762167005.584438:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451770752 00000100:00100000:0.0:1762167005.584495:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16599 00000100:00100000:0.0:1762167005.584505:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451770752:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:2.0:1762167005.600200:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843202 is committed 00000001:00080000:2.0:1762167005.600218:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843186 is committed 00000001:00080000:2.0:1762167005.600228:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843204 is committed 00000001:00080000:2.0:1762167005.600251:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843206 is committed 00000001:00080000:2.0:1762167005.600259:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843203 is committed 00000100:00100000:3.0:1762167005.600291:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451770752:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 15781us (16014us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.600304:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16599 00000100:00100000:1.0:1762167005.601858:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.601991:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451770880 00000100:00100000:3.0:1762167005.602000:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451770880 00000100:00100000:3.0:1762167005.602051:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19657 00000100:00100000:3.0:1762167005.602061:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451770880:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167005.602082:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.602099:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09dd1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3428 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.602170:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.602184:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.602192:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167005.602210:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154057 00000004:00200000:3.0:1762167005.602213:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167005.602225:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.602241:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09dd1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3428 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.602252:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3428 expref: 891 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.602258:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167005.602260:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167005.602263:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167005.602299:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451770880:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 241us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.602303:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19657 00000100:00100000:2.0:1762167005.607584:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.607713:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451771136 00000100:00100000:3.0:1762167005.607722:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451771136 00000100:00100000:0.0:1762167005.607805:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7294 00000100:00100000:0.0:1762167005.607819:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451771136:12345-192.168.203.35@tcp:35:fsx.0 00010000:00010000:2.0:1762167005.607916:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167005.608082:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451771136:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 267us (510us total) trans 8589952747 rc 0/0 00000100:00100000:0.0:1762167005.608090:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7294 00000100:00100000:2.0:1762167005.617975:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.618041:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451771264 00000100:00100000:3.0:1762167005.618052:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451771264 00000100:00100000:3.0:1762167005.618112:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19658 00000100:00100000:3.0:1762167005.618124:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56193:x1847765451771264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.618151:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.618172:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ddf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb342f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.618254:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09de6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618267:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09de6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618278:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09de6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618296:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09ded lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618302:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09ded lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618309:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09ded lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618427:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09df4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618435:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09df4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618442:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09df4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167005.618476:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154057 00000004:00200000:3.0:1762167005.618480:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167005.618496:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09df4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618509:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09df4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618517:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09de6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618523:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09de6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618530:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09de6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618534:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.618536:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09de6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618541:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09de6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618551:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167005.618555:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.618558:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09de6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618564:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09de6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618576:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09ded lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618582:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09ded lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618587:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09ded lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618592:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.618595:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09ded lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618601:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09ded lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618608:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23100) 00010000:00010000:3.0:1762167005.618610:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.618613:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09ded lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618619:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09ded lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.618647:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09ddf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb342f expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.618660:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09df4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb342f expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.618667:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167005.618669:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167005.618672:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:3.0:1762167005.618723:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56193:x1847765451771264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 603us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.618729:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19658 00000100:00100000:1.0:1762167005.620862:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.620927:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451771392 00000100:00100000:2.0:1762167005.620936:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451771392 00000100:00100000:2.0:1762167005.620990:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 634 00000100:00100000:2.0:1762167005.621001:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2361:x1847765451771392:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.621016:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.621039:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d09df4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb342f expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.621059:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:2.0:1762167005.621064:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.621117:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:2361:x1847765451771392:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 118us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.621127:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 634 00000100:00100000:0.0:1762167005.621189:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.621214:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451771648 00000100:00100000:3.0:1762167005.621220:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451771648 00000100:00100000:3.0:1762167005.621353:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19659 00000100:00100000:3.0:1762167005.621363:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56193:x1847765451771648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.621378:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.621391:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09dfb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3436 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.621489:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.621502:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3428 expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.621510:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.621539:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3428 expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.621552:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3428 expref: 893 pid: 30818 timeout: 726 lvb_type: 0 00000100:00100000:3.0:1762167005.621565:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454411392:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.621629:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2429433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.623096:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454411392:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.623122:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.623186:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.623251:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451771776 00000100:00100000:2.0:1762167005.623257:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451771776 00010000:00010000:2.0:1762167005.623283:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3428 expref: 894 pid: 30818 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.623313:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7395 00000100:00100000:2.0:1762167005.623322:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451771776:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.623333:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.623340:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3428 expref: 894 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.623352:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3428 expref: 894 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.623370:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d09dd8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3428 expref: 894 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.623385:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:2.0:1762167005.623389:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.623408:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.623415:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167005.623437:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.623471:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.623480:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2360:x1847765451771776:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (293us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167005.623482:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.623502:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7395 00000004:00200000:0.0:1762167005.623507:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154057 00010000:00010000:0.0:1762167005.623669:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d09dfb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3436 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.623685:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3436 expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.623692:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.623695:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167005.623697:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:0.0:1762167005.623740:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56193:x1847765451771648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2378us (2552us total) trans 8589952748 rc 0/0 00000100:00100000:0.0:1762167005.623749:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19659 00000100:00100000:3.0:1762167005.625274:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.625421:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451771904 00000100:00100000:0.0:1762167005.625428:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451771904 00000100:00100000:3.0:1762167005.625674:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19660 00000100:00100000:3.0:1762167005.625685:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56193:x1847765451771904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.625706:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.625724:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09e10 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb343d expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.625821:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.625834:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3436 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.625842:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.625958:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3436 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.625981:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3436 expref: 894 pid: 30818 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.625995:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454411520:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.626073:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.627623:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.627641:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454411520:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.627664:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167005.627681:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451772032 00000100:00100000:1.0:1762167005.627687:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451772032 00010000:00010000:1.0:1762167005.627718:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3436 expref: 895 pid: 30818 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167005.627752:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7396 00000100:00100000:1.0:1762167005.627759:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765451772032:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.627797:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.627804:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3436 expref: 895 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.627817:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3436 expref: 895 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.627836:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d09e02 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3436 expref: 895 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.627849:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:1.0:1762167005.627854:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.627862:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.627869:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.627894:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167005.627920:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.627930:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167005.627939:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765451772032:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 179us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.627948:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7396 00000004:00200000:2.0:1762167005.627975:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154057 00000004:00200000:2.0:1762167005.627981:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167005.628001:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.628030:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d09e10 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb343d expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.628044:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb343d expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.628053:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:2.0:1762167005.628056:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167005.628058:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:2.0:1762167005.628088:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56193:x1847765451771904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2407us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.628094:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19660 00000100:00100000:3.0:1762167005.630257:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.630308:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451772288 00000100:00100000:2.0:1762167005.630325:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451772288 00000100:00100000:2.0:1762167005.630385:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19661 00000100:00100000:2.0:1762167005.630409:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56193:x1847765451772288:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.630427:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.630444:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e1e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3444 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.630526:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09e25 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.630539:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09e25 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167005.630548:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09e25 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167005.630561:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154057 00010000:00010000:2.0:1762167005.630672:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e1e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3444 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.630688:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09e25 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3444 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.630696:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:2.0:1762167005.630699:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167005.630701:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:2.0:1762167005.630750:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56193:x1847765451772288:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 356us (499us total) trans 8589952749 rc 0/0 00000100:00100000:2.0:1762167005.630757:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19661 00000100:00100000:1.0:1762167005.632380:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.632426:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.632463:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.632466:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451772416 00000100:00100000:3.0:1762167005.632473:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451772416 00000100:00100000:2.0:1762167005.632492:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451772544 00000100:00100000:2.0:1762167005.632497:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451772544 00000100:00100000:3.0:1762167005.632524:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451772672 00000100:00100000:3.0:1762167005.632527:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451772672 00000100:00100000:2.0:1762167005.632536:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16600 00000100:00100000:0.0:1762167005.632546:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16601 00000100:00100000:2.0:1762167005.632547:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451772416:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167005.632559:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16602 00000100:00100000:0.0:1762167005.632565:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451772544:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167005.632576:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451772672:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167005.632584:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.632592:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.632602:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.632612:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.632624:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167005.632630:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.632630:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.632634:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.632635:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.632646:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.632650:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167005.632655:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.632658:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.632661:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.632665:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.632682:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.632691:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.632696:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.632697:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 17 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1762167005.632712:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 27 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.632726:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 17 pid: 6533 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167005.632747:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454411776:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.632749:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454411648:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167005.632752:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454411904:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.632841:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.632842:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8300 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.632842:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.634216:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454411648:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.634236:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.634323:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454411776:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.634338:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.634419:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.634440:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454411904:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167005.634465:0:33892:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.634466:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.634566:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.634573:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451772928 00000100:00100000:3.0:1762167005.634580:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451772928 00010000:00010000:3.0:1762167005.634604:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 18 pid: 6533 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167005.634672:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451772800 00000100:00100000:1.0:1762167005.634673:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451773056 00000100:00100000:0.0:1762167005.634678:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451772800 00000100:00100000:1.0:1762167005.634680:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451773056 00000100:00100000:3.0:1762167005.634697:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7397 00010000:00010000:0.0:1762167005.634702:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 28 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.634706:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 19 pid: 6533 timeout: 726 lvb_type: 0 00000100:00100000:3.0:1762167005.634711:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451772928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167005.634728:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762167005.634747:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7398 00002000:00010000:3.0:1762167005.634748:0:6549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 211 -> 227 00000100:00100000:1.0:1762167005.634756:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7399 00010000:00010000:3.0:1762167005.634759:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 19 pid: 6533 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167005.634804:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451773056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167005.634820:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 19 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.634829:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.634843:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d09dbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3413 expref: 19 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.634853:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 19 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:3.0:1762167005.634857:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.634861:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.634867:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.634871:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 18 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:3.0:1762167005.634886:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.634898:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09dca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3421 expref: 18 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:1.0:1762167005.634917:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.634919:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.634923:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.634931:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.634943:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451772800:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.634960:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167005.635005:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167005.635015:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451773056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 214us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.635024:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7399 00000100:00100000:2.0:1762167005.635032:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451772928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 322us (612us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167005.635033:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.635048:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7397 00010000:00010000:3.0:1762167005.635051:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.635076:0:33892:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.635078:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.635091:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.635100:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.635107:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.635112:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167005.635120:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167005.635125:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.635129:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.635131:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 28 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:3.0:1762167005.635140:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.635159:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.635161:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 28 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:3.0:1762167005.635164:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.635186:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d09e33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.635189:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.635196:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09dc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb341a expref: 28 pid: 6533 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1762167005.635218:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.635221:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7aa00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.635222:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.635229:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.635234:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.635247:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.635248:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.635276:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451772416:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2731us (2898us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167005.635279:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.635283:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.635289:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16600 00010000:00010000:1.0:1762167005.635300:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.635302:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.635313:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451772800:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 555us (845us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167005.635323:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.635331:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7398 00000100:00100000:1.0:1762167005.635377:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2360:x1847765451772672:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2800us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.635385:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16602 00010000:00010000:2.0:1762167005.635430:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.635441:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.635449:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.635459:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.635463:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.635470:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.635482:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.635488:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d09e3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.635540:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451772544:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2982us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.635546:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16601 00000100:00100000:2.0:1762167005.637278:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.637323:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451773312 00000100:00100000:0.0:1762167005.637331:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451773312 00000100:00100000:0.0:1762167005.637390:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19662 00000100:00100000:0.0:1762167005.637408:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56193:x1847765451773312:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167005.637459:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167005.637482:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d09e17 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb343d expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.637502:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09db5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb340c expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.637514:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.637518:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.637545:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.637555:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167005.637564:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000040:00080000:0.0:1762167005.638094:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5370, 88 off432928 00000004:00080000:0.0:1762167005.638102:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626430338725ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.638165:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5378, 88 off434048 00000004:00080000:0.0:1762167005.638171:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626430408305ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.638205:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5379, 88 off434136 00000004:00080000:0.0:1762167005.638209:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626430446475ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.638224:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5371, 88 off433016 00000004:00080000:0.0:1762167005.638228:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626430465157ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.638312:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5381, 88 off434264 00000004:00080000:0.0:1762167005.638318:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626430555515ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.638351:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5372, 88 off433104 00000004:00080000:0.0:1762167005.638357:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626430594115ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.638385:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5373, 88 off433192 00000004:00080000:0.0:1762167005.638389:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626430626620ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.638426:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5382, 88 off434352 00000004:00080000:0.0:1762167005.638431:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626430667850ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.638460:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5383, 88 off434440 00000004:00080000:0.0:1762167005.638465:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626430702065ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.638482:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5374, 88 off433280 00000004:00080000:0.0:1762167005.638486:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626430723740ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.638513:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5384, 88 off434528 00000004:00080000:0.0:1762167005.638517:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626430754200ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.638534:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5375, 88 off433368 00000004:00080000:0.0:1762167005.638536:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626430773492ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.638552:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5385, 88 off434616 00000004:00080000:0.0:1762167005.638556:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626430793547ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.638573:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5376, 88 off433456 00000004:00080000:0.0:1762167005.638576:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626430813578ns, next at 626774750597ns, rc = 0 00000001:00080000:3.0:1762167005.652861:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952750 is committed 00000004:00080000:3.0:1762167005.652879:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3485 committed 00000004:00080000:3.0:1762167005.652896:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3498 committed 00000004:00010000:0.0:1762167005.652909:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000004b3a258 reply state 000000004ca453ae transno 8589952750 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00080000:3.0:1762167005.652917:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3484 committed 00000004:00080000:3.0:1762167005.652922:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3497 committed 00000004:00080000:3.0:1762167005.652928:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3483 committed 00000100:00100000:0.0:1762167005.652929:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:3.0:1762167005.652931:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3496 committed 00000004:00080000:3.0:1762167005.652936:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3495 committed 00000004:00080000:3.0:1762167005.652939:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3482 committed 00000004:00080000:3.0:1762167005.652941:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3481 committed 00000004:00080000:3.0:1762167005.652943:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3494 committed 00000004:00080000:3.0:1762167005.652947:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3480 committed 00000004:00080000:3.0:1762167005.652949:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3493 committed 00000004:00080000:3.0:1762167005.652951:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3492 committed 00000004:00080000:3.0:1762167005.652953:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3479 committed 00010000:00080000:0.0:1762167005.653098:0:32138:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762167005.653121:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56193:x1847765451773312:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 15707us (15851us total) trans 8589952750 rc 0/0 00000100:00100000:0.0:1762167005.653135:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19662 00000100:00100000:2.0:1762167005.653202:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454412032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.653273:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167005.653314:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167005.653320:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454412544:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167005.653332:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.653342:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.653348:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8200 already unused, calling callback (ffffffffc2129310) 00000100:00100000:0.0:1762167005.653351:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454412032 00010000:00010000:3.0:1762167005.653354:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167005.653362:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.653363:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454412032 00000100:00100000:2.0:1762167005.653418:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454413056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.653439:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454412544 00000100:00100000:0.0:1762167005.653445:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454412544 00010000:00010000:3.0:1762167005.653450:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167005.653461:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167005.653479:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167005.653483:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167005.653489:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167005.653495:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09e48 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167005.653497:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454413056 00000100:00100000:2.0:1762167005.653504:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454413568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.653505:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454413056 00000100:00100000:1.0:1762167005.653514:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16603 00000100:00100000:1.0:1762167005.653531:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765454412032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.653548:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.653553:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16604 00000100:00100000:3.0:1762167005.653566:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16605 00000100:00100000:0.0:1762167005.653574:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765454412544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.653582:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1762167005.653587:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765454413056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.653594:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454412160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.653626:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.653656:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454412672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.653691:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.653723:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454413184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.653751:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.653809:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454413696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.653845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.653878:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454412288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.653907:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.653932:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454412800:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167005.653937:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.653942:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.653951:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.653954:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.653957:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.653961:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1762167005.653968:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167005.653970:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167005.653977:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00000100:00100000:1.0:1762167005.653983:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454412032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 449us (700us total) trans 21474843207 rc 0/0 00002000:00010000:0.0:1762167005.653985:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167005.653996:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454413312:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167005.653997:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.654011:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454413056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 423us (549us total) trans 21474843208 rc 0/0 00000100:00100000:1.0:1762167005.654011:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16603 00000100:00100000:3.0:1762167005.654020:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16605 00000100:00100000:3.0:1762167005.654039:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454412160 00000100:00100000:1.0:1762167005.654039:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454413568 00000100:00100000:3.0:1762167005.654045:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454412160 00000100:00100000:1.0:1762167005.654045:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454413568 00000100:00100000:2.0:1762167005.654062:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.654078:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454412672 00000100:00100000:0.0:1762167005.654078:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765454412544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 510us (716us total) trans 21474843209 rc 0/0 00000100:00100000:1.0:1762167005.654079:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454413184 00000100:00100000:3.0:1762167005.654082:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454412672 00000100:00100000:1.0:1762167005.654087:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454413184 00000100:00100000:2.0:1762167005.654089:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1762167005.654098:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454413696 00000100:00100000:1.0:1762167005.654102:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454412288 00000100:00100000:3.0:1762167005.654103:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454413696 00000100:00100000:1.0:1762167005.654105:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454412288 00000100:00100000:0.0:1762167005.654110:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16604 00000100:00100000:2.0:1762167005.654112:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454412416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.654122:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454412800 00000100:00100000:1.0:1762167005.654122:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454413312 00000100:00100000:3.0:1762167005.654125:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454412800 00000100:00100000:1.0:1762167005.654126:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454413312 00000100:00100000:0.0:1762167005.654147:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16606 00000100:00100000:2.0:1762167005.654155:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.654167:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454412160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.654170:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454412416 00000100:00100000:1.0:1762167005.654177:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454412416 00000100:00100000:3.0:1762167005.654181:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16607 00000100:00100000:2.0:1762167005.654181:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454412928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.654193:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454413568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.654199:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16608 00000100:00100000:1.0:1762167005.654206:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454412672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.654212:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.654235:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454413440:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.654265:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167005.654308:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454412928 00000100:00100000:2.0:1762167005.654313:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454412928 00000100:00100000:2.0:1762167005.654351:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454413440 00000100:00100000:2.0:1762167005.654358:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454413440 00002000:00010000:0.0:1762167005.654383:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.654389:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167005.654403:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1762167005.654408:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16609 00002000:00010000:0.0:1762167005.654411:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167005.654417:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167005.654427:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3295:x1847765454413184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.654439:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454412672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (747us total) trans 21474843210 rc 0/0 00000100:00100000:1.0:1762167005.654448:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16608 00000100:00100000:1.0:1762167005.654482:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16610 00000100:00100000:0.0:1762167005.654482:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3295:x1847765454412160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 317us (850us total) trans 17179875679 rc 0/0 00000100:00100000:0.0:1762167005.654502:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16606 00000100:00100000:1.0:1762167005.654506:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3295:x1847765454413696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.654515:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3295:x1847765454413568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 322us (967us total) trans 17179875680 rc 0/0 00000100:00100000:3.0:1762167005.654524:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16607 00000100:00100000:0.0:1762167005.654548:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16611 00000100:00100000:3.0:1762167005.654559:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16612 00000100:00100000:0.0:1762167005.654565:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454412288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.654579:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454412800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.654614:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3295:x1847765454413184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (860us total) trans 17179875681 rc 0/0 00000100:00100000:2.0:1762167005.654623:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16609 00000100:00100000:2.0:1762167005.654655:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16613 00002000:00010000:1.0:1762167005.654667:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 154021 -> 154021 00000100:00100000:2.0:1762167005.654672:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454413312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167005.654673:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.654679:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.654682:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.654686:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167005.654721:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3295:x1847765454413696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 222us (875us total) trans 17179875682 rc 0/0 00000100:00100000:1.0:1762167005.654730:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16610 00000100:00100000:1.0:1762167005.654756:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16614 00000100:00100000:1.0:1762167005.654798:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454412416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167005.654900:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167005.654903:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454412288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 342us (993us total) trans 21474843211 rc 0/0 00002000:00010000:2.0:1762167005.654906:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.654920:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167005.654926:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000100:00100000:0.0:1762167005.654928:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16611 00002000:00010000:2.0:1762167005.654936:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167005.654957:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167005.654962:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16615 00002000:00010000:3.0:1762167005.654967:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.654973:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:3.0:1762167005.654977:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000100:00100000:0.0:1762167005.654984:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454412928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167005.654985:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167005.654985:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3293:x1847765454412416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (828us total) trans 17179875684 rc 0/0 00000100:00100000:2.0:1762167005.654996:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3293:x1847765454413312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 325us (927us total) trans 17179875683 rc 0/0 00000100:00100000:1.0:1762167005.655010:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16614 00000100:00100000:2.0:1762167005.655017:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16613 00000100:00100000:3.0:1762167005.655023:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454412800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 451us (1059us total) trans 21474843212 rc 0/0 00000100:00100000:3.0:1762167005.655030:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16612 00000100:00100000:1.0:1762167005.655037:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16616 00000100:00100000:1.0:1762167005.655051:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454413440:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167005.655115:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348254700/2, rc 0, transno 17179875684 00000100:00100000:2.0:1762167005.655125:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454412416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.655149:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843203 gen 2 00000004:00080000:2.0:1762167005.655154:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb7b80, transno 21474843190 00000004:00080000:2.0:1762167005.655166:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb6d80, transno 21474843191 00000100:00100000:3.0:1762167005.655170:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000004:00080000:2.0:1762167005.655179:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb6300, transno 21474843192 00000004:00080000:2.0:1762167005.655185:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb5880, transno 21474843193 00000004:00080000:2.0:1762167005.655191:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb5180, transno 21474843194 00000004:00080000:2.0:1762167005.655197:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb4700, transno 21474843195 00002000:00010000:0.0:1762167005.655197:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.655206:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000004:00080000:2.0:1762167005.655209:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb6680, transno 21474843196 00002000:00010000:0.0:1762167005.655213:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167005.655216:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 154021 -> 154021 00000004:00080000:2.0:1762167005.655217:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce4380, transno 21474843197 00002000:00010000:0.0:1762167005.655219:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000004:00080000:2.0:1762167005.655227:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce5180, transno 21474843198 00002000:00010000:1.0:1762167005.655227:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167005.655228:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:2.0:1762167005.655236:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce4e00, transno 21474843199 00002000:00010000:1.0:1762167005.655240:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00000004:00080000:2.0:1762167005.655244:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce7800, transno 21474843200 00002000:00010000:1.0:1762167005.655245:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167005 -> 1762167005 00000100:00100000:3.0:1762167005.655250:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451773440 00002000:00010000:1.0:1762167005.655250:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 515 -> 515 00000004:00080000:2.0:1762167005.655253:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce6a00, transno 21474843201 00000100:00100000:3.0:1762167005.655255:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451773440 00000004:00080000:2.0:1762167005.655258:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce5f80, transno 21474843202 00000004:00080000:2.0:1762167005.655266:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce4700, transno 21474843203 00000100:00100000:2.0:1762167005.655275:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36f287480 x1847765454412288/t21474843211(21474843211) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167021 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762167005.655287:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f287480/2, rc 0, transno 21474843211 00000100:00100000:0.0:1762167005.655287:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454412928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 311us (1071us total) trans 21474843213 rc 0/0 00000100:00100000:3.0:1762167005.655301:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19663 00000100:00100000:2.0:1762167005.655303:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454412288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.655305:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454413440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 256us (1034us total) trans 17179875685 rc 0/0 00000100:00100000:0.0:1762167005.655319:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16615 00000100:00100000:3.0:1762167005.655320:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56193:x1847765451773440:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:1.0:1762167005.655328:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16616 00000004:00080000:2.0:1762167005.655333:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f285180/2, rc 0, transno 21474843212 00010000:00010000:3.0:1762167005.655340:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762167005.655346:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454412800:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167005.655358:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09e4f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb344b expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762167005.655362:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348257100/2, rc 0, transno 17179875683 00000100:00100000:2.0:1762167005.655370:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454413312:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167005.655387:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284380/2, rc 0, transno 21474843213 00000100:00100000:2.0:1762167005.655391:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454412928:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.655411:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348255f80/2, rc 0, transno 17179875685 00000100:00100000:2.0:1762167005.655414:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454413440:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1762167005.655428:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09e4f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb344b expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.655445:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09e4f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb344b expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.655465:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167005.655469:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167005.655472:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:3.0:1762167005.655522:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56193:x1847765451773440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 206us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.655529:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19663 00000004:00080000:2.0:1762167005.655627:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 7 in progress, 4 in flight, 14 done 00000004:00080000:2.0:1762167005.655658:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348255c00/2, rc 0, transno 17179875679 00000100:00100000:2.0:1762167005.655666:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454412160:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167005.655683:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f286680/2, rc 0, transno 21474843210 00000100:00100000:2.0:1762167005.655689:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454412672:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.655698:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348256a00/2, rc 0, transno 17179875681 00000100:00100000:2.0:1762167005.655702:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454413184:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167005.655710:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247868e00/2, rc 0, transno 17179875682 00000100:00100000:2.0:1762167005.655714:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454413696:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167005.655722:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348254e00/2, rc 0, transno 17179875680 00000100:00100000:2.0:1762167005.655724:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454413568:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167005.655733:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f797b80/2, rc 0, transno 21474843207 00000100:00100000:2.0:1762167005.655736:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454412032:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.655744:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f287800/2, rc 0, transno 21474843209 00000100:00100000:2.0:1762167005.655747:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454412544:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.655754:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284e00/2, rc 0, transno 21474843208 00000100:00100000:2.0:1762167005.655757:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454413056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.657289:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.657420:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451773568 00000100:00100000:0.0:1762167005.657427:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451773568 00000100:00100000:0.0:1762167005.657473:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19664 00000100:00100000:0.0:1762167005.657483:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56193:x1847765451773568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.657500:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.657517:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09e56 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3452 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.657588:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09e5d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.657602:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09e5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.657612:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09e5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167005.657641:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154057 00000004:00200000:0.0:1762167005.657645:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167005.657671:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09e5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.657696:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09e56 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3452 expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.657713:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09e5d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3452 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.657720:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.657723:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167005.657726:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:0.0:1762167005.657793:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56193:x1847765451773568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 311us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.657815:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19664 00000100:00100000:0.0:1762167005.659437:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.659499:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451773696 00000100:00100000:2.0:1762167005.659507:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451773696 00000100:00100000:2.0:1762167005.659559:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16617 00000100:00100000:2.0:1762167005.659569:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2358:x1847765451773696:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.659582:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.659602:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3459 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.659628:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 154055, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888dd, blocks: 0xe3 00010000:00010000:2.0:1762167005.659646:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.659649:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.659660:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3459 expref: 15 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.659677:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3459 expref: 15 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.659701:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:3.0:1762167005.659854:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.659857:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2358:x1847765451773696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 277us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.659870:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16617 00000100:00100000:2.0:1762167005.659892:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451773824 00000100:00100000:2.0:1762167005.659896:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451773824 00000100:00100000:2.0:1762167005.659929:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16618 00000100:00100000:2.0:1762167005.659937:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451773824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.659952:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.659970:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09e6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3460 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.659990:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888dd, blocks: 0x3 00010000:00010000:2.0:1762167005.660004:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.660007:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.660020:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09e6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3460 expref: 27 pid: 33892 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167005.660026:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167005.660038:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09e6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3460 expref: 27 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.660049:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:1.0:1762167005.660058:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451773952 00000100:00100000:1.0:1762167005.660065:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451773952 00000100:00100000:2.0:1762167005.660100:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451773824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 163us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.660109:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16619 00000100:00100000:2.0:1762167005.660117:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16618 00000100:00100000:1.0:1762167005.660122:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2358:x1847765451773952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167005.660133:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167005.660146:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3467 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167005.660161:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888dd, blocks: 0x3 00010000:00010000:1.0:1762167005.660172:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.660174:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.660180:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3467 expref: 16 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167005.660192:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3467 expref: 16 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167005.660202:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7aa00, rc 0) 00000100:00100000:1.0:1762167005.660237:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765451773952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 120us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.660245:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16619 00000100:00100000:3.0:1762167005.687911:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.688023:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451774080 00000100:00100000:2.0:1762167005.688033:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451774080 00000100:00100000:2.0:1762167005.688104:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2790 00000100:00100000:2.0:1762167005.688114:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451774080:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167005.688150:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09e79 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.688165:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.688166:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.688171:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09e79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.688184:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09e79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.690007:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09e79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.690023:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09e79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.690031:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09e79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.690038:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.690043:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09e79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.690052:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09e79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.690068:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09e79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.690076:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09e79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.690140:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451774080:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2026us (2238us total) trans 0 rc 154055/154055 00000100:00100000:2.0:1762167005.690150:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2790 00000100:00100000:0.0:1762167005.692952:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.693040:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451774208 00000100:00100000:2.0:1762167005.693058:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451774208 00000100:00100000:2.0:1762167005.693166:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2791 00000100:00100000:2.0:1762167005.693182:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451774208:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167005.693251:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 154021, mtime: 0x690888dd, atime: 0x690888d5, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:2.0:1762167005.693262:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09e80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.693279:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.693282:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.693288:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.693304:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167005.707710:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875679 is committed 00000001:00080000:1.0:1762167005.707727:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875678 is committed 00000001:00080000:1.0:1762167005.707747:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875685 is committed 00000001:00080000:1.0:1762167005.707804:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875686 is committed 00002000:00010000:3.0:1762167005.707977:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 154021 -> 155648 00010000:00010000:3.0:1762167005.707991:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.708000:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.708006:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09e80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.708010:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167005.708014:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09e80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.708019:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09e80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.708034:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09e80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.708039:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d09e80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.708133:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451774208:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14951us (15183us total) trans 17179875686 rc 0/0 00000100:00100000:3.0:1762167005.708144:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2791 00000100:00100000:0.0:1762167005.711920:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.711967:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451774336 00000100:00100000:3.0:1762167005.711977:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451774336 00000100:00100000:3.0:1762167005.712052:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2792 00000100:00100000:3.0:1762167005.712062:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451774336:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167005.712110:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 154021, mtime: 0x690888dd, atime: 0x690888db, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:3.0:1762167005.712118:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.712130:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.712133:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.712137:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.712149:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762167005.727919:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843213 is committed 00000001:00080000:2.0:1762167005.727948:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843214 is committed 00002000:00010000:3.0:1762167005.728103:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 154021 -> 155648 00010000:00010000:3.0:1762167005.728119:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.728130:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.728138:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.728144:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167005.728148:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.728157:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.728176:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.728184:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.728277:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451774336:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16213us (16360us total) trans 21474843214 rc 0/0 00000100:00100000:3.0:1762167005.728285:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2792 00000100:00100000:2.0:1762167005.730998:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.731143:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451774464 00000100:00100000:3.0:1762167005.731153:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451774464 00000100:00100000:3.0:1762167005.731222:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2793 00000100:00100000:3.0:1762167005.731232:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451774464:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762167005.731266:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.731285:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09da0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3405 expref: 21 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.731293:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.731296:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.731300:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.731334:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3405 expref: 21 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.731352:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09da0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3405 expref: 21 pid: 33892 timeout: 726 lvb_type: 1 00000100:00100000:3.0:1762167005.731367:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454413824:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.731472:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.732872:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454413824:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.732897:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.733174:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.733232:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451774592 00000100:00100000:0.0:1762167005.733239:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451774592 00010000:00010000:0.0:1762167005.733268:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09da0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3405 expref: 22 pid: 33892 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1762167005.733310:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7400 00000100:00100000:0.0:1762167005.733319:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451774592:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167005.733335:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167005.733360:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09da0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3405 expref: 22 pid: 33892 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1762167005.733373:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09da0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3405 expref: 22 pid: 33892 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1762167005.733408:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d09da0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3405 expref: 22 pid: 33892 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1762167005.733425:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.733427:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.733432:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.733443:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.733477:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167005.733532:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451774592:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 213us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.733542:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7400 00010000:00010000:3.0:1762167005.733550:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.733562:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167005.747905:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875687 is committed 00002000:00010000:0.0:1762167005.748086:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 154021 -> 155648 00002000:00010000:0.0:1762167005.748091:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:0.0:1762167005.748094:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00010000:00010000:0.0:1762167005.748107:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.748119:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.748128:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.748134:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.748138:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.748147:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.748163:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.748170:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d09e8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.748264:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451774464:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 17028us (17269us total) trans 17179875687 rc 0/0 00000100:00100000:0.0:1762167005.748277:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2793 00000100:00100000:0.0:1762167005.750796:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.750857:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451774720 00000100:00100000:3.0:1762167005.750865:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451774720 00000100:00100000:3.0:1762167005.750923:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2794 00000100:00100000:3.0:1762167005.750931:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451774720:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167005.750966:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 154021, mtime: 0x690888dd, atime: 0x690888db, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:3.0:1762167005.750974:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.750986:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.750988:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.750994:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.751007:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762167005.764116:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875688 is committed 00002000:00010000:0.0:1762167005.764249:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 154021 -> 155648 00002000:00010000:0.0:1762167005.764254:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:0.0:1762167005.764256:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00010000:00010000:0.0:1762167005.764269:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.764280:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.764289:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.764296:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167005.764301:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.764311:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.764328:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.764333:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d09e95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167005.764427:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451774720:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13491us (13658us total) trans 17179875688 rc 0/0 00000100:00100000:0.0:1762167005.764438:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2794 00000100:00100000:2.0:1762167005.767004:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.767051:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451774848 00000100:00100000:0.0:1762167005.767060:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451774848 00000100:00100000:0.0:1762167005.767132:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2795 00000100:00100000:0.0:1762167005.767143:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451774848:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762167005.767173:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.767187:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09c65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb339c expref: 20 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.767192:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.767194:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.767197:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.767224:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb339c expref: 20 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167005.767237:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09c65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb339c expref: 20 pid: 12402 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1762167005.767251:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454413952:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.767331:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.768359:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454413952:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167005.768379:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.768591:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.768671:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451774976 00000100:00100000:1.0:1762167005.768678:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451774976 00010000:00010000:1.0:1762167005.768707:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09c65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb339c expref: 21 pid: 12402 timeout: 726 lvb_type: 1 00000100:00100000:1.0:1762167005.768744:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7401 00000100:00100000:1.0:1762167005.768754:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451774976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.768796:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.768820:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09c65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb339c expref: 21 pid: 12402 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.768831:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb339c expref: 21 pid: 12402 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.768851:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09c65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb339c expref: 21 pid: 12402 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.768863:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.768866:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.768870:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.768883:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.768910:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.768935:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.768945:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.768956:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451774976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 201us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.768965:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7401 00000001:00080000:3.0:1762167005.786236:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875689 is committed 00002000:00010000:2.0:1762167005.786368:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 154021 -> 155648 00002000:00010000:2.0:1762167005.786373:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:2.0:1762167005.786376:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00010000:00010000:2.0:1762167005.786401:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.786413:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.786422:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.786429:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167005.786434:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.786442:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.786461:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.786469:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09e9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.786597:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451774848:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 19449us (19593us total) trans 17179875689 rc 0/0 00000100:00100000:2.0:1762167005.786608:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2795 00000100:00100000:3.0:1762167005.796886:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.796999:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451775232 00000100:00100000:0.0:1762167005.797010:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451775232 00000100:00100000:0.0:1762167005.797086:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19665 00000100:00100000:0.0:1762167005.797098:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56193:x1847765451775232:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167005.797159:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167005.797185:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09e5d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3452 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.797208:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.797214:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.797529:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.797543:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.797554:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167005.797611:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952751 00000004:00010000:0.0:1762167005.798059:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009f947093 reply state 0000000070d58235 transno 8589952752 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167005.798069:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167005.798172:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56193:x1847765451775232:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 1075us (1297us total) trans 8589952752 rc 0/0 00000100:00100000:0.0:1762167005.798180:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19665 00000020:00080000:0.0:1762167005.798186:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167005.800379:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167005.800388:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167005.800406:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.800415:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.800421:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.800427:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.800435:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.800497:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451775360 00010000:00010000:3.0:1762167005.800504:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00000100:00100000:2.0:1762167005.800508:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451775360 00010000:00010000:3.0:1762167005.800510:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.800516:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.800523:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d09ea3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.800561:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16620 00000100:00100000:2.0:1762167005.800570:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f549450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:56193:x1847765451775360:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.800585:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.800602:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09eaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb346e expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.800623:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 155648, mtime: 0x690888dd, atime: 0x690888d5, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:2.0:1762167005.800642:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.800644:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.800651:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09eaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb346e expref: 20 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.800663:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09eaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb346e expref: 20 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.800674:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167005.800728:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f549450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56193:x1847765451775360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 159us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.800737:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16620 00000100:00100000:2.0:1762167005.802600:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.802640:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.802684:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451775488 00000100:00100000:0.0:1762167005.802703:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451775488 00000100:00100000:3.0:1762167005.802733:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451775616 00000100:00100000:3.0:1762167005.802746:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451775616 00002000:00010000:0.0:1762167005.802818:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (154055->18446744073709551615) 00002000:00100000:0.0:1762167005.802827:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce7100 with x1847765451775488 ext(154055->18446744073709551615) 00002000:00010000:3.0:1762167005.802832:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:3.0:1762167005.802840:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5880 with x1847765451775616 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.802847:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce7100. 00002000:00010000:3.0:1762167005.802866:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce5880. 00000100:00100000:0.0:1762167005.802901:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2796 00000100:00100000:3.0:1762167005.802917:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2797 00000100:00100000:0.0:1762167005.802929:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451775488:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167005.802943:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451775616:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167005.803540:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.803546:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:3.0:1762167005.803548:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167005.803551:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00002000:00010000:3.0:1762167005.803555:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.803571:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 155648 -> 154055 00002000:00010000:0.0:1762167005.803577:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:0.0:1762167005.803581:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167005.803584:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00002000:00010000:0.0:1762167005.803587:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167005.803638:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451775616:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 699us (993us total) trans 21474843215 rc 0/0 00000100:00100000:3.0:1762167005.803648:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2797 00002000:00010000:3.0:1762167005.803654:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:3.0:1762167005.803658:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5880 with x1847765451775616 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167005.803665:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce5880. 00000100:00100000:0.0:1762167005.803666:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451775488:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 744us (1065us total) trans 17179875690 rc 0/0 00000100:00100000:0.0:1762167005.803682:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2796 00002000:00010000:0.0:1762167005.803688:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (154055->18446744073709551615) 00002000:00100000:0.0:1762167005.803692:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce7100 with x1847765451775488 ext(154055->18446744073709551615) 00002000:00010000:0.0:1762167005.803699:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce7100. 00000100:00100000:3.0:1762167005.805278:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.805369:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451775744 00000100:00100000:0.0:1762167005.805376:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451775744 00000100:00100000:0.0:1762167005.805439:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19666 00000100:00100000:0.0:1762167005.805447:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56193:x1847765451775744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.805465:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.805481:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09eb1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3475 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.805554:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09eb8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.805568:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.805579:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167005.805613:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00000004:00200000:0.0:1762167005.805617:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167005.805631:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.805659:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09eb1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3475 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.805677:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3475 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.805687:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.805690:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167005.805693:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9800, rc 0) 00000100:00100000:0.0:1762167005.805742:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56193:x1847765451775744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 297us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.805747:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19666 00000100:00100000:1.0:1762167005.808204:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.808266:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451776000 00000100:00100000:0.0:1762167005.808276:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451776000 00000100:00100000:0.0:1762167005.808339:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19667 00000100:00100000:0.0:1762167005.808350:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56193:x1847765451776000:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167005.808413:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167005.808439:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09eb8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3475 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.808459:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.808465:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.808681:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.808695:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.808704:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167005.808755:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952753 00000004:00010000:0.0:1762167005.808817:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b4355faf reply state 00000000a51da15f transno 8589952754 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167005.808825:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167005.808908:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56193:x1847765451776000:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 560us (712us total) trans 8589952754 rc 0/0 00000100:00100000:0.0:1762167005.808916:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19667 00000020:00080000:0.0:1762167005.808922:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167005.811672:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.811686:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.811693:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.811700:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.811705:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167005.811741:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167005.811785:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.811806:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167005.811809:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.811815:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.811821:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d09ebf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167005.811866:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451776128 00000100:00100000:1.0:1762167005.811876:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451776128 00000100:00100000:1.0:1762167005.811932:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16621 00000100:00100000:1.0:1762167005.811943:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56193:x1847765451776128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167005.811959:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167005.811979:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09ec6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb347c expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167005.812003:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 155648, mtime: 0x690888dd, atime: 0x690888db, ctime: 0x690888dd, blocks: 0x203 00010000:00010000:1.0:1762167005.812023:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.812026:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.812033:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb347c expref: 18 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.812048:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb347c expref: 18 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.812065:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00000100:00100000:1.0:1762167005.812124:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56193:x1847765451776128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 182us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.812132:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16621 00000100:00100000:3.0:1762167005.813966:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.814011:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.814034:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451776256 00000100:00100000:0.0:1762167005.814041:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451776256 00000100:00100000:2.0:1762167005.814072:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451776384 00000100:00100000:2.0:1762167005.814076:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451776384 00002000:00010000:0.0:1762167005.814086:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (154055->18446744073709551615) 00002000:00010000:2.0:1762167005.814091:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167005.814091:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047f800 with x1847765451776256 ext(154055->18446744073709551615) 00002000:00100000:2.0:1762167005.814095:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047d880 with x1847765451776384 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167005.814102:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee35047d880. 00002000:00010000:0.0:1762167005.814102:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047f800. 00000100:00100000:0.0:1762167005.814131:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2798 00000100:00100000:0.0:1762167005.814141:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451776256:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167005.814175:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2799 00000100:00100000:2.0:1762167005.814184:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451776384:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167005.814428:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.814434:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:2.0:1762167005.814436:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167005.814439:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00002000:00010000:2.0:1762167005.814441:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.814499:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 155648 -> 154055 00000100:00100000:2.0:1762167005.814503:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451776384:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 320us (492us total) trans 17179875691 rc 0/0 00002000:00010000:0.0:1762167005.814503:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:0.0:1762167005.814506:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167005.814508:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00002000:00010000:0.0:1762167005.814510:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167005.814511:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2799 00002000:00010000:2.0:1762167005.814515:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167005.814518:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047d880 with x1847765451776384 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167005.814522:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee35047d880. 00000100:00100000:0.0:1762167005.814530:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451776256:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 392us (573us total) trans 21474843216 rc 0/0 00000100:00100000:0.0:1762167005.814536:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2798 00002000:00010000:0.0:1762167005.814551:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (154055->18446744073709551615) 00002000:00100000:0.0:1762167005.814554:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047f800 with x1847765451776256 ext(154055->18446744073709551615) 00002000:00010000:0.0:1762167005.814559:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047f800. 00000100:00100000:3.0:1762167005.816251:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.816301:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451776512 00000100:00100000:0.0:1762167005.816309:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451776512 00000100:00100000:0.0:1762167005.816360:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19668 00000100:00100000:0.0:1762167005.816370:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56193:x1847765451776512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.816404:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.816426:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09ecd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3483 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.816522:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09ed4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.816540:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.816552:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167005.816576:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00000004:00200000:0.0:1762167005.816580:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167005.816607:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.816637:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09ecd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3483 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.816654:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3483 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.816661:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.816665:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167005.816668:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9c00, rc 0) 00000100:00100000:0.0:1762167005.816724:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56193:x1847765451776512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 354us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.816732:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19668 00000100:00100000:3.0:1762167005.818653:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.818751:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451776768 00000100:00100000:0.0:1762167005.818758:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451776768 00000100:00100000:0.0:1762167005.818839:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19669 00000100:00100000:0.0:1762167005.818849:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56193:x1847765451776768:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167005.818898:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167005.818922:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09ed4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3483 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.818951:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.818955:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.819167:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.819180:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.819189:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167005.819240:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952755 00000004:00010000:0.0:1762167005.819267:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000086db76fa reply state 00000000328e0cdd transno 8589952756 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167005.819280:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167005.819349:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56193:x1847765451776768:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 493us (693us total) trans 8589952756 rc 0/0 00000100:00100000:0.0:1762167005.819360:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19669 00000020:00080000:0.0:1762167005.819365:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167005.820178:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.820190:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.820196:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.820202:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167005.820208:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.820216:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.820227:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.820230:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167005.820233:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.820243:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09edb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.820515:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.820604:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451776896 00000100:00100000:2.0:1762167005.820610:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451776896 00000100:00100000:2.0:1762167005.820648:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16622 00000100:00100000:2.0:1762167005.820654:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56193:x1847765451776896:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.820666:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.820685:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09ee2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb348a expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.820711:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 155648, mtime: 0x690888de, atime: 0x690888da, ctime: 0x690888de, blocks: 0x203 00010000:00010000:2.0:1762167005.820730:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.820732:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.820741:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09ee2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb348a expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.820756:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09ee2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb348a expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.820787:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167005.820835:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56193:x1847765451776896:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 180us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.820841:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16622 00000100:00100000:3.0:1762167005.822473:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.822516:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.822589:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451777024 00000100:00100000:0.0:1762167005.822596:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451777024 00002000:00010000:0.0:1762167005.822632:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2072 (154055->18446744073709551615) 00002000:00100000:0.0:1762167005.822638:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047c380 with x1847765451777024 ext(154055->18446744073709551615) 00002000:00010000:0.0:1762167005.822648:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee35047c380. 00000100:00100000:0.0:1762167005.822676:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451777152 00000100:00100000:0.0:1762167005.822679:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451777152 00002000:00010000:0.0:1762167005.822693:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2069 (0->18446744073709551615) 00002000:00100000:0.0:1762167005.822696:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee245188a80 with x1847765451777152 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.822703:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee245188a80. 00000100:00100000:0.0:1762167005.822731:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2800 00000100:00100000:0.0:1762167005.822740:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451777024:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167005.822801:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2801 00000100:00100000:1.0:1762167005.822815:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451777152:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167005.823092:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.823096:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:1.0:1762167005.823099:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:1.0:1762167005.823102:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00002000:00010000:1.0:1762167005.823104:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.823119:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 155648 -> 154055 00002000:00010000:0.0:1762167005.823123:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.823125:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167005.823127:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.823128:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167005.823157:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451777152:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 347us (639us total) trans 21474843217 rc 0/0 00000100:00100000:0.0:1762167005.823159:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451777024:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 419us (692us total) trans 17179875692 rc 0/0 00000100:00100000:1.0:1762167005.823167:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2801 00002000:00010000:1.0:1762167005.823171:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2069 (0->18446744073709551615) 00000100:00100000:0.0:1762167005.823175:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2800 00002000:00100000:1.0:1762167005.823176:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee245188a80 with x1847765451777152 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167005.823182:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee245188a80. 00002000:00010000:0.0:1762167005.823182:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2072 (154055->18446744073709551615) 00002000:00100000:0.0:1762167005.823188:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047c380 with x1847765451777024 ext(154055->18446744073709551615) 00002000:00010000:0.0:1762167005.823194:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee35047c380. 00000100:00100000:3.0:1762167005.824832:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.824885:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451777280 00000100:00100000:0.0:1762167005.824893:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451777280 00000100:00100000:0.0:1762167005.824938:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19670 00000100:00100000:0.0:1762167005.824959:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56193:x1847765451777280:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.824989:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.825008:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09ee9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3491 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.825094:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09ef0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.825108:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.825119:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167005.825144:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00000004:00200000:0.0:1762167005.825148:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167005.825163:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.825186:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d09ee9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3491 expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.825203:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3491 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.825211:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.825214:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167005.825217:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9e00, rc 0) 00000100:00100000:0.0:1762167005.825267:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56193:x1847765451777280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 321us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.825276:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19670 00000100:00100000:3.0:1762167005.826933:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.827000:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451777536 00000100:00100000:0.0:1762167005.827007:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451777536 00000100:00100000:0.0:1762167005.827057:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19671 00000100:00100000:0.0:1762167005.827068:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56193:x1847765451777536:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167005.827112:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167005.827134:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d09ef0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3491 expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.827151:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.827155:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.827353:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.827366:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.827374:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167005.827439:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952757 00000004:00010000:0.0:1762167005.827466:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000688cf81e reply state 0000000054b24c2c transno 8589952758 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167005.827474:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167005.827556:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56193:x1847765451777536:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 488us (625us total) trans 8589952758 rc 0/0 00000100:00100000:0.0:1762167005.827566:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19671 00000020:00080000:0.0:1762167005.827572:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167005.828425:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.828436:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.828444:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.828450:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167005.828454:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.828462:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.828473:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.828476:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167005.828479:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.828485:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09ef7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.828841:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.828904:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451777664 00000100:00100000:2.0:1762167005.828911:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451777664 00000100:00100000:2.0:1762167005.828950:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16623 00000100:00100000:2.0:1762167005.828960:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56193:x1847765451777664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.828972:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.828988:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09efe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3498 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.829012:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 155648, mtime: 0x690888de, atime: 0x690888db, ctime: 0x690888de, blocks: 0x203 00010000:00010000:2.0:1762167005.829031:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.829034:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.829042:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09efe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3498 expref: 25 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.829056:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09efe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3498 expref: 25 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.829067:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167005.829107:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56193:x1847765451777664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 150us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.829112:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16623 00000100:00100000:3.0:1762167005.830238:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.830275:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.830340:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451777920 00000100:00100000:0.0:1762167005.830346:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451777792 00000100:00100000:1.0:1762167005.830347:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451777920 00000100:00100000:0.0:1762167005.830354:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451777792 00002000:00010000:1.0:1762167005.830383:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00010000:0.0:1762167005.830384:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (154055->18446744073709551615) 00002000:00100000:1.0:1762167005.830403:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee245189500 with x1847765451777920 ext(0->18446744073709551615) 00002000:00100000:0.0:1762167005.830406:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24518b800 with x1847765451777792 ext(154055->18446744073709551615) 00002000:00010000:1.0:1762167005.830417:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee245189500. 00002000:00010000:0.0:1762167005.830417:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24518b800. 00000100:00100000:0.0:1762167005.830448:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2802 00000100:00100000:0.0:1762167005.830458:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451777792:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167005.830466:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2803 00000100:00100000:1.0:1762167005.830478:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451777920:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167005.830745:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.830749:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:1.0:1762167005.830752:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167005.830755:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00002000:00010000:1.0:1762167005.830757:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.830781:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 155648 -> 154055 00002000:00010000:0.0:1762167005.830786:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.830789:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167005.830791:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.830794:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167005.830877:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451777920:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 399us (640us total) trans 21474843218 rc 0/0 00000100:00100000:0.0:1762167005.830878:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451777792:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 419us (599us total) trans 17179875693 rc 0/0 00000100:00100000:1.0:1762167005.830894:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2803 00002000:00010000:1.0:1762167005.830898:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00000100:00100000:0.0:1762167005.830902:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2802 00002000:00100000:1.0:1762167005.830903:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee245189500 with x1847765451777920 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167005.830908:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (154055->18446744073709551615) 00002000:00010000:1.0:1762167005.830911:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee245189500. 00002000:00100000:0.0:1762167005.830914:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24518b800 with x1847765451777792 ext(154055->18446744073709551615) 00002000:00010000:0.0:1762167005.830921:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24518b800. 00000100:00100000:3.0:1762167005.832667:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.832793:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451778048 00000100:00100000:0.0:1762167005.832801:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451778048 00000100:00100000:0.0:1762167005.832858:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19672 00000100:00100000:0.0:1762167005.832865:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56193:x1847765451778048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.832891:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.832910:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09f05 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb349f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.833008:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f0c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.833027:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.833040:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167005.833071:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00000004:00200000:0.0:1762167005.833075:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167005.833092:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f0c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.833117:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d09f05 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb349f expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.833137:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f0c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb349f expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.833146:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.833149:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167005.833152:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8e00, rc 0) 00000100:00100000:0.0:1762167005.833203:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56193:x1847765451778048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 334us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.833210:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19672 00000100:00100000:3.0:1762167005.835615:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.835674:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451778304 00000100:00100000:0.0:1762167005.835684:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451778304 00000100:00100000:0.0:1762167005.835741:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19673 00000100:00100000:0.0:1762167005.835750:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56193:x1847765451778304:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167005.835830:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167005.835855:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f0c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb349f expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.835873:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.835878:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167005.836110:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.836123:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.836133:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:0.0:1762167005.836189:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952759 00000004:00010000:0.0:1762167005.836219:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d9d387d4 reply state 0000000003c07e55 transno 8589952760 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167005.836228:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167005.836313:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56193:x1847765451778304:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 563us (705us total) trans 8589952760 rc 0/0 00000100:00100000:0.0:1762167005.836320:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19673 00000020:00080000:0.0:1762167005.836325:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167005.837472:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.837485:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.837492:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.837498:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167005.837502:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.837510:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.837523:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.837526:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167005.837531:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.837536:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d09f13 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.837951:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.838012:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451778432 00000100:00100000:2.0:1762167005.838021:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451778432 00000100:00100000:2.0:1762167005.838073:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16624 00000100:00100000:2.0:1762167005.838083:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56193:x1847765451778432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.838099:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.838117:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09f1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34a6 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167005.838139:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 155648, mtime: 0x690888de, atime: 0x690888dd, ctime: 0x690888de, blocks: 0x203 00010000:00010000:2.0:1762167005.838158:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.838161:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.838168:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09f1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34a6 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.838182:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09f1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34a6 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.838194:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167005.838240:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56193:x1847765451778432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 159us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.838247:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16624 00000100:00100000:3.0:1762167005.839620:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.839670:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451778560 00000100:00100000:2.0:1762167005.839677:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451778560 00000100:00100000:2.0:1762167005.839719:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16625 00000100:00100000:2.0:1762167005.839728:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56193:x1847765451778560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.839742:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.839756:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34ad expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.839823:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09c6c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33a3 expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.839833:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.839835:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.839840:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.839876:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33a3 expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.839890:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09c6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33a3 expref: 22 pid: 6533 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167005.839912:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454414080:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.840122:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.841327:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454414080:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.841355:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.841373:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d000, rc 0) 00000100:00100000:2.0:1762167005.841427:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56193:x1847765451778560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1699us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.841435:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16625 00000100:00100000:3.0:1762167005.841578:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.841655:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451778688 00000100:00100000:1.0:1762167005.841663:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451778688 00010000:00010000:1.0:1762167005.841685:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09c6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33a3 expref: 22 pid: 6533 timeout: 726 lvb_type: 1 00000100:00100000:1.0:1762167005.841717:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7402 00000100:00100000:1.0:1762167005.841725:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451778688:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.841737:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.841759:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09c6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33a3 expref: 22 pid: 6533 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.841795:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33a3 expref: 22 pid: 6533 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.841817:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d09c6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb33a3 expref: 22 pid: 6533 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.841836:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.841838:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.841843:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 21 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.841853:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 21 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.841884:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 21 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.841896:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454414208:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167005.841951:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.843128:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24786ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454414208:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167005.843145:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167005.843182:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451778688:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1457us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.843191:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7402 00000100:00100000:1.0:1762167005.843443:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.843532:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451778816 00000100:00100000:0.0:1762167005.843539:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451778816 00002000:00010000:0.0:1762167005.843570:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (154055->18446744073709551615) 00002000:00100000:0.0:1762167005.843575:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24786ad80 with x1847765451778816 ext(154055->18446744073709551615) 00000100:00100000:1.0:1762167005.843582:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:0.0:1762167005.843588:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24786ad80. 00000100:00100000:0.0:1762167005.843744:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451778944 00000100:00100000:0.0:1762167005.843749:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451778944 00002000:00010000:0.0:1762167005.843786:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:0.0:1762167005.843790:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247868380 with x1847765451778944 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167005.843796:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2804 00002000:00010000:0.0:1762167005.843797:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee247868380. 00000100:00100000:2.0:1762167005.843814:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451778816:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167005.843820:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2805 00000100:00100000:3.0:1762167005.843835:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451778944:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167005.844140:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.844141:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 155648 -> 154055 00002000:00010000:3.0:1762167005.844147:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:2.0:1762167005.844148:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167005.844153:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.844154:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.844159:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00002000:00010000:2.0:1762167005.844160:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167005.844164:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1762167005.844166:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167005.844213:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451778944:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 382us (634us total) trans 21474843219 rc 0/0 00000100:00100000:3.0:1762167005.844220:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2805 00002000:00010000:3.0:1762167005.844222:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:3.0:1762167005.844224:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247868380 with x1847765451778944 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167005.844228:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee247868380. 00000100:00100000:2.0:1762167005.844230:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451778816:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 406us (772us total) trans 17179875694 rc 0/0 00000100:00100000:2.0:1762167005.844241:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2804 00002000:00010000:2.0:1762167005.844246:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (154055->18446744073709551615) 00002000:00100000:2.0:1762167005.844249:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24786ad80 with x1847765451778816 ext(154055->18446744073709551615) 00002000:00010000:2.0:1762167005.844257:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24786ad80. 00000100:00100000:3.0:1762167005.845408:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.845461:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451779200 00000100:00100000:0.0:1762167005.845467:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451779200 00000100:00100000:0.0:1762167005.845510:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19674 00000100:00100000:0.0:1762167005.845521:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56193:x1847765451779200:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167005.845613:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.845629:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.845640:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:0.0:1762167005.845758:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ca87e145 reply state 0000000086240080 transno 8589952761 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167005.845802:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167005.845883:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56193:x1847765451779200:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 364us (477us total) trans 8589952761 rc 0/0 00000100:00100000:0.0:1762167005.845890:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19674 00010000:00010000:3.0:1762167005.846943:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.846954:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.846961:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.846967:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167005.846971:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.846978:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.846996:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:3.0:1762167005.846999:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167005.847002:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167005.847008:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d09f28 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167005.847270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.847324:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451779328 00000100:00100000:2.0:1762167005.847332:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451779328 00000100:00100000:2.0:1762167005.847381:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16626 00000100:00100000:2.0:1762167005.847412:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56193:x1847765451779328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167005.847426:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167005.847444:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34b4 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.847473:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3459 expref: 23 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.847482:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.847484:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.847488:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.847523:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3459 expref: 23 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167005.847537:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3459 expref: 23 pid: 33892 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167005.847552:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454414336:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.847633:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.848823:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454414336:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.848849:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.848866:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00000100:00100000:2.0:1762167005.848914:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56193:x1847765451779328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1524us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.848922:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16626 00000100:00100000:3.0:1762167005.849161:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.849232:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451779456 00000100:00100000:1.0:1762167005.849243:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451779456 00010000:00010000:1.0:1762167005.849269:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3459 expref: 23 pid: 33892 timeout: 726 lvb_type: 1 00000100:00100000:1.0:1762167005.849311:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7403 00000100:00100000:1.0:1762167005.849319:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451779456:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167005.849332:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.849353:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3459 expref: 23 pid: 33892 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.849364:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3459 expref: 23 pid: 33892 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.849383:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d09e64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3459 expref: 23 pid: 33892 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167005.849409:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.849411:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167005.849418:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.849428:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.849455:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.849467:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454414464:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167005.849527:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.851013:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.851030:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454414464:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167005.851055:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167005.851093:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451779584 00000100:00100000:3.0:1762167005.851100:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451779584 00000100:00100000:2.0:1762167005.851100:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451779456:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1779us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.851113:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7403 00000100:00100000:3.0:1762167005.851147:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16627 00000100:00100000:3.0:1762167005.851159:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56193:x1847765451779584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167005.851172:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.851184:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34bb expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.851203:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09e6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3460 expref: 29 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.851252:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.851254:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.851259:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.851285:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09e6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3460 expref: 29 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.851298:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09e6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3460 expref: 29 pid: 33892 timeout: 726 lvb_type: 1 00000100:00100000:3.0:1762167005.851306:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454414592:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.851345:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.852209:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454414592:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.852234:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.852248:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167005.852279:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56193:x1847765451779584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1125us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.852284:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16627 00000100:00100000:0.0:1762167005.852559:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.852616:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451779712 00000100:00100000:2.0:1762167005.852622:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451779712 00010000:00010000:2.0:1762167005.852645:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09e6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3460 expref: 29 pid: 33892 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167005.852680:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7404 00000100:00100000:2.0:1762167005.852688:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451779712:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.852700:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.852721:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09e6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3460 expref: 29 pid: 33892 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.852733:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09e6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3460 expref: 29 pid: 33892 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.852753:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09e6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3460 expref: 29 pid: 33892 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.852795:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.852797:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.852804:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.852815:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.852843:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.852866:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454414720:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167005.852916:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167005.853990:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.854054:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454414720:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167005.854063:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451779840 00000100:00100000:3.0:1762167005.854070:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451779840 00010000:00010000:2.0:1762167005.854071:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.854114:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451779712:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1426us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.854115:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16628 00000100:00100000:3.0:1762167005.854125:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56193:x1847765451779840:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:2.0:1762167005.854130:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7404 00010000:00010000:3.0:1762167005.854138:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167005.854150:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34c2 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.854168:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3467 expref: 23 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.854181:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.854183:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167005.854186:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.854212:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3467 expref: 23 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167005.854237:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3467 expref: 23 pid: 12402 timeout: 726 lvb_type: 1 00000100:00100000:3.0:1762167005.854249:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454414848:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167005.854297:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.855908:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454414848:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167005.855935:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167005.855951:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000100:00100000:3.0:1762167005.856064:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56193:x1847765451779840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1938us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167005.856072:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16628 00000100:00100000:0.0:1762167005.856124:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.856167:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451779968 00000100:00100000:2.0:1762167005.856179:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451779968 00010000:00010000:2.0:1762167005.856206:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3467 expref: 23 pid: 12402 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167005.856245:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7405 00000100:00100000:2.0:1762167005.856253:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451779968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.856266:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.856291:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3467 expref: 23 pid: 12402 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.856303:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3467 expref: 23 pid: 12402 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.856328:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d09e72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3467 expref: 23 pid: 12402 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167005.856351:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.856353:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.856359:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.856368:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.856408:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.856421:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454414976:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167005.856476:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.857647:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454414976:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167005.857662:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.857703:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451779968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1450us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.857714:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7405 00000100:00100000:0.0:1762167005.858191:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.858219:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167005.858245:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451780224 00000100:00100000:3.0:1762167005.858253:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451780224 00000100:00100000:0.0:1762167005.858254:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.858276:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451780096 00000100:00100000:1.0:1762167005.858282:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451780096 00000100:00100000:3.0:1762167005.858295:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451780352 00000100:00100000:3.0:1762167005.858300:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451780352 00000100:00100000:2.0:1762167005.858326:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16629 00000100:00100000:1.0:1762167005.858336:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16630 00000100:00100000:2.0:1762167005.858342:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451780224:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167005.858351:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16631 00000100:00100000:1.0:1762167005.858357:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451780096:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167005.858378:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451780352:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167005.858597:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 154055 -> 154055 00002000:00010000:1.0:1762167005.858601:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.858605:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.858606:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167005.858608:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00002000:00010000:3.0:1762167005.858610:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.858612:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167005.858614:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 227 -> 227 00002000:00010000:3.0:1762167005.858617:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.858620:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.858622:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.858624:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00002000:00010000:3.0:1762167005.858627:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167005 -> 1762167006 00002000:00010000:2.0:1762167005.858630:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167005.858631:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167005.858658:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451780096:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 307us (437us total) trans 21474843220 rc 0/0 00000100:00100000:2.0:1762167005.858671:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451780224:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 330us (477us total) trans 17179875695 rc 0/0 00000100:00100000:1.0:1762167005.858671:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16630 00000100:00100000:3.0:1762167005.858673:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451780352:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 310us (418us total) trans 21474843221 rc 0/0 00000100:00100000:2.0:1762167005.858689:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16629 00000100:00100000:3.0:1762167005.858696:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16631 00000100:00100000:1.0:1762167005.860815:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.861282:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451780608 00000100:00100000:0.0:1762167005.861292:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451780608 00000100:00100000:0.0:1762167005.861349:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7295 00000100:00100000:0.0:1762167005.861361:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358650850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56193:x1847765451780608:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762167005.861448:0:30820:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09e25 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3444 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.861506:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167005.861520:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09e4f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb344b expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.861527:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167005.861565:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09e4f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb344b expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.861582:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09e4f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb344b expref: 902 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167005.861597:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454415104:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167005.861681:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.863413:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454415104:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.863444:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167005.863849:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.864188:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451780736 00000100:00100000:2.0:1762167005.864209:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451780736 00010000:00010000:2.0:1762167005.864288:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09e4f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb344b expref: 903 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.864350:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7406 00000100:00100000:2.0:1762167005.864361:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2360:x1847765451780736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.864410:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.864421:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09e4f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb344b expref: 903 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.864445:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09e4f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb344b expref: 903 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.864481:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d09e4f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb344b expref: 903 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.864504:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:2.0:1762167005.864512:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167005.864523:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167005.864532:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167005.864574:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.864667:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2360:x1847765451780736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 306us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.864677:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7406 00010000:00010000:0.0:1762167005.864887:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167005.864901:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000040:00080000:0.0:1762167005.865477:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5377, 88 off433544 00000004:00080000:0.0:1762167005.865488:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626657724505ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.865570:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5386, 88 off434704 00000004:00080000:0.0:1762167005.865576:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626657813604ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.865631:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5387, 88 off434792 00000004:00080000:0.0:1762167005.865638:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626657874753ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.865661:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5378, 88 off433632 00000004:00080000:0.0:1762167005.865665:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626657902119ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.865744:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5388, 88 off434880 00000004:00080000:0.0:1762167005.865750:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626657986939ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.865803:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5379, 88 off433720 00000004:00080000:0.0:1762167005.865808:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626658045525ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.865835:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5380, 88 off433808 00000004:00080000:0.0:1762167005.865840:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626658076840ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.865861:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5389, 88 off434968 00000004:00080000:0.0:1762167005.865866:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626658103237ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.865899:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5390, 88 off435056 00000004:00080000:0.0:1762167005.865904:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626658141450ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.865923:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5381, 88 off433896 00000004:00080000:0.0:1762167005.865927:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626658164102ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.865962:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5391, 88 off435144 00000004:00080000:0.0:1762167005.865967:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626658204157ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.865983:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5382, 88 off433984 00000004:00080000:0.0:1762167005.865987:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626658224195ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167005.866007:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5392, 88 off435232 00000004:00080000:0.0:1762167005.866012:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626658249520ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167005.866039:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5383, 88 off434072 00000004:00080000:0.0:1762167005.866044:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626658281460ns, next at 626774750597ns, rc = 0 00000001:00080000:1.0:1762167005.882289:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952762 is committed 00000004:00080000:1.0:1762167005.882310:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3492 committed 00000004:00080000:1.0:1762167005.882326:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3505 committed 00000004:00080000:1.0:1762167005.882336:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3491 committed 00000004:00080000:1.0:1762167005.882340:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3504 committed 00000004:00080000:1.0:1762167005.882343:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3490 committed 00000004:00080000:1.0:1762167005.882347:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3503 committed 00000004:00080000:1.0:1762167005.882350:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3502 committed 00000004:00080000:1.0:1762167005.882353:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3489 committed 00000004:00080000:1.0:1762167005.882357:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3488 committed 00000004:00080000:1.0:1762167005.882360:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3501 committed 00000004:00080000:1.0:1762167005.882362:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3487 committed 00000004:00080000:1.0:1762167005.882364:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3500 committed 00000004:00080000:1.0:1762167005.882367:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3499 committed 00000004:00080000:1.0:1762167005.882369:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3486 committed 00000100:00100000:3.0:1762167005.882552:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454415360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.882625:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454415232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.882626:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.882662:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.882664:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454415872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.882690:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454415744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.882696:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.882725:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.882727:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454416384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.882753:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454416256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.882759:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.882804:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454416896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.882812:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.882833:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.882838:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454416768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.882865:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167005.882869:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454415616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.882898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.882917:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454415360 00000100:00100000:0.0:1762167005.882925:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454415360 00000100:00100000:1.0:1762167005.882962:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454415488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.882963:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454415232 00000100:00100000:0.0:1762167005.882969:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454415232 00000100:00100000:1.0:1762167005.882995:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.883007:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454416000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167005.883021:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167005.883029:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454416512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167005.883045:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.883052:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454415872 00000100:00100000:0.0:1762167005.883057:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454415872 00000100:00100000:0.0:1762167005.883074:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454415744 00000100:00100000:0.0:1762167005.883077:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454415744 00000100:00100000:0.0:1762167005.883084:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454416384 00000100:00100000:0.0:1762167005.883085:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454416384 00000100:00100000:0.0:1762167005.883097:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454416256 00000100:00100000:0.0:1762167005.883100:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454416256 00000100:00100000:3.0:1762167005.883103:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454416128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167005.883112:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454416896 00000100:00100000:0.0:1762167005.883115:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454416896 00000100:00100000:0.0:1762167005.883130:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454416768 00000100:00100000:3.0:1762167005.883132:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.883134:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454416768 00000100:00100000:3.0:1762167005.883147:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454416640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.883150:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454415616 00000100:00100000:0.0:1762167005.883154:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454415616 00000100:00100000:0.0:1762167005.883170:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454415488 00000100:00100000:3.0:1762167005.883171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167005.883173:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454415488 00000100:00100000:0.0:1762167005.883191:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454416000 00000100:00100000:0.0:1762167005.883194:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454416000 00000100:00100000:3.0:1762167005.883205:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454416512 00000100:00100000:0.0:1762167005.883207:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454416128 00000100:00100000:3.0:1762167005.883210:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454416512 00000100:00100000:0.0:1762167005.883212:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454416128 00000100:00100000:3.0:1762167005.883237:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454416640 00000100:00100000:3.0:1762167005.883241:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454416640 00000100:00100000:0.0:1762167005.883245:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16632 00000100:00100000:0.0:1762167005.883258:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454415360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.883263:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16633 00000100:00100000:3.0:1762167005.883273:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454415232:12345-0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1762167005.883465:0:30820:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000d321ed6 reply state 000000000602934d transno 8589952762 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167005.883479:0:30820:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762167005.883487:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:2.0:1762167005.883491:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167005.883500:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d09e25 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3444 expref: 890 pid: 32138 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167005.883520:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.883520:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 154055 -> 154055 00002000:00010000:3.0:1762167005.883527:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167005.883527:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.883533:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762167005.883534:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167005.883536:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167005.883539:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167005.883541:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167005.883544:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 227 -> 227 00000100:00100000:0.0:1762167005.883605:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454415360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 350us (981us total) trans 21474843222 rc 0/0 00000100:00100000:0.0:1762167005.883614:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16632 00010000:00080000:2.0:1762167005.883616:0:30820:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762167005.883632:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358650850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56193:x1847765451780608:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 22273us (22825us total) trans 8589952762 rc 0/0 00000100:00100000:0.0:1762167005.883635:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16634 00000100:00100000:2.0:1762167005.883646:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7295 00000100:00100000:0.0:1762167005.883647:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454415872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.883715:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16635 00000100:00100000:2.0:1762167005.883724:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454415744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167005.883757:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.883783:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.883787:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00002000:00010000:0.0:1762167005.883790:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.883792:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167005.883825:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454415872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (1132us total) trans 21474843223 rc 0/0 00000100:00100000:0.0:1762167005.883832:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16634 00000100:00100000:0.0:1762167005.883847:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16636 00000100:00100000:0.0:1762167005.883855:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454416384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167005.883867:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 154055 -> 154055 00002000:00010000:2.0:1762167005.883872:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167005.883874:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167005.883876:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167005.883878:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167005.883945:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 154055 -> 154055 00002000:00010000:0.0:1762167005.883949:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.883951:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167005.883953:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.883955:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167005.884077:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454416384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (1224us total) trans 17179875697 rc 0/0 00000100:00100000:0.0:1762167005.884083:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16636 00000100:00100000:0.0:1762167005.884096:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16637 00000100:00100000:0.0:1762167005.884103:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454416256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.884140:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454415744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 417us (1414us total) trans 21474843224 rc 0/0 00000100:00100000:2.0:1762167005.884148:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16635 00000100:00100000:3.0:1762167005.884164:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454415232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 890us (1499us total) trans 17179875696 rc 0/0 00000100:00100000:2.0:1762167005.884168:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16638 00000100:00100000:1.0:1762167005.884168:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875685 gen 2 00000004:00080000:1.0:1762167005.884179:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee374ab0e00, transno 17179875664 00000100:00100000:3.0:1762167005.884182:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16633 00000100:00100000:2.0:1762167005.884184:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454416896:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167005.884198:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee374ab3800, transno 17179875665 00000004:00080000:1.0:1762167005.884203:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee374ab3480, transno 17179875666 00002000:00010000:0.0:1762167005.884206:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1762167005.884207:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee374ab1180, transno 17179875667 00000100:00100000:3.0:1762167005.884211:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16639 00002000:00010000:0.0:1762167005.884213:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000004:00080000:1.0:1762167005.884215:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee374ab3100, transno 17179875668 00002000:00010000:0.0:1762167005.884218:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000004:00080000:1.0:1762167005.884221:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee374ab1500, transno 17179875669 00002000:00010000:0.0:1762167005.884223:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:3.0:1762167005.884224:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454416768:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167005.884228:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee374ab1f80, transno 17179875670 00002000:00010000:0.0:1762167005.884230:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:1.0:1762167005.884237:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4f800, transno 17179875671 00000004:00080000:1.0:1762167005.884241:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4e300, transno 17179875672 00000004:00080000:1.0:1762167005.884245:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4dc00, transno 17179875673 00000004:00080000:1.0:1762167005.884247:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4df80, transno 17179875674 00000004:00080000:1.0:1762167005.884251:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4c700, transno 17179875675 00000004:00080000:1.0:1762167005.884255:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4ed80, transno 17179875676 00000004:00080000:1.0:1762167005.884259:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4d180, transno 17179875677 00000004:00080000:1.0:1762167005.884264:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348255c00, transno 17179875679 00000100:00100000:0.0:1762167005.884268:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454416256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (1454us total) trans 17179875698 rc 0/0 00000004:00080000:1.0:1762167005.884270:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348254e00, transno 17179875680 00000004:00080000:1.0:1762167005.884276:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348256a00, transno 17179875681 00000004:00080000:1.0:1762167005.884282:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247868e00, transno 17179875682 00000100:00100000:0.0:1762167005.884287:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16637 00000004:00080000:1.0:1762167005.884288:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348257100, transno 17179875683 00000004:00080000:1.0:1762167005.884294:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348254700, transno 17179875684 00000004:00080000:1.0:1762167005.884299:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348255f80, transno 17179875685 00002000:00010000:2.0:1762167005.884305:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 154055 -> 154055 00000100:00100000:1.0:1762167005.884309:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37fcb7100 x1847765454415232/t17179875696(17179875696) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167021 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762167005.884310:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16640 00002000:00010000:2.0:1762167005.884313:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167005.884319:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.884325:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167005.884326:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454415616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167005.884331:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000004:00080000:1.0:1762167005.884332:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb7100/2, rc 0, transno 17179875696 00000100:00100000:2.0:1762167005.884367:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454416896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (1532us total) trans 17179875699 rc 0/0 00000100:00100000:2.0:1762167005.884375:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16638 00002000:00010000:3.0:1762167005.884405:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 154055 -> 154055 00000100:00100000:2.0:1762167005.884406:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16641 00002000:00010000:3.0:1762167005.884412:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167005.884415:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:2.0:1762167005.884418:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454415488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167005.884421:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167005.884427:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167005.884446:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167005.884450:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.884453:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167005.884456:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.884459:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.884464:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454416768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (1596us total) trans 17179875700 rc 0/0 00000100:00100000:1.0:1762167005.884467:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454415232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167005.884475:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16639 00000100:00100000:1.0:1762167005.884491:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843213 gen 2 00000100:00100000:3.0:1762167005.884496:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16642 00000004:00080000:1.0:1762167005.884496:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f797b80, transno 21474843207 00000100:00100000:0.0:1762167005.884507:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454415616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (1607us total) trans 21474843225 rc 0/0 00000100:00100000:3.0:1762167005.884509:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454416000:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167005.884510:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284e00, transno 21474843208 00000004:00080000:1.0:1762167005.884517:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f287800, transno 21474843209 00000004:00080000:1.0:1762167005.884523:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f286680, transno 21474843210 00000100:00100000:0.0:1762167005.884524:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16640 00000004:00080000:1.0:1762167005.884530:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f287480, transno 21474843211 00000004:00080000:1.0:1762167005.884535:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f285180, transno 21474843212 00000004:00080000:1.0:1762167005.884539:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284380, transno 21474843213 00002000:00010000:2.0:1762167005.884547:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167005.884547:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee34825ad80 x1847765454415744/t21474843224(21474843224) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167021 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762167005.884551:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16643 00002000:00010000:2.0:1762167005.884555:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.884561:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.884568:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000004:00080000:1.0:1762167005.884569:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825ad80/2, rc 0, transno 21474843224 00000100:00100000:0.0:1762167005.884572:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454416512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167005.884574:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167005.884580:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454415744:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167005.884596:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc59500/2, rc 0, transno 17179875698 00000100:00100000:1.0:1762167005.884601:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454416256:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167005.884616:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc58700/2, rc 0, transno 17179875700 00000100:00100000:1.0:1762167005.884621:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454416768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167005.884627:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454415488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 211us (1629us total) trans 21474843226 rc 0/0 00000100:00100000:2.0:1762167005.884635:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16641 00002000:00010000:3.0:1762167005.884637:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167005.884642:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167005.884645:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167005.884647:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167005.884650:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:1.0:1762167005.884655:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258380/2, rc 0, transno 21474843226 00000100:00100000:2.0:1762167005.884659:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16644 00000100:00100000:1.0:1762167005.884665:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454415488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167005.884671:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454416128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167005.884690:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454416000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (1665us total) trans 21474843227 rc 0/0 00000004:00080000:1.0:1762167005.884693:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258700/2, rc 0, transno 21474843227 00000100:00100000:3.0:1762167005.884700:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16642 00002000:00010000:0.0:1762167005.884702:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167005.884703:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454416000:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167005.884709:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.884713:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167005.884716:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167005.884718:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167005.884726:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16645 00000100:00100000:3.0:1762167005.884736:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454416640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167005.884789:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454416512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 196us (1717us total) trans 17179875701 rc 0/0 00000100:00100000:0.0:1762167005.884798:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16643 00002000:00010000:2.0:1762167005.884821:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167005.884825:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167005.884828:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167005.884831:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167005.884834:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:0.0:1762167005.884844:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc58000/2, rc 0, transno 17179875701 00000100:00100000:0.0:1762167005.884849:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454416512:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762167005.884868:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167005.884873:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454416128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (1740us total) trans 21474843228 rc 0/0 00010000:00010000:0.0:1762167005.884877:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167005.884885:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16644 00002000:00010000:3.0:1762167005.884886:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 154055 -> 154055 00010000:00010000:0.0:1762167005.884886:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00002000:00010000:3.0:1762167005.884896:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00010000:00010000:0.0:1762167005.884898:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8400 already unused, calling callback (ffffffffc2129310) 00002000:00010000:3.0:1762167005.884900:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167002 00010000:00010000:0.0:1762167005.884903:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00002000:00010000:3.0:1762167005.884905:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167005.884912:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 515 -> 515 00010000:00010000:0.0:1762167005.884913:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167005.884927:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167005.884929:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167005.884932:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167005.884936:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f44 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167005.884947:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454416640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (1776us total) trans 17179875702 rc 0/0 00000100:00100000:3.0:1762167005.884955:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16645 00000004:00080000:2.0:1762167005.884992:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc5b100/2, rc 0, transno 17179875697 00000100:00100000:2.0:1762167005.884999:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454416384:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167005.885000:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825a300/2, rc 0, transno 21474843225 00000100:00100000:3.0:1762167005.885009:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454415616:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.885018:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc5bb80/2, rc 0, transno 17179875699 00000100:00100000:2.0:1762167005.885023:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454416896:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167005.885029:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825aa00/2, rc 0, transno 21474843228 00000100:00100000:3.0:1762167005.885037:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454416128:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.885043:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee245188e00/2, rc 0, transno 21474843222 00000100:00100000:2.0:1762167005.885050:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454415360:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167005.885059:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc59880/2, rc 0, transno 17179875702 00000004:00080000:1.0:1762167005.885059:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 7 in progress, 1 in flight, 21 done 00000100:00100000:3.0:1762167005.885068:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454416640:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167005.885069:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825b480/2, rc 0, transno 21474843223 00000100:00100000:2.0:1762167005.885077:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454415872:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167005.885197:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 7 in progress, 0 in flight, 7 done 00000100:00100000:1.0:1762167005.887565:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.887611:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451780864 00000100:00100000:0.0:1762167005.887621:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451780864 00000100:00100000:1.0:1762167005.887698:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19675 00000100:00100000:1.0:1762167005.887709:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56193:x1847765451780864:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167005.887728:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167005.887747:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d09f4b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34c9 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.887828:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d09f4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c9 expref: 890 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.887841:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d09f4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c9 expref: 890 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.887856:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:1.0:1762167005.887859:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167005.887862:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a800, rc 0) 00000100:00100000:1.0:1762167005.887903:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56193:x1847765451780864:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 197us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.887910:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19675 00000100:00100000:0.0:1762167005.891654:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.891724:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451781120 00000100:00100000:2.0:1762167005.891736:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451781120 00000100:00100000:2.0:1762167005.891838:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7296 00000100:00100000:2.0:1762167005.891848:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56193:x1847765451781120:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167005.892134:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56193:x1847765451781120:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 286us (487us total) trans 8589952763 rc 0/0 00000100:00100000:2.0:1762167005.892143:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7296 00000100:00100000:3.0:1762167005.902217:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.902291:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451781248 00000100:00100000:1.0:1762167005.902303:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451781248 00000100:00100000:1.0:1762167005.902367:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19676 00000100:00100000:1.0:1762167005.902378:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56194:x1847765451781248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167005.902414:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167005.902437:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f52 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34d0 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.902516:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09f59 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902530:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09f59 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902547:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09f59 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902561:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09f60 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902567:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09f60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902572:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09f60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902677:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902685:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902689:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167005.902720:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00000004:00200000:1.0:1762167005.902723:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167005.902736:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902744:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902750:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09f59 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902754:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09f59 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902758:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09f59 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902799:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167005.902802:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09f59 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902807:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09f59 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902816:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:1.0:1762167005.902818:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167005.902821:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09f59 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902825:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09f59 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902836:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09f60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902840:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09f60 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902843:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09f60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902846:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7bc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167005.902848:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09f60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902851:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09f60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902855:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee345a77000) 00010000:00010000:1.0:1762167005.902856:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167005.902858:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09f60 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902861:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09f60 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.902884:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d0 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.902891:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d0 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.902895:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:1.0:1762167005.902896:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167005.902898:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b000, rc 0) 00000100:00100000:1.0:1762167005.902943:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56194:x1847765451781248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 569us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167005.902948:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19676 00000100:00100000:1.0:1762167005.904881:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.904931:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451781504 00000100:00100000:0.0:1762167005.904940:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451781504 00000100:00100000:0.0:1762167005.904995:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19677 00000100:00100000:0.0:1762167005.905005:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56194:x1847765451781504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.905022:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.905039:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f6e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34d7 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.905126:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.905138:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.905147:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167005.905157:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00010000:00010000:0.0:1762167005.905277:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d09f6e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d7 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.905294:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d7 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.905303:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:0.0:1762167005.905307:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762167005.905310:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:0.0:1762167005.905369:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56194:x1847765451781504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 365us (496us total) trans 8589952764 rc 0/0 00000100:00100000:0.0:1762167005.905376:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19677 00000100:00100000:2.0:1762167005.907326:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.907376:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451781760 00000100:00100000:0.0:1762167005.907384:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451781760 00000100:00100000:0.0:1762167005.907450:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19678 00000100:00100000:0.0:1762167005.907460:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56194:x1847765451781760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167005.907482:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167005.907497:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09f83 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34de expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.907577:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f8a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.907589:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167005.907599:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167005.907611:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00010000:00010000:0.0:1762167005.907720:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d09f83 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34de expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.907736:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f8a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34de expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.907744:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:0.0:1762167005.907747:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167005.907749:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8e00, rc 0) 00000100:00100000:0.0:1762167005.907830:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56194:x1847765451781760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 370us (509us total) trans 8589952765 rc 0/0 00000100:00100000:0.0:1762167005.907838:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19678 00000100:00100000:3.0:1762167005.936664:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.936737:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451781888 00000100:00100000:2.0:1762167005.936749:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451781888 00000100:00100000:2.0:1762167005.936856:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2806 00000100:00100000:2.0:1762167005.936867:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451781888:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167005.936914:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.936935:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 24 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.936944:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167005.936946:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167005.936950:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.936987:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 24 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.937002:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 24 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.937016:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454417024:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.937108:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6af00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167005.938302:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454417024:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167005.938325:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.938713:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.938860:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451782016 00000100:00100000:2.0:1762167005.938866:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451782016 00010000:00010000:2.0:1762167005.938895:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 25 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.938940:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7407 00000100:00100000:2.0:1762167005.938949:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451782016:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.938964:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.938985:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 25 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.938998:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 25 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.939020:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d09f2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34b4 expref: 25 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.939038:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.939039:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.939043:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.939053:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.939084:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.939131:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451782016:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 182us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.939139:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7407 00010000:00010000:1.0:1762167005.939181:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.939192:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.941012:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.941025:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.941031:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.941035:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.941038:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.941044:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.941055:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.941059:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d09f98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.941126:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451781888:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4257us (4466us total) trans 0 rc 154055/154055 00000100:00100000:1.0:1762167005.941137:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2806 00000100:00100000:3.0:1762167005.944189:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.944267:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451782144 00000100:00100000:1.0:1762167005.944284:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451782144 00000100:00100000:1.0:1762167005.944401:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2807 00000100:00100000:1.0:1762167005.944416:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451782144:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167005.944476:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.944501:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09eaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb346e expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.944509:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.944512:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.944517:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.944563:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09eaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb346e expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.944581:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09eaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb346e expref: 29 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167005.944599:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454417152:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167005.944722:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.946321:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167005.946407:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451782272 00000100:00100000:0.0:1762167005.946418:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451782272 00010000:00010000:0.0:1762167005.946460:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09eaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb346e expref: 30 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167005.946513:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7408 00000100:00100000:0.0:1762167005.946524:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451782272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167005.946539:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167005.946561:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09eaa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb346e expref: 30 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1762167005.946574:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09eaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb346e expref: 30 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1762167005.946599:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.946600:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167005.946606:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.946616:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167005.946636:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167005.946690:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451782272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 168us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167005.946697:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7408 00010000:00010000:1.0:1762167005.948518:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d09eaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb346e expref: 29 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167005.948539:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454417152:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167005.948563:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.948577:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.948583:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.951102:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.951118:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.951127:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.951133:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.951137:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.951144:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.951161:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.951168:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09f9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.951247:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451782144:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6832us (7061us total) trans 0 rc 154055/154055 00000100:00100000:1.0:1762167005.951257:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2807 00000100:00100000:3.0:1762167005.954435:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.954487:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451782400 00000100:00100000:1.0:1762167005.954497:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451782400 00000100:00100000:1.0:1762167005.954566:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2808 00000100:00100000:1.0:1762167005.954576:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451782400:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167005.954607:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.954625:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09ec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb347c expref: 23 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.954632:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.954633:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.954637:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.954669:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb347c expref: 23 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.954682:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb347c expref: 23 pid: 12402 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167005.954697:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454417280:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167005.954822:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.956205:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454417280:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167005.956231:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.956505:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.956600:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451782528 00000100:00100000:2.0:1762167005.956608:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451782528 00010000:00010000:2.0:1762167005.956643:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb347c expref: 24 pid: 12402 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.956685:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7409 00000100:00100000:2.0:1762167005.956694:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451782528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.956709:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.956731:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09ec6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb347c expref: 24 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.956744:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb347c expref: 24 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.956804:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09ec6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb347c expref: 24 pid: 12402 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.956819:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.956821:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.956826:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.956837:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.956863:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167005.956887:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.956898:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.956914:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451782528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 221us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.956924:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7409 00010000:00010000:1.0:1762167005.958450:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.958467:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.958489:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.958500:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7bc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.958505:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.958514:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.958530:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.958542:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fa6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.958626:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451782400:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4050us (4197us total) trans 0 rc 154055/154055 00000100:00100000:1.0:1762167005.958636:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2808 00000100:00100000:3.0:1762167005.961433:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.961499:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451782656 00000100:00100000:1.0:1762167005.961511:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451782656 00000100:00100000:1.0:1762167005.961590:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2809 00000100:00100000:1.0:1762167005.961600:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451782656:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167005.961636:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.961655:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09ee2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb348a expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.961663:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.961665:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.961669:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 4/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.961701:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09ee2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb348a expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.961714:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09ee2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb348a expref: 28 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167005.961741:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454417408:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167005.961861:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.963246:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454417408:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167005.963271:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.963605:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.963660:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451782784 00000100:00100000:2.0:1762167005.963666:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451782784 00010000:00010000:2.0:1762167005.963694:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09ee2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb348a expref: 29 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.963730:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7410 00000100:00100000:2.0:1762167005.963740:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451782784:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.963755:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.963802:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09ee2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb348a expref: 29 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.963821:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09ee2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb348a expref: 29 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.963843:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d09ee2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb348a expref: 29 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.963862:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.963865:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.963869:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.963880:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.963909:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167005.963936:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.963970:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.963976:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451782784:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 232us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.963995:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7410 00010000:00010000:1.0:1762167005.966451:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.966471:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.966481:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.966488:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.966492:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.966500:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.966522:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.966530:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.966627:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451782656:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5022us (5195us total) trans 0 rc 154055/154055 00000100:00100000:1.0:1762167005.966638:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2809 00000100:00100000:0.0:1762167005.969670:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.969717:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451782912 00000100:00100000:1.0:1762167005.969728:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451782912 00000100:00100000:1.0:1762167005.969838:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2810 00000100:00100000:1.0:1762167005.969849:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451782912:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167005.969883:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.969904:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09efe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3498 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.969912:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.969914:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.969918:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.969951:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09efe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3498 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.969970:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09efe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3498 expref: 27 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167005.970001:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454417536:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167005.970084:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167005.971699:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.971798:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451783040 00000100:00100000:2.0:1762167005.971811:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451783040 00010000:00010000:2.0:1762167005.971852:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09efe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3498 expref: 28 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.971886:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7411 00000100:00100000:1.0:1762167005.971891:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454417536:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167005.971900:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451783040:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.971918:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167005.971924:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.971956:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09efe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3498 expref: 28 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.971972:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09efe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3498 expref: 28 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.971997:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d09efe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3498 expref: 28 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.972012:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.972014:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.972019:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.972029:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.972065:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167005.972077:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.972087:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.972115:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451783040:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 218us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.972123:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7411 00010000:00010000:1.0:1762167005.973961:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.973983:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.973994:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.974001:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.974007:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.974017:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.974035:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.974042:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.974142:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451782912:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4292us (4479us total) trans 0 rc 154055/154055 00000100:00100000:1.0:1762167005.974151:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2810 00000100:00100000:3.0:1762167005.977412:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.978405:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451783168 00000100:00100000:1.0:1762167005.978419:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451783168 00000100:00100000:1.0:1762167005.978519:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2811 00000100:00100000:1.0:1762167005.978531:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451783168:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167005.978589:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.978609:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09f1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34a6 expref: 26 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.978618:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.978620:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167005.978627:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.978679:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09f1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34a6 expref: 26 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.978694:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34a6 expref: 26 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167005.978718:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454417664:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167005.978847:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167005.980808:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454417664:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167005.980837:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167005.981367:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.981479:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451783296 00000100:00100000:2.0:1762167005.981487:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451783296 00010000:00010000:2.0:1762167005.981524:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34a6 expref: 27 pid: 33894 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167005.981569:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7412 00000100:00100000:2.0:1762167005.981580:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451783296:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167005.981606:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.981639:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34a6 expref: 27 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.981652:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09f1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34a6 expref: 27 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.981675:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d09f1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34a6 expref: 27 pid: 33894 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167005.981691:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.981693:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167005.981698:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.981707:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.981737:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167005.981794:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.981805:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167005.981812:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451783296:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 231us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.981823:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7412 00010000:00010000:1.0:1762167005.984061:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.984084:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.984094:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.984106:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167005.984112:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.984122:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.984139:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.984147:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167005.984342:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765451783168:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5809us (6948us total) trans 0 rc 154055/154055 00000100:00100000:1.0:1762167005.984353:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2811 00000100:00100000:0.0:1762167005.993492:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.993596:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451783424 00000100:00100000:2.0:1762167005.993610:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451783424 00000100:00100000:2.0:1762167005.993694:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 635 00000100:00100000:2.0:1762167005.993708:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56194:x1847765451783424:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762167005.993730:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167005.993843:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d09f8a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34de expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167005.993867:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:2.0:1762167005.993874:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167005.993947:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56194:x1847765451783424:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 243us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167005.993955:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 635 00000100:00100000:3.0:1762167005.995386:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167005.995490:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451783680 00000100:00100000:2.0:1762167005.995499:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451783680 00000100:00100000:2.0:1762167005.995562:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7297 00000100:00100000:2.0:1762167005.995572:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56194:x1847765451783680:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167005.995905:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56194:x1847765451783680:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 334us (525us total) trans 8589952766 rc 0/0 00000100:00100000:2.0:1762167005.995914:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7297 00000100:00100000:3.0:1762167005.998917:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167005.999039:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451783936 00000100:00100000:1.0:1762167005.999053:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451783936 00000100:00100000:1.0:1762167005.999127:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19679 00000100:00100000:1.0:1762167005.999138:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451783936:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167005.999167:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167005.999185:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fc2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34e5 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.999304:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.999327:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d0 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.999337:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167005.999374:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d0 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167005.999402:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d0 expref: 897 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167005.999419:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454417792:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167005.999516:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.000914:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454417792:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167006.000939:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167006.001475:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.001528:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451784064 00000100:00100000:2.0:1762167006.001537:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451784064 00010000:00010000:2.0:1762167006.001570:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d0 expref: 898 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167006.001611:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7413 00000100:00100000:2.0:1762167006.001620:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765451784064:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.001634:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.001640:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d0 expref: 898 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.001657:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d0 expref: 898 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.001679:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d09f67 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d0 expref: 898 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.001695:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:2.0:1762167006.001698:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.001705:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.001716:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.001742:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.001797:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.001806:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167006.001822:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00000100:00100000:2.0:1762167006.001823:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451784064:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 201us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.001834:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7413 00010000:00010000:1.0:1762167006.001968:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09fc2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34e5 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.001985:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34e5 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.001993:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:1.0:1762167006.001996:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762167006.001998:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a600, rc 0) 00000100:00100000:1.0:1762167006.002037:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451783936:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2901us (3135us total) trans 8589952767 rc 0/0 00000100:00100000:1.0:1762167006.002044:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19679 00000100:00100000:3.0:1762167006.003556:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.003644:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451784192 00000100:00100000:1.0:1762167006.003656:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451784192 00000100:00100000:1.0:1762167006.003721:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19680 00000100:00100000:1.0:1762167006.003732:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451784192:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.003753:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.003795:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fd7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34ec expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.003879:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.003895:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34e5 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.003904:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.003936:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34e5 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.003945:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34e5 expref: 898 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:1.0:1762167006.003957:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454417920:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167006.004020:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.005621:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454417920:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167006.005650:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167006.005924:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.005966:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451784320 00000100:00100000:2.0:1762167006.005974:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451784320 00010000:00010000:2.0:1762167006.006007:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34e5 expref: 899 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167006.006046:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7414 00000100:00100000:2.0:1762167006.006055:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2361:x1847765451784320:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.006073:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.006080:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34e5 expref: 899 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.006098:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34e5 expref: 899 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.006129:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d09fc9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34e5 expref: 899 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.006145:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:2.0:1762167006.006150:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.006159:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.006167:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.006207:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.006242:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167006.006251:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451784320:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 195us (327us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167006.006255:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167006.006261:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7414 00000004:00200000:1.0:1762167006.006309:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00000004:00200000:1.0:1762167006.006314:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167006.006335:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.006363:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fd7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ec expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.006379:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ec expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.006385:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:1.0:1762167006.006388:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167006.006403:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00000100:00100000:1.0:1762167006.006441:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451784192:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2712us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.006453:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19680 00000100:00100000:3.0:1762167006.008336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.008436:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451784448 00000100:00100000:0.0:1762167006.008449:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451784448 00000100:00100000:0.0:1762167006.008508:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16646 00000100:00100000:0.0:1762167006.008520:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765451784448:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167006.008539:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.008561:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09fe5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34f3 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167006.008596:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 154055, mtime: 0x690888de, atime: 0x690888da, ctime: 0x690888de, blocks: 0x203 00010000:00010000:0.0:1762167006.008617:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.008620:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.008631:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09fe5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34f3 expref: 26 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.008649:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09fe5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34f3 expref: 26 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.008662:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9c00, rc 0) 00000100:00100000:0.0:1762167006.008723:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451784448:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 206us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.008732:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16646 00000100:00100000:3.0:1762167006.010698:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.010753:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451784576 00000100:00100000:1.0:1762167006.010789:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451784576 00002000:00100000:1.0:1762167006.010835:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x818:0x0] (16384->28671) req@ffff9ee37f8c1500 x1847765451784576/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167006.010846:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c1500 with x1847765451784576 ext(16384->28671) 00002000:00010000:1.0:1762167006.010851:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f8c1500 00000100:00100000:1.0:1762167006.010883:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2812 00000100:00100000:1.0:1762167006.010893:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451784576:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167006.011079:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451784576:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 188us (388us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1762167006.011084:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2812 00002000:00100000:1.0:1762167006.011089:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x818:0x0] (16384->28671) req@ffff9ee37f8c1500 x1847765451784576/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/12728 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167006.011094:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c1500 with x1847765451784576 ext(16384->28671) 00002000:00010000:1.0:1762167006.011097:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f8c1500 00000100:00100000:3.0:1762167006.012837:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.012888:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451784832 00000100:00100000:2.0:1762167006.012896:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451784832 00000100:00100000:2.0:1762167006.012940:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7298 00000100:00100000:2.0:1762167006.012949:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451784832:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167006.013158:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451784832:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 209us (326us total) trans 8589952768 rc 0/0 00000100:00100000:2.0:1762167006.013166:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7298 00000100:00100000:2.0:1762167006.023973:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.024123:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451785088 00000100:00100000:1.0:1762167006.024148:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451785088 00000100:00100000:1.0:1762167006.024263:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19681 00000100:00100000:1.0:1762167006.024280:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56195:x1847765451785088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.024319:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.024347:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb34fa expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.024475:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09ff3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024497:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024512:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024528:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d09ffa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024535:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d09ffa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024541:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d09ffa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024718:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a001 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024728:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a001 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024735:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a001 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167006.024805:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00010000:00010000:1.0:1762167006.024928:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024936:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09ff3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024947:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024952:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167006.024957:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024966:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09ff3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024980:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:1.0:1762167006.024983:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167006.024988:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09ff3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.024994:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d09ff3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.025011:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d09ffa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.025017:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d09ffa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.025023:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d09ffa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.025027:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ba00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167006.025030:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d09ffa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.025035:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d09ffa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.025043:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee345a77300) 00010000:00010000:1.0:1762167006.025045:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167006.025047:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d09ffa lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.025052:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d09ffa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.025103:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d09fec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34fa expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.025116:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a001 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34fa expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.025123:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:1.0:1762167006.025125:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167006.025129:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7aa00, rc 0) 00000100:00100000:1.0:1762167006.025235:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56195:x1847765451785088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 958us (1272us total) trans 8589952769 rc 0/0 00000100:00100000:1.0:1762167006.025244:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19681 00000100:00100000:3.0:1762167006.027933:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.028114:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451785216 00000100:00100000:2.0:1762167006.028129:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451785216 00000100:00100000:3.0:1762167006.028142:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.028203:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 636 00000100:00100000:2.0:1762167006.028215:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2359:x1847765451785216:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.028247:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.028281:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a001 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34fa expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.028308:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:2.0:1762167006.028314:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167006.028368:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451785472 00000100:00100000:0.0:1762167006.028374:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451785472 00000100:00100000:2.0:1762167006.028382:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2359:x1847765451785216:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 168us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.028402:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 636 00000100:00100000:0.0:1762167006.028430:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19682 00000100:00100000:0.0:1762167006.028439:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56195:x1847765451785472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.028460:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.028477:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a00f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3501 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.030138:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x648:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.030158:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.030174:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.030186:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x648:0x0]: returning size 0 00010000:00010000:0.0:1762167006.030241:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a00f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3501 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.030259:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3501 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.030267:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167006.030270:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167006.030272:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9400, rc 0) 00000100:00100000:0.0:1762167006.030329:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56195:x1847765451785472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1891us (2186us total) trans 8589952770 rc 0/0 00000100:00100000:0.0:1762167006.030336:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19682 00000100:00100000:3.0:1762167006.034573:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.034658:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451785728 00000100:00100000:0.0:1762167006.034682:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451785728 00000100:00100000:0.0:1762167006.034800:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19683 00000100:00100000:0.0:1762167006.034814:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56195:x1847765451785728:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.034852:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.034886:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a024 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3508 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.035056:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.035077:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3501 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.035087:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.035139:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3501 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.035155:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3501 expref: 902 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167006.035173:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fa98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454418048:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.035320:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.037513:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fa98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454418048:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167006.037548:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167006.037570:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167006.037681:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451785856 00000100:00100000:2.0:1762167006.037696:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451785856 00010000:00010000:2.0:1762167006.037799:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3501 expref: 903 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167006.037863:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7415 00000100:00100000:2.0:1762167006.037875:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2360:x1847765451785856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.037896:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.037904:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3501 expref: 903 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.037919:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3501 expref: 903 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.037941:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a016 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3501 expref: 903 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.037960:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:2.0:1762167006.037965:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.037973:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.037981:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.038014:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.038055:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.038067:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.038099:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x648:0x0]: returning size 0 00000100:00100000:2.0:1762167006.038107:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2360:x1847765451785856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 228us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.038121:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7415 00000004:00080000:0.0:1762167006.038674:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81a:0x0], index 0: 0 00000004:00080000:0.0:1762167006.038690:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81d:0x0], index 1: 0 00010000:00010000:0.0:1762167006.039003:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.039014:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.039027:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.039034:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.039040:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.039050:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.039070:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167006.039074:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167006.039078:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.039084:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a02b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.039199:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a024 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3508 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.039211:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167006.039214:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762167006.039217:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a024 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3508 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.039229:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:0.0:1762167006.039309:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56195:x1847765451785728:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 4498us (4747us total) trans 8589952771 rc 301/301 00000100:00100000:0.0:1762167006.039319:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19683 00000100:00100000:3.0:1762167006.040979:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.041025:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451786112 00000100:00100000:2.0:1762167006.041036:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451786112 00000100:00100000:2.0:1762167006.041088:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7299 00000100:00100000:2.0:1762167006.041095:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56195:x1847765451786112:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167006.041484:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56195:x1847765451786112:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 387us (512us total) trans 8589952772 rc 0/0 00000100:00100000:2.0:1762167006.041493:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7299 00000100:00100000:1.0:1762167006.043483:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.043567:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451786240 00000100:00100000:0.0:1762167006.043585:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451786240 00000100:00100000:0.0:1762167006.043672:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19684 00000100:00100000:0.0:1762167006.043684:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56195:x1847765451786240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.043709:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.043735:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a039 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x648:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb350f expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.043860:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a040 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x648:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.043878:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a040 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.043892:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a040 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.043932:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x648:0x0]: returning size 0 00000004:00200000:0.0:1762167006.043936:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167006.043954:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a040 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.043986:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a039 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb350f expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.044010:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a040 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb350f expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.044018:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167006.044022:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762167006.044025:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8800, rc 0) 00000100:00100000:0.0:1762167006.044096:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56195:x1847765451786240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 415us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.044101:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19684 00000100:00100000:1.0:1762167006.045933:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.046031:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.046105:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451786368 00000100:00100000:2.0:1762167006.046115:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451786368 00000100:00100000:0.0:1762167006.046115:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451786496 00000100:00100000:0.0:1762167006.046123:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451786496 00000100:00100000:2.0:1762167006.046185:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16647 00000100:00100000:2.0:1762167006.046199:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451786368:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:0.0:1762167006.046207:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16648 00010000:00010000:2.0:1762167006.046217:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762167006.046218:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451786496:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.046230:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.046237:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a047 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3516 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.046246:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a04e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb351d expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167006.046265:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:0.0:1762167006.046269:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762167006.046286:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.046286:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.046290:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.046291:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.046301:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb351d expref: 27 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.046302:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3516 expref: 23 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.046332:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3516 expref: 23 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.046333:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb351d expref: 27 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.046357:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8c00, rc 0) 00010000:00010000:2.0:1762167006.046358:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:0.0:1762167006.046605:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451786496:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 388us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.046612:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16648 00000100:00100000:2.0:1762167006.046759:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451786368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 562us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.046798:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16647 00000100:00100000:1.0:1762167006.048544:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.048602:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451786752 00000100:00100000:0.0:1762167006.048612:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451786752 00000100:00100000:0.0:1762167006.048670:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19685 00000100:00100000:0.0:1762167006.048682:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56195:x1847765451786752:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.048705:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.048725:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a055 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3524 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.049019:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a05c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.049036:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a05c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.049047:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a05c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.049062:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00010000:00010000:0.0:1762167006.049209:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a055 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3524 expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.049228:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a05c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3524 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.049237:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:0.0:1762167006.049241:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167006.049245:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:0.0:1762167006.049297:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56195:x1847765451786752:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 616us (759us total) trans 8589952773 rc 0/0 00000100:00100000:0.0:1762167006.049305:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19685 00000100:00100000:3.0:1762167006.050991:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.051021:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.051073:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451786880 00000100:00100000:0.0:1762167006.051082:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451786880 00000100:00100000:2.0:1762167006.051086:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451787008 00000100:00100000:2.0:1762167006.051091:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451787008 00000100:00100000:2.0:1762167006.051129:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16649 00000100:00100000:2.0:1762167006.051135:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451787008:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:0.0:1762167006.051152:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16650 00000100:00100000:0.0:1762167006.051163:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451786880:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167006.051184:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.051191:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a071 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.051205:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 23 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.051205:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.051209:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.051215:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a071 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.051221:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.051226:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.051231:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.051231:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a071 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.051279:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a071 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.051282:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 23 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.051296:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a071 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.051306:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 23 pid: 12400 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1762167006.051308:0:33894:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.051327:0:33894:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167006.051333:0:33894:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.051334:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454418176:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.051348:0:33894:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a071 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.051362:0:33894:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a071 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.051372:0:33894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a071 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.051430:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451786880:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 268us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.051433:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a900 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.051440:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16650 00000100:00100000:2.0:1762167006.052820:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454418176:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.052842:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167006.053089:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.053680:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451787136 00000100:00100000:2.0:1762167006.053688:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451787136 00010000:00010000:2.0:1762167006.053722:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 24 pid: 12400 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167006.053759:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7416 00000100:00100000:2.0:1762167006.053789:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451787136:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.053809:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.053833:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 24 pid: 12400 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.053846:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 24 pid: 12400 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.053869:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d08e1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb2ecc expref: 24 pid: 12400 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.053883:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.053885:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.053889:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.053899:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.053935:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.053996:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451787136:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 209us (907us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167006.054002:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.054003:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7416 00010000:00010000:3.0:1762167006.054015:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.054038:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.054047:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.054055:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.054062:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167006.054066:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.054074:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.054086:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.054093:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a06a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167006.054142:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451787008:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3007us (3119us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.054151:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16649 00000100:00100000:1.0:1762167006.095167:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.095222:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451787264 00000100:00100000:3.0:1762167006.095234:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451787264 00000100:00100000:3.0:1762167006.095294:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16651 00000100:00100000:3.0:1762167006.095304:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451787264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167006.095323:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.095346:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a078 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb352b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167006.095375:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x815:0x0] initial LVB size: 0, mtime: 0x690888de, atime: 0x690888da, ctime: 0x690888de, blocks: 0x3 00010000:00010000:3.0:1762167006.095413:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.095416:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.095426:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb352b expref: 23 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.095445:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb352b expref: 23 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.095459:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922a00, rc 0) 00000100:00100000:3.0:1762167006.095533:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451787264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 230us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.095542:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16651 00000100:00100000:1.0:1762167006.098148:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.098224:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451787392 00000100:00100000:2.0:1762167006.098235:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451787392 00000100:00100000:2.0:1762167006.098317:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2813 00000100:00100000:2.0:1762167006.098330:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451787392:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167006.098365:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a07f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.098376:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.098377:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.098381:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a07f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.098408:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a07f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.099871:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a07f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.099885:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a07f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.099894:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a07f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.099900:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.099904:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a07f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.099912:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a07f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.099928:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a07f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.099936:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a07f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.100000:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451787392:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1672us (1860us total) trans 0 rc 154055/154055 00000100:00100000:2.0:1762167006.100011:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2813 00000100:00100000:1.0:1762167006.102076:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.102125:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451787520 00000100:00100000:2.0:1762167006.102136:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451787520 00000100:00100000:2.0:1762167006.102202:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2814 00000100:00100000:2.0:1762167006.102213:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451787520:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:2.0:1762167006.102246:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.102261:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a047 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3516 expref: 23 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.102267:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.102268:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.102271:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.102299:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3516 expref: 23 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.102311:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3516 expref: 23 pid: 6532 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167006.102327:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454418304:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.102420:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a900 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.103618:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454418304:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.103635:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.103911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.103961:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451787648 00000100:00100000:2.0:1762167006.103969:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451787648 00010000:00010000:2.0:1762167006.103996:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3516 expref: 24 pid: 6532 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167006.104032:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7417 00000100:00100000:2.0:1762167006.104042:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451787648:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.104056:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.104081:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3516 expref: 24 pid: 6532 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167006.104096:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3516 expref: 24 pid: 6532 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167006.104121:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a047 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3516 expref: 24 pid: 6532 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167006.104136:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.104138:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.104142:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.104151:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.104184:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.104205:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.104215:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.104231:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451787648:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 190us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.104238:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7417 00002000:00010000:3.0:1762167006.119619:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 0 -> 154055 00002000:00010000:3.0:1762167006.119629:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 0 -> 1762167006 00002000:00010000:3.0:1762167006.119632:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 0 -> 1762167006 00002000:00010000:3.0:1762167006.119634:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 1 -> 515 00010000:00010000:3.0:1762167006.119650:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.119663:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.119672:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.119678:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167006.119682:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.119691:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.119711:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.119718:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a086 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167006.119868:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451787520:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 17652us (17795us total) trans 21474843229 rc 0/0 00000100:00100000:3.0:1762167006.119879:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2814 00000001:00080000:2.0:1762167006.119926:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843225 is committed 00000001:00080000:2.0:1762167006.119944:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843216 is committed 00000001:00080000:2.0:1762167006.119953:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843220 is committed 00000001:00080000:2.0:1762167006.119962:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843229 is committed 00000001:00080000:2.0:1762167006.119971:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843228 is committed 00000100:00100000:0.0:1762167006.121227:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.121286:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451787776 00000100:00100000:1.0:1762167006.121295:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451787776 00000100:00100000:1.0:1762167006.121355:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19686 00000100:00100000:1.0:1762167006.121365:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56195:x1847765451787776:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762167006.136460:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952773 is committed 00000100:00100000:1.0:1762167006.136539:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56195:x1847765451787776:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 15170us (15310us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.136551:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19686 00000100:00100000:1.0:1762167006.138128:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.138272:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451787904 00000100:00100000:3.0:1762167006.138282:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451787904 00000100:00100000:3.0:1762167006.138343:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16652 00000100:00100000:3.0:1762167006.138353:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451787904:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:0.0:1762167006.138427:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.138499:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451788032 00000100:00100000:1.0:1762167006.138505:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451788032 00000100:00100000:1.0:1762167006.138544:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16653 00000100:00100000:1.0:1762167006.138555:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451788032:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:3.0:1762167006.138627:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451787904:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 274us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.138635:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451788032:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.138640:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16652 00000100:00100000:1.0:1762167006.138652:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16653 00000100:00100000:1.0:1762167006.145825:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.145854:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.145893:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451788160 00000100:00100000:0.0:1762167006.145903:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451788160 00000100:00100000:3.0:1762167006.145914:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451788288 00000100:00100000:3.0:1762167006.145919:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451788288 00000100:00100000:0.0:1762167006.145967:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16654 00000100:00100000:0.0:1762167006.145978:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451788160:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167006.145988:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16655 00000100:00100000:3.0:1762167006.145999:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451788288:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167006.146029:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a094 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146030:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a08d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.146058:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.146058:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.146063:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.146063:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.146072:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146077:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a08d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.146097:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146097:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a08d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.146138:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a094 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146139:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a08d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.146154:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a094 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.146173:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146176:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a08d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.146181:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167006.146186:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146190:0:33894:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a08d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.146193:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a094 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146210:0:33894:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167006.146217:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a094 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146218:0:33894:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a08d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.146233:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a094 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146239:0:33894:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a08d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146254:0:33894:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a08d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.146262:0:33894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a08d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.146309:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451788160:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 329us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.146310:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451788288:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 307us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.146319:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16654 00000100:00100000:3.0:1762167006.146326:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16655 00000100:00100000:2.0:1762167006.147651:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.147711:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451788544 00000100:00100000:1.0:1762167006.147718:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451788544 00000100:00100000:1.0:1762167006.147788:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19687 00000100:00100000:1.0:1762167006.147796:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56195:x1847765451788544:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167006.147840:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.147864:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a040 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x648:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb350f expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.147881:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:1.0:1762167006.147891:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.147945:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x648:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.147952:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.147958:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:1.0:1762167006.148108:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000057d6ca reply state 00000000415dd164 transno 8589952774 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.148117:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167006.148195:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56195:x1847765451788544:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 399us (550us total) trans 8589952774 rc 0/0 00000100:00100000:1.0:1762167006.148202:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19687 00010000:00010000:0.0:1762167006.148928:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.148939:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.148950:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.148960:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.148964:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.148972:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.148983:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee345a77300) 00010000:00010000:0.0:1762167006.148985:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.148989:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.148995:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a09b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x648:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167006.149196:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.149230:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451788672 00000100:00100000:1.0:1762167006.149236:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451788672 00000100:00100000:1.0:1762167006.149272:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19688 00000100:00100000:1.0:1762167006.149280:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56195:x1847765451788672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.149295:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.149306:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a0a2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x648:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3532 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.149345:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3532 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.149357:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3532 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.149373:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee345a77400) 00010000:00010000:1.0:1762167006.149376:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167006.149379:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ba00, rc 0) 00000100:00100000:1.0:1762167006.149440:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56195:x1847765451788672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 161us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.149446:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19688 00000100:00100000:1.0:1762167006.150509:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.150564:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451788800 00000100:00100000:3.0:1762167006.150569:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451788800 00000100:00100000:3.0:1762167006.150603:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16656 00000100:00100000:3.0:1762167006.150609:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:56195:x1847765451788800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167006.150618:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.150630:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a0a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3539 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167006.150649:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 154055, mtime: 0x690888de, atime: 0x0, ctime: 0x690888de, blocks: 0x203 00010000:00010000:3.0:1762167006.150663:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.150665:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.150671:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a0a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3539 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.150690:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a0a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3539 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.150700:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167006.150736:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:56195:x1847765451788800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 127us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.150740:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16656 00000100:00100000:3.0:1762167006.151697:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.151746:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451788928 00000100:00100000:2.0:1762167006.151751:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451788928 00000100:00100000:2.0:1762167006.151818:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16657 00000100:00100000:2.0:1762167006.151826:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56195:x1847765451788928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.151837:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.151848:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3540 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.151868:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a04e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb351d expref: 28 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.151875:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.151877:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.151881:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 28 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.151910:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb351d expref: 28 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.151923:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a04e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb351d expref: 28 pid: 33894 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167006.151936:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454418432:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.151997:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.152936:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454418432:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167006.152973:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 28 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.153002:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d200, rc 0) 00000100:00100000:3.0:1762167006.153048:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56195:x1847765451788928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1222us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.153061:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16657 00000100:00100000:2.0:1762167006.153188:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.153226:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451789056 00000100:00100000:1.0:1762167006.153232:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451789056 00010000:00010000:1.0:1762167006.153258:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a04e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb351d expref: 28 pid: 33894 timeout: 726 lvb_type: 1 00000100:00100000:1.0:1762167006.153289:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7418 00000100:00100000:1.0:1762167006.153297:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451789056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.153308:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.153328:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a04e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb351d expref: 28 pid: 33894 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167006.153341:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb351d expref: 28 pid: 33894 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167006.153365:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a04e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb351d expref: 28 pid: 33894 timeout: 726 lvb_type: 1 00010000:00010000:1.0:1762167006.153376:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.153378:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.153382:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.153405:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.153433:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.153444:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454418560:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167006.153491:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.154382:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454418560:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167006.154410:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.154441:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451789056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1145us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.154450:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7418 00000100:00100000:3.0:1762167006.154585:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.154670:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.154798:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451789184 00000100:00100000:2.0:1762167006.154799:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451789312 00000100:00100000:1.0:1762167006.154804:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451789184 00000100:00100000:2.0:1762167006.154807:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451789312 00000100:00100000:1.0:1762167006.154877:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16658 00000100:00100000:1.0:1762167006.154887:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451789184:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:2.0:1762167006.154946:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16659 00000100:00100000:2.0:1762167006.154955:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451789312:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762167006.155124:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.155124:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 154055 -> 154055 00002000:00010000:2.0:1762167006.155129:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 0 -> 1762167005 00002000:00010000:1.0:1762167006.155129:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167006 -> 1762167005 00002000:00010000:2.0:1762167006.155132:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 0 -> 1762167005 00002000:00010000:1.0:1762167006.155132:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 0 -> 1762167005 00002000:00010000:2.0:1762167006.155135:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 0 -> 1762167006 00002000:00010000:1.0:1762167006.155135:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.155138:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1762167006.155138:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167006.155172:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451789312:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 217us (500us total) trans 17179875703 rc 0/0 00000100:00100000:1.0:1762167006.155172:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451789184:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 286us (588us total) trans 21474843230 rc 0/0 00000100:00100000:2.0:1762167006.155178:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16659 00000100:00100000:1.0:1762167006.155186:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16658 00000100:00100000:0.0:1762167006.156288:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.156335:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451789568 00000100:00100000:1.0:1762167006.156342:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451789568 00000100:00100000:1.0:1762167006.156386:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19689 00000100:00100000:1.0:1762167006.156408:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56195:x1847765451789568:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:1.0:1762167006.156463:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a0b7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x648:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.156479:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.156488:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.156507:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.156511:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a0b7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.156515:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a0b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.156519:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7aa00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167006.156521:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a0b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.156526:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a0b7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.156533:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee345a77400) 00010000:00010000:1.0:1762167006.156536:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762167006.156539:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a0b7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x648:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.156543:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a0b7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x648:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167006.156593:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56195:x1847765451789568:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 185us (306us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762167006.156600:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19689 00000100:00100000:0.0:1762167006.157866:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.157916:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451789824 00000100:00100000:1.0:1762167006.157923:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451789824 00000100:00100000:1.0:1762167006.157974:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19690 00000100:00100000:1.0:1762167006.157982:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56195:x1847765451789824:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167006.158030:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.158056:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d09fde lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ec expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.158070:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:1.0:1762167006.158073:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.158107:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.158117:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167006.158123:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00010000:1.0:1762167006.158249:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000acb43240 reply state 00000000cc239f37 transno 8589952775 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:1.0:1762167006.158263:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167006.158345:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56195:x1847765451789824:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 362us (485us total) trans 8589952775 rc 0/0 00000100:00100000:1.0:1762167006.158353:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19690 00010000:00010000:0.0:1762167006.159224:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.159235:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.159241:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.159248:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.159252:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.159264:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.159277:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:0.0:1762167006.159280:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.159284:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.159289:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a0be lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167006.159685:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.159742:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451789952 00000100:00100000:1.0:1762167006.159751:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451789952 00000100:00100000:1.0:1762167006.159841:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16660 00000100:00100000:1.0:1762167006.159849:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56195:x1847765451789952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.159867:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.159880:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3547 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.159902:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09fe5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34f3 expref: 29 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.159908:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.159910:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.159913:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.159938:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09fe5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34f3 expref: 29 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.159947:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09fe5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34f3 expref: 29 pid: 33894 timeout: 726 lvb_type: 1 00000100:00100000:1.0:1762167006.159960:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454418688:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167006.160018:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.161253:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24786a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454418688:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167006.161256:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167006.161289:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.161306:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a600, rc 0) 00000100:00100000:1.0:1762167006.161357:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56195:x1847765451789952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1508us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.161365:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16660 00000100:00100000:2.0:1762167006.161415:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451790080 00000100:00100000:2.0:1762167006.161426:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451790080 00010000:00010000:2.0:1762167006.161457:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09fe5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34f3 expref: 29 pid: 33894 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167006.161499:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7419 00000100:00100000:2.0:1762167006.161509:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451790080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.161522:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.161546:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09fe5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34f3 expref: 29 pid: 33894 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167006.161558:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09fe5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34f3 expref: 29 pid: 33894 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167006.161578:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d09fe5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34f3 expref: 29 pid: 33894 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167006.161591:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.161592:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.161597:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.161606:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.161637:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.161651:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454418816:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167006.161710:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a300 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.162854:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454418816:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167006.162871:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167006.162902:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.162918:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451790080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1409us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.162939:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7419 00000100:00100000:3.0:1762167006.162955:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451790208 00000100:00100000:3.0:1762167006.162962:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451790208 00000100:00100000:2.0:1762167006.163076:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16661 00000100:00100000:2.0:1762167006.163087:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56195:x1847765451790208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.163101:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.163117:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb354e expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.163141:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a078 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb352b expref: 18 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.163150:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.163153:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.163157:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 18 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.163182:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb352b expref: 18 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.163194:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a078 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb352b expref: 18 pid: 6532 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167006.163209:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454418944:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.163254:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a300 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.164153:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454418944:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.164172:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 18 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.164186:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d400, rc 0) 00000100:00100000:2.0:1762167006.164226:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56195:x1847765451790208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1142us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.164234:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16661 00000100:00100000:3.0:1762167006.164503:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.164537:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451790336 00000100:00100000:2.0:1762167006.164543:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451790336 00010000:00010000:2.0:1762167006.164566:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a078 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb352b expref: 18 pid: 6532 timeout: 726 lvb_type: 1 00000100:00100000:2.0:1762167006.164597:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7420 00000100:00100000:2.0:1762167006.164605:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451790336:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.164614:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.164630:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a078 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb352b expref: 18 pid: 6532 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167006.164638:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a078 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb352b expref: 18 pid: 6532 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167006.164656:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a078 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb352b expref: 18 pid: 6532 timeout: 726 lvb_type: 1 00010000:00010000:2.0:1762167006.164665:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.164666:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.164669:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 17 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.164675:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 17 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.164691:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 17 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.164698:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454419072:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167006.164739:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a300 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.165642:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454419072:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167006.165652:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.165683:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451790336:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1079us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.165691:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7420 00000100:00100000:1.0:1762167006.166185:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.166229:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451790592 00000100:00100000:2.0:1762167006.166235:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451790592 00000100:00100000:2.0:1762167006.166275:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16662 00000100:00100000:2.0:1762167006.166284:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451790592:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:0.0:1762167006.166356:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.166384:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451790464 00000100:00100000:3.0:1762167006.166401:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451790464 00000100:00100000:3.0:1762167006.166515:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16663 00002000:00010000:2.0:1762167006.166522:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167006.166532:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451790464:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762167006.166534:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167006 -> 1762167005 00002000:00010000:2.0:1762167006.166543:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167002 -> 1762167005 00002000:00010000:2.0:1762167006.166546:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.166548:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167006.166589:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451790592:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 306us (405us total) trans 21474843231 rc 0/0 00000100:00100000:2.0:1762167006.166599:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16662 00002000:00010000:3.0:1762167006.166656:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb size from disk: 154055 -> 154055 00002000:00010000:3.0:1762167006.166661:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb mtime from disk: 1762167006 -> 1762167005 00002000:00010000:3.0:1762167006.166663:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb atime from disk: 1762167002 -> 1762167005 00002000:00010000:3.0:1762167006.166666:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.166668:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x818:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167006.166708:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451790464:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 184us (353us total) trans 17179875704 rc 0/0 00000100:00100000:3.0:1762167006.166759:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16663 00000100:00100000:0.0:1762167006.167907:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.167981:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451790848 00000100:00100000:2.0:1762167006.167987:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451790848 00000100:00100000:2.0:1762167006.168033:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7300 00000100:00100000:2.0:1762167006.168041:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358650c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56195:x1847765451790848:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167006.168112:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a05c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3524 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.168146:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.168159:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d09f4b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c9 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.168166:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d7 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.168174:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.168200:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d7 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.168213:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d7 expref: 895 pid: 30818 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167006.168227:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454419200:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.168303:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d09f4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c9 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.168324:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d09f4b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c9 expref: 895 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167006.168334:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454419328:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.168359:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a300 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.169532:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454419200:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.169545:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454419328:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.169563:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167006.169871:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.169907:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.169949:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451790976 00000100:00100000:2.0:1762167006.169956:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451790976 00010000:00010000:2.0:1762167006.169982:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d09f4b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c9 expref: 896 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167006.170026:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7421 00000100:00100000:3.0:1762167006.170029:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451791232 00000100:00100000:3.0:1762167006.170036:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451791232 00000100:00100000:2.0:1762167006.170037:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451790976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.170052:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.170060:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d09f4b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c9 expref: 897 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:3.0:1762167006.170074:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7301 00010000:00010000:2.0:1762167006.170074:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d09f4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c9 expref: 897 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:3.0:1762167006.170089:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:49238:x1847765451791232:12345-192.168.203.35@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1762167006.170098:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d09f4b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c9 expref: 897 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.170115:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:2.0:1762167006.170121:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.170128:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.170134:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.170183:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451790976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 148us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.170190:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7421 00000100:00100000:3.0:1762167006.170269:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:49238:x1847765451791232:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 185us (399us total) trans 8589952776 rc 0/0 00000100:00100000:3.0:1762167006.170275:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7301 00000100:00100000:1.0:1762167006.172062:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.172106:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451791360 00000100:00100000:2.0:1762167006.172114:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451791360 00010000:00010000:2.0:1762167006.172144:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d7 expref: 896 pid: 30818 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167006.172181:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7422 00000100:00100000:2.0:1762167006.172192:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3456e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451791360:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.172205:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.172210:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d7 expref: 896 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.172223:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d7 expref: 896 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.172242:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d09f75 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34d7 expref: 896 pid: 30818 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.172257:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:2.0:1762167006.172261:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.172270:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.172277:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.172308:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.172355:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3456e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451791360:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (298us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167006.172356:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167006.172369:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7422 00010000:00010000:0.0:1762167006.172370:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.172408:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.172421:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a0a2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3532 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.172429:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 4/0,1 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.172465:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3532 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.172479:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a0a2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3532 expref: 894 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1762167006.172493:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454419456:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.172556:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.173895:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454419456:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.173918:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167006.173977:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.174015:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451791488 00000100:00100000:2.0:1762167006.174021:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451791488 00010000:00010000:2.0:1762167006.174045:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a0a2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3532 expref: 895 pid: 32138 timeout: 726 lvb_type: 0 00000100:00100000:2.0:1762167006.174080:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7423 00000100:00100000:2.0:1762167006.174091:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451791488:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.174102:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.174110:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a0a2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3532 expref: 895 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.174120:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a0a2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3532 expref: 895 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.174138:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a0a2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x648:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3532 expref: 895 pid: 32138 timeout: 726 lvb_type: 0 00010000:00010000:2.0:1762167006.174152:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee345a77400) 00010000:00010000:2.0:1762167006.174156:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 3/0,1 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.174164:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.174170:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.174192:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.174219:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.174227:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167006.174230:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451791488:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 141us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.174244:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7423 00000100:00100000:0.0:1762167006.174722:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454419584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.174796:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.174822:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.174830:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454419584 00000100:00100000:2.0:1762167006.174836:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454419584 00000100:00080000:0.0:1762167006.174879:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762167006.174888:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:2.0:1762167006.174898:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454419584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.174958:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454419584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 64us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.174964:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1762167006.174983:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843228 gen 2 00000004:00080000:0.0:1762167006.174990:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee245188e00, transno 21474843222 00000004:00080000:0.0:1762167006.175002:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825b480, transno 21474843223 00000004:00080000:0.0:1762167006.175004:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825ad80, transno 21474843224 00000004:00080000:0.0:1762167006.175007:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825a300, transno 21474843225 00000004:00080000:0.0:1762167006.175010:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258380, transno 21474843226 00000004:00080000:0.0:1762167006.175013:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258700, transno 21474843227 00000004:00080000:0.0:1762167006.175015:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825aa00, transno 21474843228 00000100:00100000:0.0:1762167006.175021:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454419584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.175070:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454419712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.175097:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.175122:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.175150:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454419712 00000004:00080000:2.0:1762167006.175155:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 7 done 00000100:00100000:3.0:1762167006.175156:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454419712 00000100:00100000:3.0:1762167006.175199:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1762167006.175209:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454419712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1762167006.175260:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762167006.175275:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454419712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.175282:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1762167006.175311:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454419712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.175356:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454419840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.175381:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.175412:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.175447:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454419840 00000100:00100000:3.0:1762167006.175450:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454419840 00000100:00100000:3.0:1762167006.175480:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1762167006.175487:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454419840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.175545:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454419840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.175551:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1762167006.175615:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454419840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.175651:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454419968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.175675:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.175699:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.175747:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454419968 00000100:00100000:3.0:1762167006.175752:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454419968 00000100:00100000:3.0:1762167006.175802:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1762167006.175809:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454419968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.175863:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454419968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 55us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.175869:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1762167006.175978:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454419968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.176015:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.176035:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.176060:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.176070:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454420096 00000100:00100000:3.0:1762167006.176074:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454420096 00000100:00100000:3.0:1762167006.176103:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1762167006.176110:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454420096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.176161:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454420096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 51us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.176167:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1762167006.176191:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.176220:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.176243:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.176262:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.176274:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454420224 00000100:00100000:3.0:1762167006.176279:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454420224 00000100:00100000:3.0:1762167006.176307:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1762167006.176314:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454420224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.176381:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454420224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 64us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.176398:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1762167006.176464:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.176495:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.176516:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.176534:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.176547:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454420352 00000100:00100000:3.0:1762167006.176552:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454420352 00000100:00100000:3.0:1762167006.176584:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1762167006.176591:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454420352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.176642:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454420352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.176649:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:2.0:1762167006.176686:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.176718:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.176744:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.176785:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.176807:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454420480 00000100:00100000:3.0:1762167006.176813:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454420480 00000100:00100000:3.0:1762167006.176837:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1762167006.176844:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454420480:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.176892:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454420480:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 48us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.176898:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1762167006.176924:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.176959:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.176982:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.177001:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.177013:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454420608 00000100:00100000:3.0:1762167006.177018:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454420608 00000100:00100000:3.0:1762167006.177044:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1762167006.177051:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454420608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.177101:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454420608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 50us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.177109:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1762167006.177120:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.177155:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.177178:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.177197:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.177208:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454420736 00000100:00100000:3.0:1762167006.177212:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454420736 00000100:00100000:3.0:1762167006.177238:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1762167006.177244:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454420736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.177299:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454420736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.177309:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1762167006.177315:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.177352:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.177374:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.177405:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.177420:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454420864 00000100:00100000:3.0:1762167006.177425:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454420864 00000100:00100000:3.0:1762167006.177452:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1762167006.177458:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454420864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.177510:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454420864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 51us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.177518:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1762167006.177522:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.177553:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.177572:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.177590:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.177599:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454420992 00000100:00100000:3.0:1762167006.177603:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454420992 00000100:00100000:3.0:1762167006.177628:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1762167006.177633:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454420992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.177680:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454420992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 46us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.177686:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1762167006.177700:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454420992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.177735:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.177756:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167006.177793:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454421120 00000100:00100000:3.0:1762167006.177798:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454421120 00000100:00100000:2.0:1762167006.177801:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.177825:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1762167006.177832:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454421120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.177879:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454421120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 47us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.177886:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1762167006.177897:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.177921:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.177937:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.177956:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.177963:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454421248 00000100:00100000:3.0:1762167006.177967:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454421248 00000100:00100000:3.0:1762167006.177989:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1762167006.177996:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454421248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.178040:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454421248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 45us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.178047:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1762167006.178052:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.178076:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.178090:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.178103:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.178117:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454421376 00000100:00100000:3.0:1762167006.178121:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454421376 00000100:00100000:3.0:1762167006.178147:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1762167006.178154:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454421376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.178202:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454421376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.178209:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1762167006.178218:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.178243:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.178257:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.178270:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.178285:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454421504 00000100:00100000:3.0:1762167006.178290:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454421504 00000100:00100000:3.0:1762167006.178316:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1762167006.178323:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454421504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.178371:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454421504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 48us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.178377:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1762167006.178400:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421504:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1762167006.178724:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].48, 912 off61536 00000001:00080000:2.0:1762167006.178738:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952777 00000100:00100000:2.0:1762167006.178835:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.178855:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.178874:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.178904:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454421632 00000100:00100000:3.0:1762167006.178909:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454421632 00000100:00100000:3.0:1762167006.178942:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1762167006.178948:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454421632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.179240:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454421632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 291us (382us total) trans 21474843232 rc 0/0 00000100:00100000:3.0:1762167006.179247:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1762167006.179281:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.179309:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f797b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.179334:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.179357:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.179834:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454421760 00000100:00100000:3.0:1762167006.179840:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454421760 00000100:00100000:3.0:1762167006.179873:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1762167006.179880:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:30820:x1847765454421760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.180060:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:30820:x1847765454421760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 179us (723us total) trans 17179875705 rc 0/0 00000100:00100000:3.0:1762167006.180067:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1762167006.180100:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f797b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454421760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762167006.180187:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952778 00010000:00010000:2.0:1762167006.180216:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180226:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180235:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180241:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.180246:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180253:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180269:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee345a77400) 00010000:00010000:2.0:1762167006.180272:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167006.180277:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 2/0,0 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180283:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a0da lrc: 0/0,0 mode: --/EX res: [0x200000404:0x648:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180311:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180316:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180322:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180326:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.180329:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180334:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180341:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:2.0:1762167006.180343:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167006.180346:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180351:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a0d3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.180360:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:2.0:1762167006.180363:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167006.180370:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a05c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3524 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.180481:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358650c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56195:x1847765451790848:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 12439us (12575us total) trans 8589952779 rc 0/0 00000100:00100000:2.0:1762167006.180490:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7300 00000020:00080000:2.0:1762167006.180495:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762167006.182132:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.182184:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451791616 00000100:00100000:0.0:1762167006.182193:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451791616 00000100:00100000:0.0:1762167006.182255:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19691 00000100:00100000:0.0:1762167006.182266:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56195:x1847765451791616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.182286:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.182306:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a0e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3555 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.182374:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a0e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3555 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.182399:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a0e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3555 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.182421:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.182423:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167006.182427:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9a00, rc 0) 00000100:00100000:0.0:1762167006.182478:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56195:x1847765451791616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 215us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.182485:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19691 00000100:00100000:3.0:1762167006.185072:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.185143:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451791872 00000100:00100000:2.0:1762167006.185153:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451791872 00000100:00100000:2.0:1762167006.185208:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7302 00000100:00100000:2.0:1762167006.185219:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56195:x1847765451791872:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167006.185478:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56195:x1847765451791872:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 260us (413us total) trans 8589952780 rc 0/0 00000100:00100000:2.0:1762167006.185486:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7302 00000100:00100000:1.0:1762167006.187027:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.187100:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451792128 00000100:00100000:2.0:1762167006.187106:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451792128 00000100:00100000:2.0:1762167006.187153:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7303 00000100:00100000:2.0:1762167006.187162:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56195:x1847765451792128:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762167006.187446:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x648:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762167006.187568:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x648:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.187586:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.187598:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.187607:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.187613:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.187619:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.187643:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762167006.187756:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56195:x1847765451792128:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 592us (730us total) trans 8589952781 rc 0/0 00000100:00100000:2.0:1762167006.187810:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7303 00010000:00010000:1.0:1762167006.187823:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167006.187839:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.187863:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167006.187869:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.187883:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x648:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.187912:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x648:0x0].0x0 (ffff9ee2429d0300) 00010000:00010000:1.0:1762167006.187916:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762167006.187922:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x648:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.187929:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a0e8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x648:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.187956:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167006.187958:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167006.187960:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167006.198632:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.198702:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451792256 00000100:00100000:0.0:1762167006.198718:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451792256 00000100:00100000:0.0:1762167006.198791:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19692 00000100:00100000:0.0:1762167006.198801:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56196:x1847765451792256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.198824:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.198844:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a0ef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb355c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.198912:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a0f6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.198926:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.198936:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.198950:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a0fd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.198957:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a0fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.198963:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a0fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199082:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199091:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199096:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167006.199124:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00000004:00200000:0.0:1762167006.199127:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167006.199141:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199152:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199160:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199166:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a0f6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199172:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a0f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199178:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.199181:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a0f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199188:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a0f6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199198:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167006.199200:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.199203:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a0f6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199207:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a0f6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199217:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a0fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199221:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a0fd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199225:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a0fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199227:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.199229:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a0fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199232:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a0fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199235:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167006.199236:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.199238:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a0fd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199240:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a0fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.199263:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a0ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb355c expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.199275:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb355c expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.199282:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.199284:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167006.199286:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9400, rc 0) 00000100:00100000:0.0:1762167006.199356:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56196:x1847765451792256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 556us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.199364:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19692 00000100:00100000:3.0:1762167006.200900:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.200946:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451792512 00000100:00100000:0.0:1762167006.200955:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451792512 00000100:00100000:0.0:1762167006.200997:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19693 00000100:00100000:0.0:1762167006.201006:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56196:x1847765451792512:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.201021:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.201033:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a10b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3563 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.201102:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a112 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.201113:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a112 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.201122:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a112 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167006.201132:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00010000:00010000:0.0:1762167006.201238:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a10b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3563 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.201253:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a112 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3563 expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.201261:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.201264:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762167006.201267:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9c00, rc 0) 00000100:00100000:0.0:1762167006.201306:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56196:x1847765451792512:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 301us (410us total) trans 8589952782 rc 0/0 00000100:00100000:0.0:1762167006.201313:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19693 00000100:00100000:1.0:1762167006.202665:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.202716:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451792768 00000100:00100000:0.0:1762167006.202723:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451792768 00000100:00100000:0.0:1762167006.202788:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19694 00000100:00100000:0.0:1762167006.202800:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56196:x1847765451792768:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.202819:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.202832:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a120 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb356a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.202905:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a127 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.202917:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a127 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.202926:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a127 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167006.202935:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00010000:00010000:0.0:1762167006.203011:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a120 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb356a expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.203024:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a127 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb356a expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.203029:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.203031:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167006.203033:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8a00, rc 0) 00000100:00100000:0.0:1762167006.203070:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56196:x1847765451792768:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 275us (414us total) trans 8589952783 rc 0/0 00000100:00100000:0.0:1762167006.203075:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19694 00000100:00100000:1.0:1762167006.228562:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.228599:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451792896 00000100:00100000:3.0:1762167006.228609:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451792896 00000100:00100000:3.0:1762167006.228653:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16664 00000100:00100000:3.0:1762167006.228672:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451792896:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167006.228691:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.228711:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a135 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3571 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167006.228734:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 154055, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888de, blocks: 0xe3 00010000:00010000:3.0:1762167006.228752:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.228755:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.228796:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3571 expref: 19 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.228814:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3571 expref: 19 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.228824:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:3.0:1762167006.228869:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451792896:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 203us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.228877:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16664 00000100:00100000:3.0:1762167006.230041:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.230096:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451793024 00000100:00100000:2.0:1762167006.230103:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451793024 00000100:00100000:2.0:1762167006.230158:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2815 00000100:00100000:2.0:1762167006.230169:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451793024:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167006.230195:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a13c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.230207:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.230209:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.230212:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a13c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.230224:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a13c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.231987:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a13c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.232001:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a13c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.232010:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a13c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.232017:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.232021:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a13c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.232030:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a13c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.232048:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a13c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.232055:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a13c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.232138:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451793024:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1966us (2093us total) trans 0 rc 154055/154055 00000100:00100000:2.0:1762167006.232150:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2815 00000100:00100000:1.0:1762167006.234434:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.234514:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451793152 00000100:00100000:2.0:1762167006.234525:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451793152 00000100:00100000:2.0:1762167006.234602:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2816 00000100:00100000:2.0:1762167006.234613:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451793152:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:2.0:1762167006.234674:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 154055, mtime: 0x690888de, atime: 0x690888d5, ctime: 0x690888de, blocks: 0x203 00010000:00010000:2.0:1762167006.234683:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a143 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.234697:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.234699:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.234705:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a143 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.234722:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a143 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.236309:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a143 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.236322:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a143 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.236331:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a143 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.236342:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.236347:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a143 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.236355:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a143 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.236370:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a143 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.236544:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a143 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.236618:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451793152:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2006us (2191us total) trans 0 rc 154055/154055 00000100:00100000:2.0:1762167006.236628:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2816 00000100:00100000:1.0:1762167006.238998:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.239047:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451793280 00000100:00100000:2.0:1762167006.239058:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451793280 00000100:00100000:2.0:1762167006.239137:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2817 00000100:00100000:2.0:1762167006.239149:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451793280:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:2.0:1762167006.239204:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 154055, mtime: 0x690888de, atime: 0x690888db, ctime: 0x690888de, blocks: 0x203 00010000:00010000:2.0:1762167006.239212:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a14a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.239225:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.239228:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.239235:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a14a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.239249:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a14a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.241245:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a14a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.241261:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a14a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.241270:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a14a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.241276:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.241281:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a14a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.241289:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a14a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.241308:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a14a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.241315:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a14a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.241406:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451793280:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2257us (2415us total) trans 0 rc 154055/154055 00000100:00100000:2.0:1762167006.241423:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2817 00000100:00100000:3.0:1762167006.243576:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.243664:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451793408 00000100:00100000:2.0:1762167006.243673:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451793408 00000100:00100000:2.0:1762167006.243746:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2818 00000100:00100000:2.0:1762167006.243757:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451793408:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167006.243820:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.243838:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.243847:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.243849:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.243853:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.243889:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.243903:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 29 pid: 33894 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.243918:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f797800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454421888:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.243998:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.244933:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f797800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454421888:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.244958:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167006.245267:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.245309:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451793536 00000100:00100000:2.0:1762167006.245315:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451793536 00010000:00010000:2.0:1762167006.245339:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 30 pid: 33894 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.245372:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7424 00000100:00100000:2.0:1762167006.245381:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451793536:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.245402:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.245426:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 30 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.245438:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 30 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.245457:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a0c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3547 expref: 30 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.245470:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.245472:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.245476:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.245484:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.245507:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167006.245536:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.245548:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.245550:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451793536:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 169us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.245567:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7424 00010000:00010000:2.0:1762167006.246841:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.246857:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.246865:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.246871:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.246875:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.246883:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.246896:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.246903:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a151 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.246972:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451793408:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3215us (3401us total) trans 0 rc 154055/154055 00000100:00100000:2.0:1762167006.246983:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2818 00000100:00100000:1.0:1762167006.249170:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.249217:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451793664 00000100:00100000:2.0:1762167006.249226:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451793664 00000100:00100000:2.0:1762167006.249302:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2819 00000100:00100000:2.0:1762167006.249324:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451793664:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:2.0:1762167006.249371:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 154055, mtime: 0x690888de, atime: 0x690888db, ctime: 0x690888de, blocks: 0x203 00010000:00010000:2.0:1762167006.249380:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a158 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.249416:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.249418:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.249423:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a158 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.249437:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a158 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.250916:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a158 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.250932:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a158 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.250942:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a158 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.250949:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.250953:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a158 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.250963:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a158 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.250978:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a158 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.250986:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a158 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.251055:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451793664:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1742us (1889us total) trans 0 rc 154055/154055 00000100:00100000:2.0:1762167006.251064:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2819 00000100:00100000:3.0:1762167006.253274:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.253336:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451793792 00000100:00100000:2.0:1762167006.253346:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451793792 00000100:00100000:2.0:1762167006.253431:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2820 00000100:00100000:2.0:1762167006.253443:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451793792:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:2.0:1762167006.253514:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 154055, mtime: 0x690888de, atime: 0x690888dd, ctime: 0x690888de, blocks: 0x203 00010000:00010000:2.0:1762167006.253524:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a15f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.253546:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.253548:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.253556:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a15f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.253572:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a15f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.255651:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a15f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.255679:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a15f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.255688:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a15f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.255695:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.255701:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a15f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.255710:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a15f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.255734:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a15f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.255739:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a15f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.255861:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451793792:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2416us (2591us total) trans 0 rc 154055/154055 00000100:00100000:2.0:1762167006.255871:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2820 00000100:00100000:1.0:1762167006.258862:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.258911:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451793920 00000100:00100000:2.0:1762167006.258924:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451793920 00000100:00100000:2.0:1762167006.259011:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2821 00000100:00100000:2.0:1762167006.259021:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451793920:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167006.259059:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.259076:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a0a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3539 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.259082:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.259084:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.259087:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.259117:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a0a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3539 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.259129:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a0a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3539 expref: 19 pid: 6532 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.259145:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f797800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454422016:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.259244:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.261019:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f797800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454422016:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.261061:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167006.261132:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.261181:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451794048 00000100:00100000:2.0:1762167006.261189:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451794048 00010000:00010000:2.0:1762167006.261229:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a0a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3539 expref: 20 pid: 6532 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.261276:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7425 00000100:00100000:2.0:1762167006.261287:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451794048:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.261306:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.261342:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a0a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3539 expref: 20 pid: 6532 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.261356:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a0a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3539 expref: 20 pid: 6532 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.261403:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a0a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3539 expref: 20 pid: 6532 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.261419:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.261421:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.261426:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.261436:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.261464:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167006.261506:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.261521:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.261533:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451794048:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 244us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.261543:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7425 00010000:00010000:2.0:1762167006.263255:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.263273:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.263287:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.263294:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.263299:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.263308:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.263323:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.263330:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a166 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.263418:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451793920:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4396us (4563us total) trans 0 rc 154055/154055 00000100:00100000:2.0:1762167006.263428:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2821 00000100:00100000:1.0:1762167006.271386:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.271455:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451794176 00000100:00100000:2.0:1762167006.271467:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451794176 00000100:00100000:2.0:1762167006.271532:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 637 00000100:00100000:2.0:1762167006.271542:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56196:x1847765451794176:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762167006.271558:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.271587:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a127 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb356a expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.271607:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167006.271610:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.271673:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56196:x1847765451794176:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 132us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.271682:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 637 00000100:00100000:1.0:1762167006.272850:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.272890:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451794432 00000100:00100000:2.0:1762167006.272896:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451794432 00000100:00100000:2.0:1762167006.272932:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7304 00000100:00100000:2.0:1762167006.272940:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56196:x1847765451794432:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167006.273152:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56196:x1847765451794432:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 213us (304us total) trans 8589952784 rc 0/0 00000100:00100000:2.0:1762167006.273160:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7304 00000100:00100000:3.0:1762167006.275612:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.275697:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451794688 00000100:00100000:0.0:1762167006.275709:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451794688 00000100:00100000:0.0:1762167006.275803:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19695 00000100:00100000:0.0:1762167006.275813:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451794688:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167006.275834:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.275853:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a16d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3578 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.275937:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.275948:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb355c expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.275955:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.275992:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb355c expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.276006:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb355c expref: 904 pid: 30818 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.276020:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454422144:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.276098:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855480 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.277470:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454422144:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.277499:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167006.277667:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.277991:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451794816 00000100:00100000:2.0:1762167006.277998:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451794816 00010000:00010000:2.0:1762167006.278040:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb355c expref: 905 pid: 30818 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.278086:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7426 00000100:00100000:2.0:1762167006.278099:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2361:x1847765451794816:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.278120:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.278128:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb355c expref: 905 pid: 30818 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.278143:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb355c expref: 905 pid: 30818 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.278174:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a104 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb355c expref: 905 pid: 30818 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.278193:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167006.278198:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.278206:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.278214:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.278247:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.278310:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167006.278315:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2361:x1847765451794816:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 212us (641us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167006.278321:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167006.278338:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7426 00000004:00200000:0.0:1762167006.278352:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00010000:00010000:0.0:1762167006.278557:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a16d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3578 expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.278579:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3578 expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.278586:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.278590:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167006.278592:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:0.0:1762167006.278637:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451794688:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2826us (3033us total) trans 8589952785 rc 0/0 00000100:00100000:0.0:1762167006.278644:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19695 00000100:00100000:3.0:1762167006.280091:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.280139:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451794944 00000100:00100000:0.0:1762167006.280148:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451794944 00000100:00100000:0.0:1762167006.280199:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19696 00000100:00100000:0.0:1762167006.280210:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451794944:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167006.280234:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.280252:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a182 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb357f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.280333:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.280347:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3578 expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.280355:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.280402:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3578 expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.280415:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3578 expref: 905 pid: 30818 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.280434:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454422272:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.280516:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855480 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.281678:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454422272:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.281699:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167006.281943:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.282019:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451795072 00000100:00100000:2.0:1762167006.282025:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451795072 00010000:00010000:2.0:1762167006.282056:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3578 expref: 906 pid: 30818 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.282090:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7427 00000100:00100000:2.0:1762167006.282099:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2360:x1847765451795072:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.282112:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.282119:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3578 expref: 906 pid: 30818 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.282137:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3578 expref: 906 pid: 30818 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.282155:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a174 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3578 expref: 906 pid: 30818 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.282171:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167006.282175:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.282182:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.282190:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.282214:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.282244:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.282254:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167006.282263:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2360:x1847765451795072:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 163us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.282271:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7427 00000004:00200000:0.0:1762167006.282295:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00000004:00200000:0.0:1762167006.282301:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167006.282319:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.282344:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a182 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb357f expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.282360:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb357f expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.282366:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.282369:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167006.282371:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:0.0:1762167006.282421:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451794944:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2214us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.282428:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19696 00000100:00100000:3.0:1762167006.283697:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.283786:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451795200 00000100:00100000:1.0:1762167006.283793:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451795200 00000100:00100000:1.0:1762167006.283837:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16665 00000100:00100000:1.0:1762167006.283845:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451795200:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.283859:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.283875:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a190 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3586 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167006.283896:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 154055, mtime: 0x690888de, atime: 0x690888db, ctime: 0x690888de, blocks: 0x203 00010000:00010000:1.0:1762167006.283913:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.283916:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.283926:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a190 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3586 expref: 29 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.283943:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a190 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3586 expref: 29 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.283966:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b600, rc 0) 00000100:00100000:1.0:1762167006.284020:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451795200:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 175us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.284027:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16665 00000100:00100000:2.0:1762167006.286017:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.286085:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451795328 00000100:00100000:1.0:1762167006.286094:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451795328 00000100:00100000:1.0:1762167006.286143:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16666 00000100:00100000:1.0:1762167006.286151:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56065:x1847765451795328:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.286166:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.286181:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb358d expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.286211:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a190 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3586 expref: 30 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.286219:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.286221:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.286224:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 30 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.286262:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a190 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3586 expref: 30 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.286274:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a190 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3586 expref: 30 pid: 33894 timeout: 727 lvb_type: 1 00000100:00100000:1.0:1762167006.286289:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454422400:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167006.286369:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.287605:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454422400:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167006.287630:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 30 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.287644:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b800, rc 0) 00000100:00100000:1.0:1762167006.287706:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:56065:x1847765451795328:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1554us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.287716:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16666 00000100:00100000:2.0:1762167006.287756:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.287835:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451795456 00000100:00100000:1.0:1762167006.287841:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451795456 00010000:00010000:1.0:1762167006.287866:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a190 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3586 expref: 30 pid: 33894 timeout: 727 lvb_type: 1 00000100:00100000:1.0:1762167006.287915:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7428 00000100:00100000:1.0:1762167006.287925:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451795456:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.287941:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.287971:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a190 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3586 expref: 30 pid: 33894 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1762167006.287985:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a190 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3586 expref: 30 pid: 33894 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1762167006.288009:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a190 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3586 expref: 30 pid: 33894 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1762167006.288025:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.288028:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.288036:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.288046:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.288076:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.288089:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454422528:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167006.288153:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.289229:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454422528:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167006.289246:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167006.289288:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451795456:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1364us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.289297:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7428 00000100:00100000:0.0:1762167006.289609:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.289652:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451795584 00000100:00100000:2.0:1762167006.289658:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451795584 00002000:00100000:2.0:1762167006.289690:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x81a:0x0] (65536->69631) req@ffff9ee24354ea00 x1847765451795584/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167006.289701:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354ea00 with x1847765451795584 ext(65536->69631) 00002000:00010000:2.0:1762167006.289706:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24354ea00 00000100:00100000:2.0:1762167006.289736:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2822 00000100:00100000:2.0:1762167006.289746:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451795584:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167006.289951:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451795584:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 207us (343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167006.289957:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2822 00002000:00100000:2.0:1762167006.289964:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x81a:0x0] (65536->69631) req@ffff9ee24354ea00 x1847765451795584/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/4536 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167006.289973:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354ea00 with x1847765451795584 ext(65536->69631) 00002000:00010000:2.0:1762167006.289976:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24354ea00 00000100:00100000:2.0:1762167006.291425:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.291492:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451795840 00000100:00100000:0.0:1762167006.291500:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451795840 00000100:00100000:0.0:1762167006.291553:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7305 00000100:00100000:0.0:1762167006.291564:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451795840:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167006.291815:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451795840:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 253us (395us total) trans 8589952786 rc 0/0 00000100:00100000:0.0:1762167006.291824:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7305 00000100:00100000:3.0:1762167006.292899:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.292951:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451796096 00000100:00100000:0.0:1762167006.292958:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451796096 00000100:00100000:0.0:1762167006.292999:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19697 00000100:00100000:0.0:1762167006.293009:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451796096:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167006.293025:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.293028:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762167006.293053:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a189 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb357f expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.293081:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a112 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3563 expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.293094:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a0e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3555 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.293103:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.293114:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.293127:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a19e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3594 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.293170:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a1a5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.293182:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a1a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167006.293191:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a1a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000040:00080000:0.0:1762167006.293781:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5385, 88 off434264 00000004:00080000:0.0:1762167006.293793:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627086029479ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167006.293868:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5393, 88 off435320 00000004:00080000:0.0:1762167006.293874:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627086111468ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167006.293904:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5394, 88 off435408 00000004:00080000:0.0:1762167006.293908:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627086145050ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167006.293964:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5386, 88 off434352 00000004:00080000:0.0:1762167006.293970:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627086207029ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167006.293990:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5395, 88 off435496 00000004:00080000:0.0:1762167006.293994:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627086231599ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167006.294146:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5387, 88 off434440 00000004:00080000:0.0:1762167006.294152:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627086388948ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167006.294265:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5388, 88 off434528 00000004:00080000:0.0:1762167006.294270:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627086507321ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167006.294369:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5396, 88 off435584 00000004:00080000:0.0:1762167006.294374:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627086611504ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167006.294413:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5397, 88 off435672 00000004:00080000:0.0:1762167006.294419:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627086655731ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167006.294439:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5389, 88 off434616 00000004:00080000:0.0:1762167006.294443:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627086679988ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167006.294523:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5398, 88 off435760 00000004:00080000:0.0:1762167006.294529:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627086765720ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167006.294558:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5390, 88 off434704 00000004:00080000:0.0:1762167006.294563:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627086800388ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167006.294590:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5399, 88 off435848 00000004:00080000:0.0:1762167006.294594:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627086831151ns, next at 626774785189ns, rc = 0 00000040:00080000:0.0:1762167006.294625:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5391, 88 off434792 00000004:00080000:0.0:1762167006.294631:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627086867939ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167006.294662:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5392, 88 off434880 00000004:00080000:0.0:1762167006.294667:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627086904369ns, next at 626774750597ns, rc = 0 00000040:00080000:0.0:1762167006.294695:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5400, 88 off435936 00000004:00080000:0.0:1762167006.294700:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627086937594ns, next at 626774785189ns, rc = 0 00000001:00080000:2.0:1762167006.307510:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952787 is committed 00000004:00080000:2.0:1762167006.307525:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3513 committed 00000004:00080000:2.0:1762167006.307538:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3500 committed 00010000:00010000:3.0:1762167006.307540:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3594 expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.307556:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:3.0:1762167006.307561:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:2.0:1762167006.307565:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3499 committed 00000004:00080000:2.0:1762167006.307569:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3512 committed 00000004:00080000:2.0:1762167006.307575:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3498 committed 00000004:00080000:2.0:1762167006.307579:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3511 committed 00010000:00010000:3.0:1762167006.307581:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a19e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3594 expref: 904 pid: 30818 timeout: 0 lvb_type: 3 00000004:00080000:2.0:1762167006.307583:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3497 committed 00000004:00080000:2.0:1762167006.307590:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3510 committed 00000004:00080000:2.0:1762167006.307595:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3509 committed 00000004:00080000:2.0:1762167006.307600:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3496 committed 00000004:00080000:2.0:1762167006.307604:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3495 committed 00000004:00080000:2.0:1762167006.307607:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3508 committed 00010000:00010000:3.0:1762167006.307608:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3594 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762167006.307612:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3494 committed 00000004:00080000:2.0:1762167006.307617:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3507 committed 00000004:00080000:2.0:1762167006.307620:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3506 committed 00000004:00080000:2.0:1762167006.307622:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3493 committed 00000100:00100000:3.0:1762167006.307649:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454422784:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1762167006.307676:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee349c6a780 refcount 2 committed 0 result 0 batchid 4294969180 00000020:00080000:2.0:1762167006.307682:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee347bb9600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee349c6a180 00000020:00080000:2.0:1762167006.307685:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee347bb9500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee349c6a3c0 00000020:00080000:2.0:1762167006.307688:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee347bb9d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee2434eb400 00000020:00080000:2.0:1762167006.307691:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].48 00000100:00100000:3.0:1762167006.307716:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1762167006.307725:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969180 committed batchid 4294969179 00000100:00100000:3.0:1762167006.307783:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454423296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167006.307818:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167006.307844:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454422656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167006.307851:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454423808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.307890:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167006.307910:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454422784 00000100:00100000:3.0:1762167006.307918:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454422784 00000100:00100000:0.0:1762167006.307930:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454423296 00000100:00100000:1.0:1762167006.307933:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454423168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.307936:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454423296 00000020:00080000:2.0:1762167006.307962:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969179 00000100:00100000:1.0:1762167006.307968:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.307978:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454422656 00000100:00100000:0.0:1762167006.307983:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454422656 00000100:00100000:2.0:1762167006.307986:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454423168 00000100:00100000:1.0:1762167006.307989:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454423680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167006.307992:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454423168 00000100:00100000:1.0:1762167006.308011:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.308016:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16667 00000100:00100000:0.0:1762167006.308029:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765454422784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167006.308030:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454424192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.308036:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454423680 00000100:00100000:2.0:1762167006.308040:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454423680 00000100:00100000:3.0:1762167006.308051:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16668 00000100:00100000:1.0:1762167006.308055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167006.308063:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765454423296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.308064:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454424192 00000100:00100000:2.0:1762167006.308068:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454424192 00000100:00100000:1.0:1762167006.308086:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454422912:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.308089:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16669 00000100:00100000:2.0:1762167006.308100:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454422656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.308125:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167006.308146:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454423424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.308175:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167006.308191:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454423936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167006.308215:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167006.308222:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167006.308226:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00000100:00100000:1.0:1762167006.308228:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454424448:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167006.308232:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167006.308236:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.308239:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167006.308246:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 154055 -> 154055 00000100:00100000:1.0:1762167006.308251:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167006.308253:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167006.308257:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167006.308259:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167006.308259:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:1.0:1762167006.308265:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00002000:00010000:2.0:1762167006.308266:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167006.308267:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 227 -> 227 00000100:00100000:1.0:1762167006.308272:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454423040:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167006.308274:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167006.308280:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000100:00100000:3.0:1762167006.308284:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454423296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (464us total) trans 21474843233 rc 0/0 00002000:00010000:2.0:1762167006.308284:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167006.308297:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16668 00000100:00100000:3.0:1762167006.308318:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454422912 00000100:00100000:3.0:1762167006.308323:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454422912 00000100:00100000:0.0:1762167006.308327:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454422784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 289us (599us total) trans 21474843234 rc 0/0 00000100:00100000:1.0:1762167006.308328:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.308337:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454422656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (447us total) trans 17179875706 rc 0/0 00000100:00100000:0.0:1762167006.308340:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16667 00000100:00100000:1.0:1762167006.308348:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454423552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.308355:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16669 00000100:00100000:3.0:1762167006.308361:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454423424 00000100:00100000:0.0:1762167006.308363:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454423936 00000100:00100000:3.0:1762167006.308366:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454423424 00000100:00100000:0.0:1762167006.308369:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454423936 00000100:00100000:2.0:1762167006.308376:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454424448 00000100:00100000:1.0:1762167006.308379:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.308383:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454424448 00000100:00100000:3.0:1762167006.308403:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454423040 00000100:00100000:0.0:1762167006.308408:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454423552 00000100:00100000:3.0:1762167006.308409:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454423040 00000100:00100000:1.0:1762167006.308413:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454424064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.308414:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454423552 00000100:00100000:2.0:1762167006.308421:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16670 00000100:00100000:2.0:1762167006.308432:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454423168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167006.308438:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16671 00000100:00100000:1.0:1762167006.308448:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167006.308450:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454423680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.308455:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16672 00000100:00100000:1.0:1762167006.308468:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454424576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167006.308469:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454424192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167006.308501:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167006.308538:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454424064 00000100:00100000:1.0:1762167006.308543:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454424064 00000100:00100000:1.0:1762167006.308568:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454424576 00000100:00100000:1.0:1762167006.308572:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454424576 00000100:00100000:1.0:1762167006.308596:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16673 00000100:00100000:1.0:1762167006.308604:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454422912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.308610:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3295:x1847765454423168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (641us total) trans 17179875707 rc 0/0 00000100:00100000:2.0:1762167006.308619:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16670 00002000:00010000:0.0:1762167006.308623:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167006.308624:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1847765454423680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (609us total) trans 17179875708 rc 0/0 00002000:00010000:0.0:1762167006.308630:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.308636:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:3.0:1762167006.308640:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16671 00002000:00010000:0.0:1762167006.308641:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.308646:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167006.308648:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16674 00000100:00100000:2.0:1762167006.308661:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454423424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167006.308663:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16675 00000100:00100000:3.0:1762167006.308676:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454423936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167006.308682:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454424192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 218us (627us total) trans 21474843235 rc 0/0 00000100:00100000:0.0:1762167006.308688:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16672 00002000:00010000:1.0:1762167006.308695:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.308700:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167006.308703:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167006.308706:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167006.308710:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16676 00002000:00010000:1.0:1762167006.308711:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167006.308719:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454424448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167006.308755:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454422912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (629us total) trans 21474843236 rc 0/0 00000100:00100000:1.0:1762167006.308783:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16673 00000100:00100000:1.0:1762167006.308802:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16677 00000100:00100000:1.0:1762167006.308810:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454423040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167006.308833:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167006.308838:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167006.308841:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167006.308843:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.308846:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167006.308854:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167006.308859:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.308861:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167006.308862:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167006.308865:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.308868:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.308869:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167006.308876:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167006.308876:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:3.0:1762167006.308882:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454423936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (663us total) trans 21474843237 rc 0/0 00002000:00010000:0.0:1762167006.308883:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:3.0:1762167006.308894:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16675 00002000:00010000:1.0:1762167006.308915:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167006.308917:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16678 00002000:00010000:1.0:1762167006.308919:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167006.308922:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167006.308926:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167006.308928:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3293:x1847765454423424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 268us (751us total) trans 17179875709 rc 0/0 00000100:00100000:3.0:1762167006.308930:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454423552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167006.308931:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167006.308931:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454424448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (676us total) trans 21474843238 rc 0/0 00000100:00100000:2.0:1762167006.308947:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16674 00000100:00100000:0.0:1762167006.308954:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16676 00000100:00100000:1.0:1762167006.308965:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3293:x1847765454423040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (655us total) trans 17179875710 rc 0/0 00000100:00100000:2.0:1762167006.308972:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16679 00000100:00100000:1.0:1762167006.308978:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16677 00000100:00100000:2.0:1762167006.308986:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3293:x1847765454424064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.308986:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16680 00000100:00100000:0.0:1762167006.309000:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454424576:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167006.309024:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825b480/2, rc 0, transno 17179875706 00000100:00100000:1.0:1762167006.309033:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454422656:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167006.309048:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825a300/2, rc 0, transno 17179875707 00000100:00100000:1.0:1762167006.309054:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454423168:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167006.309071:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258700/2, rc 0, transno 17179875708 00000100:00100000:1.0:1762167006.309076:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454423680:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167006.309088:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e473b80/2, rc 0, transno 21474843235 00000100:00100000:1.0:1762167006.309093:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454424192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167006.309111:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454423552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (732us total) trans 21474843239 rc 0/0 00000100:00100000:1.0:1762167006.309112:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167006.309122:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16678 00000100:00100000:1.0:1762167006.309137:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454424320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167006.309143:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454423808 00000100:00100000:3.0:1762167006.309148:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454423808 00000100:00100000:1.0:1762167006.309161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167006.309180:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454424320 00000100:00100000:3.0:1762167006.309185:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454424320 00000004:00080000:1.0:1762167006.309188:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354e300/2, rc 0, transno 21474843233 00000100:00100000:1.0:1762167006.309194:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454423296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.309197:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454424064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (747us total) trans 17179875711 rc 0/0 00000100:00100000:0.0:1762167006.309197:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454424576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (693us total) trans 21474843240 rc 0/0 00000004:00080000:1.0:1762167006.309205:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354ed80/2, rc 0, transno 21474843234 00000100:00100000:3.0:1762167006.309208:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16681 00000100:00100000:1.0:1762167006.309214:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454422784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.309218:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16679 00000100:00100000:3.0:1762167006.309221:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454423808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.309228:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16680 00000100:00100000:1.0:1762167006.309238:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16682 00000100:00100000:1.0:1762167006.309250:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454424320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167006.309332:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 154055 -> 154055 00002000:00010000:3.0:1762167006.309336:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.309338:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167006.309341:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.309343:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167006.309359:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.309362:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167006.309364:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167006.309366:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.309368:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167006.309398:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454423808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 169us (274us total) trans 17179875712 rc 0/0 00000100:00100000:3.0:1762167006.309406:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16681 00000100:00100000:1.0:1762167006.309410:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454424320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (248us total) trans 17179875713 rc 0/0 00000100:00100000:1.0:1762167006.309415:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16682 00000004:00080000:0.0:1762167006.309433:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825aa00/2, rc 0, transno 17179875712 00000100:00100000:0.0:1762167006.309441:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454423808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167006.309450:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825ad80/2, rc 0, transno 17179875710 00000100:00100000:1.0:1762167006.309455:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454423040:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167006.309458:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825a680/2, rc 0, transno 17179875713 00000100:00100000:0.0:1762167006.309464:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454424320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167006.309467:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354d180/2, rc 0, transno 21474843239 00000100:00100000:1.0:1762167006.309471:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454423552:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167006.309477:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348259880/2, rc 0, transno 17179875711 00000100:00100000:1.0:1762167006.309481:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454424064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167006.309486:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e472d80/2, rc 0, transno 21474843240 00000100:00100000:1.0:1762167006.309489:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454424576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167006.309493:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354f480/2, rc 0, transno 21474843236 00000100:00100000:1.0:1762167006.309495:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454422912:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167006.309498:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258380/2, rc 0, transno 17179875709 00000100:00100000:1.0:1762167006.309500:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454423424:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167006.309504:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24354dc00/2, rc 0, transno 21474843237 00000100:00100000:1.0:1762167006.309506:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454423936:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167006.309511:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e472680/2, rc 0, transno 21474843238 00000100:00100000:1.0:1762167006.309513:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454424448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167006.309523:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.309582:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451796224 00000100:00100000:2.0:1762167006.309587:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451796224 00000100:00100000:2.0:1762167006.309620:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 119 00000100:00100000:2.0:1762167006.309628:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765451796224:12345-192.168.203.35@tcp:400:kworker.0 00010000:00010000:3.0:1762167006.309632:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:3.0:1762167006.309638:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762167006.309641:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8c00, rc 0) 00000100:00100000:2.0:1762167006.309682:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2359:x1847765451796224:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 54us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.309689:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 119 00000100:00100000:3.0:1762167006.309695:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451796096:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 16685us (16795us total) trans 8589952787 rc 0/0 00000100:00100000:3.0:1762167006.309704:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19697 00000100:00100000:3.0:1762167006.312415:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.312643:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451796352 00000100:00100000:1.0:1762167006.312652:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451796352 00000100:00100000:1.0:1762167006.312714:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16683 00000100:00100000:1.0:1762167006.312724:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56065:x1847765451796352:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.312739:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.312757:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb359b expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.312828:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a135 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3571 expref: 19 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.312836:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.312838:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.312843:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 19 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.312878:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3571 expref: 19 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.312895:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3571 expref: 19 pid: 33894 timeout: 727 lvb_type: 1 00000100:00100000:1.0:1762167006.312910:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454424704:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167006.312986:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.314169:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454424704:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.314195:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 19 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.314208:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ae00, rc 0) 00000100:00100000:2.0:1762167006.314242:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:56065:x1847765451796352:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1521us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.314248:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16683 00000100:00100000:3.0:1762167006.314685:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.314736:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451796480 00000100:00100000:1.0:1762167006.314742:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451796480 00010000:00010000:1.0:1762167006.314808:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3571 expref: 19 pid: 33894 timeout: 727 lvb_type: 1 00000100:00100000:1.0:1762167006.314842:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7429 00000100:00100000:1.0:1762167006.314854:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451796480:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.314867:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.314886:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3571 expref: 19 pid: 33894 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1762167006.314903:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3571 expref: 19 pid: 33894 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1762167006.314925:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a135 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3571 expref: 19 pid: 33894 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1762167006.314936:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.314938:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.314945:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 18 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.314954:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 18 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.314981:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 18 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.314994:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454424832:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167006.315060:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.316036:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454424832:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167006.316057:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167006.316100:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451796480:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1248us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.316109:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7429 00000100:00100000:0.0:1762167006.328952:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.329083:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451796608 00000100:00100000:2.0:1762167006.329094:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451796608 00002000:00100000:2.0:1762167006.329152:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (65536->69631) req@ffff9ee36e471880 x1847765451796608/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167006.329164:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e471880 with x1847765451796608 ext(65536->69631) 00002000:00010000:2.0:1762167006.329170:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e471880 00000100:00100000:2.0:1762167006.329210:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2823 00000100:00100000:2.0:1762167006.329222:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451796608:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167006.329457:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451796608:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 236us (515us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167006.329465:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2823 00002000:00100000:2.0:1762167006.329473:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (65536->69631) req@ffff9ee36e471880 x1847765451796608/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/4536 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167006.329481:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e471880 with x1847765451796608 ext(65536->69631) 00002000:00010000:2.0:1762167006.329484:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e471880 00000100:00100000:3.0:1762167006.332045:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.332166:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451796736 00000100:00100000:2.0:1762167006.332175:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451796736 00002000:00100000:2.0:1762167006.332218:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->106495) req@ffff9ee37ff82a00 x1847765451796736/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 504/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167006.332230:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff82a00 with x1847765451796736 ext(40960->106495) 00002000:00010000:2.0:1762167006.332236:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff82a00 00000100:00100000:2.0:1762167006.332269:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2824 00000100:00100000:2.0:1762167006.332286:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451796736:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167006.333918:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451796736:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1631us (1871us total) trans 0 rc 61440/61440 00000100:00100000:2.0:1762167006.333932:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2824 00002000:00100000:2.0:1762167006.333943:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->106495) req@ffff9ee37ff82a00 x1847765451796736/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 504/440 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 61440/61440 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167006.333954:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff82a00 with x1847765451796736 ext(40960->106495) 00002000:00010000:2.0:1762167006.333960:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff82a00 00000100:00100000:0.0:1762167006.337154:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.337243:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451796864 00000100:00100000:2.0:1762167006.337253:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451796864 00002000:00100000:2.0:1762167006.337299:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (65536->98303) req@ffff9ee36e471180 x1847765451796864/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167006.337310:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e471180 with x1847765451796864 ext(65536->98303) 00002000:00010000:2.0:1762167006.337315:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e471180 00000100:00100000:2.0:1762167006.337351:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2825 00000100:00100000:2.0:1762167006.337360:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451796864:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:2.0:1762167006.339554:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451796864:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 2185us (2399us total) trans 21474843241 rc 0/0 00000100:00100000:2.0:1762167006.339569:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2825 00002000:00100000:2.0:1762167006.339582:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (65536->98303) req@ffff9ee36e471180 x1847765451796864/t21474843241(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/448 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167006.339594:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e471180 with x1847765451796864 ext(65536->98303) 00002000:00010000:2.0:1762167006.339601:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e471180 00000100:00100000:0.0:1762167006.341642:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.341719:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451796992 00000100:00100000:2.0:1762167006.341727:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451796992 00000100:00100000:2.0:1762167006.341815:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16684 00000100:00100000:2.0:1762167006.341825:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451796992:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:2.0:1762167006.358250:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843240 is committed 00000001:00080000:2.0:1762167006.358286:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843230 is committed 00000001:00080000:2.0:1762167006.358295:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843241 is committed 00000100:00100000:3.0:1762167006.358383:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451796992:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 16548us (16739us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.358411:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16684 00000100:00100000:0.0:1762167006.360346:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.360445:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451797120 00000100:00100000:3.0:1762167006.360458:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451797120 00000100:00100000:3.0:1762167006.360529:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19698 00000100:00100000:3.0:1762167006.360540:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451797120:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167006.360567:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.360587:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1b3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35a2 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.360668:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a1ba lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167006.360682:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a1ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167006.360693:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a1ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167006.360721:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 154055 00000004:00200000:3.0:1762167006.360725:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167006.360744:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a1ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167006.360809:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1b3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a2 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.360827:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a1ba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a2 expref: 891 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.360835:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:3.0:1762167006.360838:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167006.360842:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167006.360910:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451797120:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 371us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.360917:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19698 00000100:00100000:2.0:1762167006.365600:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.365686:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451797376 00000100:00100000:3.0:1762167006.365697:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451797376 00000100:00100000:3.0:1762167006.365758:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19699 00000100:00100000:3.0:1762167006.365801:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451797376:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:3.0:1762167006.365855:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762167006.365884:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a1ba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a2 expref: 891 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.365908:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a1a5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3594 expref: 890 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.365921:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:3.0:1762167006.365931:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167006.366216:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167006.366230:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167006.366239:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:3.0:1762167006.366286:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952788 00000004:00010000:3.0:1762167006.366310:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bf37d179 reply state 000000004ea48d2d transno 8589952789 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167006.366319:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167006.366440:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451797376:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 641us (848us total) trans 8589952789 rc 0/0 00000100:00100000:3.0:1762167006.366448:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19699 00000020:00080000:3.0:1762167006.366454:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167006.367407:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.367418:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.367424:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.367429:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.367434:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.367441:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.367453:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23900) 00010000:00010000:2.0:1762167006.367456:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.367460:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167006.367466:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a1c1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167006.367649:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.367688:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451797504 00000100:00100000:3.0:1762167006.367695:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451797504 00000100:00100000:3.0:1762167006.367737:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19700 00000100:00100000:3.0:1762167006.367745:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451797504:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167006.367790:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.367807:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1c8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35a9 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.367850:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a9 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.367863:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a9 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.367880:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:3.0:1762167006.367883:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167006.367886:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167006.367930:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451797504:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 185us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.367937:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19700 00000100:00100000:0.0:1762167006.369593:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.369615:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.369635:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.369694:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451797632 00000100:00100000:3.0:1762167006.369701:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451797632 00000100:00100000:2.0:1762167006.369714:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451797760 00000100:00100000:2.0:1762167006.369720:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451797760 00002000:00010000:2.0:1762167006.369754:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:2.0:1762167006.369759:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e471500 with x1847765451797760 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167006.369792:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (92852->18446744073709551615) 00000100:00100000:1.0:1762167006.369798:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451797888 00002000:00100000:3.0:1762167006.369799:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e470700 with x1847765451797632 ext(92852->18446744073709551615) 00000100:00100000:1.0:1762167006.369805:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451797888 00002000:00010000:2.0:1762167006.369811:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e471500. 00002000:00010000:3.0:1762167006.369812:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e470700. 00002000:00010000:1.0:1762167006.369826:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167006.369831:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e472a00 with x1847765451797888 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167006.369838:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2826 00002000:00010000:1.0:1762167006.369839:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e472a00. 00000100:00100000:3.0:1762167006.369848:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2827 00000100:00100000:2.0:1762167006.369853:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451797760:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167006.369864:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451797632:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167006.369898:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2828 00000100:00100000:1.0:1762167006.369909:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451797888:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:2.0:1762167006.370144:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167006.370148:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:2.0:1762167006.370151:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167006.370154:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.370157:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167006.370217:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451797760:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 369us (598us total) trans 17179875714 rc 0/0 00000100:00100000:2.0:1762167006.370226:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2826 00002000:00010000:2.0:1762167006.370231:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:2.0:1762167006.370234:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e471500 with x1847765451797760 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167006.370240:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e471500. 00002000:00010000:1.0:1762167006.370243:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.370248:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:1.0:1762167006.370251:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167006.370253:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.370256:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167006.370283:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451797888:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 376us (644us total) trans 21474843242 rc 0/0 00000100:00100000:1.0:1762167006.370290:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2828 00002000:00010000:1.0:1762167006.370294:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167006.370296:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e472a00 with x1847765451797888 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167006.370300:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e472a00. 00002000:00010000:3.0:1762167006.370459:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 154055 -> 92852 00002000:00010000:3.0:1762167006.370467:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167005 -> 1762167006 00002000:00010000:3.0:1762167006.370470:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167006.370473:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.370475:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 227 -> 227 00000100:00100000:3.0:1762167006.370511:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451797632:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 650us (919us total) trans 21474843243 rc 0/0 00000100:00100000:3.0:1762167006.370522:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2827 00002000:00010000:3.0:1762167006.370528:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (92852->18446744073709551615) 00002000:00100000:3.0:1762167006.370532:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e470700 with x1847765451797632 ext(92852->18446744073709551615) 00002000:00010000:3.0:1762167006.370536:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e470700. 00000100:00100000:0.0:1762167006.373844:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.373910:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451798016 00000100:00100000:3.0:1762167006.373922:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451798016 00000100:00100000:3.0:1762167006.373980:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19701 00000100:00100000:3.0:1762167006.373990:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451798016:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167006.374015:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.374036:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a1cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35b0 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.374128:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a1d6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167006.374142:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167006.374154:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167006.374182:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92852 00000004:00200000:3.0:1762167006.374186:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167006.374205:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167006.374229:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a1cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35b0 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.374251:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a1d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35b0 expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.374259:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:3.0:1762167006.374261:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167006.374265:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:3.0:1762167006.374332:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451798016:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 343us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.374340:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19701 00000100:00100000:0.0:1762167006.378735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.378924:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451798144 00000100:00100000:3.0:1762167006.378935:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451798144 00002000:00100000:3.0:1762167006.378987:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (12288->40959) req@ffff9ee36e473480 x1847765451798144/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167006.378998:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e473480 with x1847765451798144 ext(12288->40959) 00002000:00010000:3.0:1762167006.379004:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e473480 00000100:00100000:3.0:1762167006.379045:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2829 00000100:00100000:3.0:1762167006.379054:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451798144:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167006.380329:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451798144:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1270us (1599us total) trans 0 rc 28672/28672 00000100:00100000:3.0:1762167006.380339:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2829 00002000:00100000:3.0:1762167006.380350:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (12288->40959) req@ffff9ee36e473480 x1847765451798144/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/440 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167006.380361:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e473480 with x1847765451798144 ext(12288->40959) 00002000:00010000:3.0:1762167006.380365:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e473480 00000100:00100000:0.0:1762167006.386245:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.386308:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451798272 00000100:00100000:3.0:1762167006.386318:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451798272 00002000:00100000:3.0:1762167006.386368:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (0->12287) req@ffff9ee36e470380 x1847765451798272/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167006.386380:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e470380 with x1847765451798272 ext(0->12287) 00002000:00010000:3.0:1762167006.386399:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e470380 00000100:00100000:3.0:1762167006.386434:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2830 00000100:00100000:3.0:1762167006.386446:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451798272:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167006.386696:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451798272:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 252us (461us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1762167006.386702:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2830 00002000:00100000:3.0:1762167006.386707:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (0->12287) req@ffff9ee36e470380 x1847765451798272/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/12728 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167006.386714:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e470380 with x1847765451798272 ext(0->12287) 00002000:00010000:3.0:1762167006.386717:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e470380 00000100:00100000:0.0:1762167006.392282:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.392497:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451798400 00000100:00100000:3.0:1762167006.392513:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451798400 00002000:00100000:3.0:1762167006.392586:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (94208->204799) req@ffff9ee36e473100 x1847765451798400/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167006.392600:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e473100 with x1847765451798400 ext(94208->204799) 00002000:00010000:3.0:1762167006.392606:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e473100 00000100:00100000:3.0:1762167006.392655:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2831 00000100:00100000:3.0:1762167006.392667:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451798400:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167006.394749:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451798400:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 2076us (2477us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.394794:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2831 00002000:00100000:3.0:1762167006.394806:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (94208->204799) req@ffff9ee36e473100 x1847765451798400/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/440 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167006.394817:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e473100 with x1847765451798400 ext(94208->204799) 00002000:00010000:3.0:1762167006.394823:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e473100 00000100:00100000:0.0:1762167006.399295:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.399401:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451798528 00000100:00100000:3.0:1762167006.399411:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451798528 00002000:00100000:3.0:1762167006.399452:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->262143) req@ffff9ee36e471c00 x1847765451798528/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 504/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167006.399461:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e471c00 with x1847765451798528 ext(40960->262143) 00002000:00010000:3.0:1762167006.399466:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e471c00 00000100:00100000:3.0:1762167006.399500:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2832 00000100:00100000:3.0:1762167006.399510:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451798528:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:3.0:1762167006.402213:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451798528:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 2696us (2922us total) trans 21474843244 rc 0/0 00000100:00100000:3.0:1762167006.402229:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2832 00002000:00100000:3.0:1762167006.402243:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->262143) req@ffff9ee36e471c00 x1847765451798528/t21474843244(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 504/448 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167006.402254:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e471c00 with x1847765451798528 ext(40960->262143) 00002000:00010000:3.0:1762167006.402260:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e471c00 00000100:00100000:0.0:1762167006.404356:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.404449:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451798656 00000100:00100000:3.0:1762167006.404458:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451798656 00000100:00100000:3.0:1762167006.404513:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16685 00000100:00100000:3.0:1762167006.404523:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451798656:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:2.0:1762167006.419863:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843242 is committed 00000100:00100000:3.0:1762167006.420026:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451798656:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 15496us (15670us total) trans 0 rc 0/0 00000001:00080000:0.0:1762167006.420036:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843244 is committed 00000100:00100000:3.0:1762167006.420040:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16685 00000100:00100000:0.0:1762167006.424656:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.424722:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451798784 00000100:00100000:3.0:1762167006.424735:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451798784 00002000:00100000:3.0:1762167006.424815:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->106495) req@ffff9ee37fb11500 x1847765451798784/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167006.424827:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb11500 with x1847765451798784 ext(81920->106495) 00002000:00010000:3.0:1762167006.424837:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb11500 00000100:00100000:3.0:1762167006.424866:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2833 00000100:00100000:3.0:1762167006.424877:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451798784:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:3.0:1762167006.426753:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451798784:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 1870us (2097us total) trans 21474843245 rc 0/0 00000100:00100000:3.0:1762167006.426800:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2833 00002000:00100000:3.0:1762167006.426812:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->106495) req@ffff9ee37fb11500 x1847765451798784/t21474843245(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/448 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167006.426823:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb11500 with x1847765451798784 ext(81920->106495) 00002000:00010000:3.0:1762167006.426829:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb11500 00000100:00100000:0.0:1762167006.428360:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.428429:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451798912 00000100:00100000:3.0:1762167006.428439:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451798912 00000100:00100000:3.0:1762167006.428499:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16686 00000100:00100000:3.0:1762167006.428513:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451798912:12345-192.168.203.35@tcp:16:fsx.0 00000100:00100000:0.0:1762167006.443318:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451798912:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 14799us (14958us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.443335:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16686 00000001:00080000:0.0:1762167006.443378:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843245 is committed 00000100:00100000:0.0:1762167006.445740:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.445817:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451799168 00000100:00100000:1.0:1762167006.445829:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451799168 00000100:00100000:1.0:1762167006.445887:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19702 00000100:00100000:1.0:1762167006.445898:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451799168:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167006.445953:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.445980:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a1d6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35b0 expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.445999:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:1.0:1762167006.446005:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.446213:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.446226:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.446235:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:1.0:1762167006.446287:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952790 00000004:00010000:1.0:1762167006.446313:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fd8e952f reply state 00000000ea14e78e transno 8589952791 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.446321:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167006.446414:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451799168:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 517us (680us total) trans 8589952791 rc 0/0 00000100:00100000:1.0:1762167006.446422:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19702 00000020:00080000:1.0:1762167006.446428:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167006.447480:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.447492:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.447498:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.447504:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.447509:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.447516:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.447528:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:0.0:1762167006.447530:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.447533:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.447540:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a1dd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167006.447964:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.447992:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.448019:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.448072:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451799296 00000100:00100000:3.0:1762167006.448080:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451799424 00000100:00100000:1.0:1762167006.448090:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451799296 00000100:00100000:3.0:1762167006.448092:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451799424 00000100:00100000:2.0:1762167006.448096:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451799552 00000100:00100000:2.0:1762167006.448103:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451799552 00002000:00010000:3.0:1762167006.448161:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:2.0:1762167006.448161:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:1.0:1762167006.448164:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (124079->18446744073709551615) 00002000:00100000:2.0:1762167006.448178:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13480 with x1847765451799552 ext(0->18446744073709551615) 00002000:00100000:1.0:1762167006.448179:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb12a00 with x1847765451799296 ext(124079->18446744073709551615) 00002000:00100000:3.0:1762167006.448180:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13b80 with x1847765451799424 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167006.448197:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb13480. 00002000:00010000:3.0:1762167006.448199:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb13b80. 00002000:00010000:1.0:1762167006.448202:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb12a00. 00000100:00100000:2.0:1762167006.448234:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2834 00000100:00100000:3.0:1762167006.448247:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2835 00000100:00100000:2.0:1762167006.448253:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451799552:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167006.448269:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451799424:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167006.448276:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2836 00000100:00100000:1.0:1762167006.448296:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451799296:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167006.448595:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167006.448599:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.448602:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167006.448604:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.448607:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167006.448668:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451799424:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 406us (670us total) trans 17179875715 rc 0/0 00000100:00100000:3.0:1762167006.448681:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2835 00002000:00010000:3.0:1762167006.448685:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167006.448689:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13b80 with x1847765451799424 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167006.448698:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb13b80. 00002000:00010000:2.0:1762167006.448713:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167006.448719:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.448723:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167006.448727:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.448731:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167006.448820:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451799552:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 574us (797us total) trans 21474843246 rc 0/0 00000100:00100000:2.0:1762167006.448831:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2834 00002000:00010000:2.0:1762167006.448837:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:2.0:1762167006.448841:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13480 with x1847765451799552 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167006.448849:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb13480. 00002000:00010000:1.0:1762167006.449067:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 92852 -> 124079 00002000:00010000:1.0:1762167006.449072:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.449075:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167005 -> 1762167006 00002000:00010000:1.0:1762167006.449078:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.449081:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 227 -> 389 00000100:00100000:1.0:1762167006.449145:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451799296:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 853us (1182us total) trans 21474843247 rc 0/0 00000100:00100000:1.0:1762167006.449156:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2836 00002000:00010000:1.0:1762167006.449161:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (124079->18446744073709551615) 00002000:00100000:1.0:1762167006.449165:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb12a00 with x1847765451799296 ext(124079->18446744073709551615) 00002000:00010000:1.0:1762167006.449171:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb12a00. 00000100:00100000:0.0:1762167006.450538:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.450614:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451799680 00000100:00100000:1.0:1762167006.450622:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451799680 00000100:00100000:1.0:1762167006.450676:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19703 00000100:00100000:1.0:1762167006.450686:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451799680:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.450706:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.450724:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a1e4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35b7 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.450836:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a1eb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.450852:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a1eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.450867:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a1eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167006.450894:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 124079 00000004:00200000:1.0:1762167006.450898:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167006.450915:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a1eb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.450938:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a1e4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35b7 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.450956:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a1eb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35b7 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.450964:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:1.0:1762167006.450967:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167006.450969:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7bc00, rc 0) 00000100:00100000:1.0:1762167006.451019:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451799680:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 334us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.451027:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19703 00000100:00100000:0.0:1762167006.452989:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.453045:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451799936 00000100:00100000:1.0:1762167006.453054:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451799936 00000100:00100000:1.0:1762167006.453103:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19704 00000100:00100000:1.0:1762167006.453113:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451799936:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167006.453156:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.453178:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a1eb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35b7 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.453195:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:1.0:1762167006.453199:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.453401:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.453412:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.453420:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:1.0:1762167006.453466:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952792 00000004:00010000:1.0:1762167006.453486:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005fb75a5e reply state 000000007e984968 transno 8589952793 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.453494:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167006.453571:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451799936:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 459us (587us total) trans 8589952793 rc 0/0 00000100:00100000:1.0:1762167006.453578:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19704 00000020:00080000:1.0:1762167006.453583:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167006.454518:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.454530:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.454537:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.454543:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.454548:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.454559:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.454572:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:2.0:1762167006.454575:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.454579:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.454585:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a1f2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167006.454969:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.455044:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.455081:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.455139:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451800192 00000100:00100000:1.0:1762167006.455145:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451800064 00000100:00100000:3.0:1762167006.455148:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451800192 00000100:00100000:1.0:1762167006.455152:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451800064 00002000:00010000:3.0:1762167006.455182:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:1.0:1762167006.455182:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (205925->18446744073709551615) 00002000:00100000:3.0:1762167006.455191:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13100 with x1847765451800192 ext(0->18446744073709551615) 00002000:00100000:1.0:1762167006.455192:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb10380 with x1847765451800064 ext(205925->18446744073709551615) 00002000:00010000:3.0:1762167006.455205:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb13100. 00002000:00010000:1.0:1762167006.455206:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb10380. 00000100:00100000:3.0:1762167006.455243:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451800320 00000100:00100000:3.0:1762167006.455248:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451800320 00000100:00100000:1.0:1762167006.455265:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2837 00002000:00010000:3.0:1762167006.455267:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167006.455272:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb12d80 with x1847765451800320 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167006.455280:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb12d80. 00000100:00100000:1.0:1762167006.455291:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765451800192:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167006.455293:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2838 00000100:00100000:0.0:1762167006.455322:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2839 00000100:00100000:2.0:1762167006.455331:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451800064:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167006.455345:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451800320:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167006.455588:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.455592:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.455596:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167006.455599:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.455602:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167006.455632:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167006.455636:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.455640:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167006.455644:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.455647:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167006.455668:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 124079 -> 205925 00002000:00010000:2.0:1762167006.455675:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00000100:00100000:1.0:1762167006.455681:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2358:x1847765451800192:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 398us (708us total) trans 17179875716 rc 0/0 00000100:00100000:0.0:1762167006.455683:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451800320:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 341us (595us total) trans 21474843248 rc 0/0 00002000:00010000:2.0:1762167006.455685:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.455701:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.455710:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 389 -> 389 00000100:00100000:0.0:1762167006.455712:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2839 00002000:00010000:0.0:1762167006.455721:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:1.0:1762167006.455726:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2837 00002000:00100000:0.0:1762167006.455727:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb12d80 with x1847765451800320 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167006.455733:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:0.0:1762167006.455736:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb12d80. 00002000:00100000:1.0:1762167006.455737:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13100 with x1847765451800192 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167006.455746:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb13100. 00000100:00100000:2.0:1762167006.455832:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451800064:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 518us (784us total) trans 21474843249 rc 0/0 00000100:00100000:2.0:1762167006.455843:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2838 00002000:00010000:2.0:1762167006.455848:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (205925->18446744073709551615) 00002000:00100000:2.0:1762167006.455852:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb10380 with x1847765451800064 ext(205925->18446744073709551615) 00002000:00010000:2.0:1762167006.455861:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb10380. 00000100:00100000:0.0:1762167006.457168:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.457212:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451800448 00000100:00100000:1.0:1762167006.457219:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451800448 00000100:00100000:1.0:1762167006.457269:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19705 00000100:00100000:1.0:1762167006.457279:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451800448:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.457298:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.457314:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a1f9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35be expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.457417:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a200 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.457432:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a200 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.457442:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a200 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167006.457468:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 205925 00000004:00200000:1.0:1762167006.457473:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167006.457488:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a200 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.457513:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a1f9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35be expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.457529:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a200 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35be expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.457537:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:1.0:1762167006.457540:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167006.457544:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a600, rc 0) 00000100:00100000:1.0:1762167006.457596:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451800448:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 318us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.457603:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19705 00000100:00100000:3.0:1762167006.460896:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.460955:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451800704 00000100:00100000:0.0:1762167006.460965:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451800704 00000100:00100000:0.0:1762167006.461017:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7306 00000100:00100000:0.0:1762167006.461028:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451800704:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167006.461355:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451800704:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 328us (464us total) trans 8589952794 rc 0/0 00000100:00100000:0.0:1762167006.461363:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7306 00000100:00100000:0.0:1762167006.470307:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.470471:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451800960 00000100:00100000:1.0:1762167006.470491:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451800960 00000100:00100000:1.0:1762167006.470596:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19706 00000100:00100000:1.0:1762167006.470611:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56197:x1847765451800960:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.470648:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.470676:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a207 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35c5 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.470827:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a20e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.470842:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a20e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.470853:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a20e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.470867:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a215 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.470874:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a215 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.470880:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a215 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471067:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a21c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471081:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a21c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471087:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a21c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167006.471098:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 205925 00010000:00010000:1.0:1762167006.471219:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a20e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471227:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a20e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471234:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a20e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471241:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7bc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167006.471246:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a20e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471253:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a20e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471267:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:1.0:1762167006.471270:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167006.471276:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a20e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471282:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a20e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471300:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a215 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471310:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a215 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471316:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a215 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471321:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167006.471324:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a215 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471330:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a215 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471337:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee345a77b00) 00010000:00010000:1.0:1762167006.471340:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167006.471343:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a215 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471348:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a215 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.471415:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a207 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35c5 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.471431:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a21c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35c5 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.471439:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:1.0:1762167006.471442:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167006.471445:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7aa00, rc 0) 00000100:00100000:1.0:1762167006.471527:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56197:x1847765451800960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 920us (1233us total) trans 8589952795 rc 0/0 00000100:00100000:1.0:1762167006.471536:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19706 00000100:00100000:1.0:1762167006.473498:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.473622:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451801088 00000100:00100000:2.0:1762167006.473634:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451801088 00000100:00100000:2.0:1762167006.473718:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 638 00000100:00100000:2.0:1762167006.473731:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2360:x1847765451801088:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.473753:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.473849:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a21c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35c5 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.473872:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:2.0:1762167006.473878:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167006.473937:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.473948:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765451801088:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 216us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.473959:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 638 00000100:00100000:1.0:1762167006.474056:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451801344 00000100:00100000:1.0:1762167006.474067:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451801344 00000100:00100000:1.0:1762167006.474123:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19707 00000100:00100000:1.0:1762167006.474132:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56197:x1847765451801344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.474157:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.474174:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a22a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35cc expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.474941:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x649:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.474957:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.474967:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167006.474980:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x649:0x0]: returning size 0 00010000:00010000:1.0:1762167006.475031:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a22a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35cc expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.475048:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35cc expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.475057:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee345a77300) 00010000:00010000:1.0:1762167006.475060:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167006.475063:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b000, rc 0) 00000100:00100000:1.0:1762167006.475113:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56197:x1847765451801344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 983us (1187us total) trans 8589952796 rc 0/0 00000100:00100000:1.0:1762167006.475121:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19707 00000100:00100000:0.0:1762167006.476932:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.476987:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451801600 00000100:00100000:1.0:1762167006.476998:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451801600 00000100:00100000:1.0:1762167006.477053:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19708 00000100:00100000:1.0:1762167006.477066:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56197:x1847765451801600:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.477088:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.477106:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a23f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35d3 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.477216:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.477232:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35cc expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.477240:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.477281:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35cc expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.477294:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35cc expref: 902 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1762167006.477308:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454424960:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167006.477416:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.478470:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454424960:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167006.478506:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167006.478637:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.478694:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451801728 00000100:00100000:2.0:1762167006.478707:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451801728 00010000:00010000:2.0:1762167006.478750:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35cc expref: 903 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.478818:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7430 00000100:00100000:2.0:1762167006.478831:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2361:x1847765451801728:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.478846:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.478853:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35cc expref: 903 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.478867:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35cc expref: 903 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.478889:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a231 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35cc expref: 903 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.478913:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee345a77300) 00010000:00010000:2.0:1762167006.478918:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.478927:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.478932:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.478957:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.478987:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.478998:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167006.479008:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2361:x1847765451801728:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 176us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.479019:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7430 00000004:00200000:1.0:1762167006.479024:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x649:0x0]: returning size 0 00000004:00080000:1.0:1762167006.479438:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81e:0x0], index 1: 0 00000004:00080000:1.0:1762167006.479449:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81b:0x0], index 0: 0 00010000:00010000:1.0:1762167006.479640:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.479649:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.479656:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.479662:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167006.479666:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.479675:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.479689:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee345a77300) 00010000:00010000:1.0:1762167006.479693:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167006.479697:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.479704:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a246 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.479820:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a23f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35d3 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.479831:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:1.0:1762167006.479834:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762167006.479838:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a23f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35d3 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.479854:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7be00, rc 0) 00000100:00100000:1.0:1762167006.479911:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56197:x1847765451801600:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2848us (2987us total) trans 8589952797 rc 301/301 00000100:00100000:1.0:1762167006.479919:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19708 00000100:00100000:0.0:1762167006.481105:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.481159:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451801984 00000100:00100000:2.0:1762167006.481168:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451801984 00000100:00100000:2.0:1762167006.481213:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7307 00000100:00100000:2.0:1762167006.481219:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56197:x1847765451801984:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167006.481546:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56197:x1847765451801984:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 325us (449us total) trans 8589952798 rc 0/0 00000100:00100000:2.0:1762167006.481554:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7307 00000100:00100000:0.0:1762167006.483239:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.483281:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451802112 00000100:00100000:1.0:1762167006.483289:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451802112 00000100:00100000:1.0:1762167006.483344:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19709 00000100:00100000:1.0:1762167006.483353:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56197:x1847765451802112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.483371:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.483404:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a254 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x649:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35da expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.483463:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a25b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x649:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.483475:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a25b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.483485:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a25b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167006.483516:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x649:0x0]: returning size 0 00000004:00200000:1.0:1762167006.483519:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167006.483533:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a25b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.483553:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a254 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35da expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.483569:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a25b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35da expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.483576:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:1.0:1762167006.483579:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762167006.483582:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b400, rc 0) 00000100:00100000:1.0:1762167006.483629:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56197:x1847765451802112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 277us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.483636:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19709 00000100:00100000:3.0:1762167006.485082:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.485115:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.485143:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451802240 00000100:00100000:0.0:1762167006.485150:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451802240 00000100:00100000:1.0:1762167006.485160:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451802368 00000100:00100000:1.0:1762167006.485166:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451802368 00000100:00100000:0.0:1762167006.485193:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16687 00000100:00100000:0.0:1762167006.485205:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451802240:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:1.0:1762167006.485212:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16688 00010000:00010000:0.0:1762167006.485219:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167006.485225:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451802368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.485236:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a262 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35e1 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.485242:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.485258:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a269 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35e8 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167006.485262:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:1.0:1762167006.485284:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762167006.485284:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.485289:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.485298:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.485299:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a262 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e1 expref: 33 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.485303:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.485312:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a269 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e8 expref: 21 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.485320:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a262 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e1 expref: 33 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.485329:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a269 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e8 expref: 21 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.485347:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7bc00, rc 0) 00010000:00010000:0.0:1762167006.485360:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:1.0:1762167006.485415:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451802368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 193us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.485416:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451802240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 212us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.485433:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16688 00000100:00100000:0.0:1762167006.485440:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16687 00000100:00100000:0.0:1762167006.487055:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.487128:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451802624 00000100:00100000:1.0:1762167006.487136:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451802624 00000100:00100000:1.0:1762167006.487188:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19710 00000100:00100000:1.0:1762167006.487198:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56197:x1847765451802624:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.487213:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.487230:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a270 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35ef expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.487344:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a277 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.487357:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a277 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.487367:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a277 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167006.487378:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 205925 00010000:00010000:1.0:1762167006.487502:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a270 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35ef expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.487520:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a277 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35ef expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.487528:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:1.0:1762167006.487531:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167006.487534:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a000, rc 0) 00000100:00100000:1.0:1762167006.487583:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56197:x1847765451802624:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 386us (534us total) trans 8589952799 rc 0/0 00000100:00100000:1.0:1762167006.487590:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19710 00000100:00100000:2.0:1762167006.489911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.489947:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.489978:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451802752 00000100:00100000:2.0:1762167006.489984:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.489990:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451802752 00000100:00100000:1.0:1762167006.490003:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451802880 00000100:00100000:1.0:1762167006.490009:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451802880 00000100:00100000:0.0:1762167006.490047:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451803008 00000100:00100000:0.0:1762167006.490052:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451803008 00000100:00100000:1.0:1762167006.490070:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16689 00000100:00100000:3.0:1762167006.490086:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16690 00000100:00100000:1.0:1762167006.490091:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451802752:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167006.490098:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16691 00000100:00100000:3.0:1762167006.490102:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451802880:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167006.490114:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451803008:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167006.490139:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.490139:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.490141:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.490171:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.490175:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.490176:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 33 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.490184:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.490187:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.490192:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.490200:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167006.490201:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167006.490205:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167006.490206:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167006.490210:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.490211:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.490227:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.490240:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 22 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.490254:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.490255:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 33 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.490257:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454425088:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167006.490283:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 33 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.490288:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 22 pid: 33894 timeout: 727 lvb_type: 0 00000100:00100000:3.0:1762167006.490304:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454425344:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167006.490308:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454425216:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.490339:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7540 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.490344:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.490352:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.491538:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454425088:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.491561:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.491592:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454425344:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.491607:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.491784:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454425216:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167006.491803:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.492060:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.492096:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.492111:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451803136 00000100:00100000:2.0:1762167006.492117:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451803136 00000100:00100000:1.0:1762167006.492133:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451803264 00000100:00100000:1.0:1762167006.492136:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451803264 00010000:00010000:2.0:1762167006.492145:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 34 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.492151:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 23 pid: 33894 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.492158:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.492199:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451803392 00000100:00100000:2.0:1762167006.492202:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451803392 00000100:00100000:1.0:1762167006.492205:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7431 00000100:00100000:1.0:1762167006.492214:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451803136:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.492215:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 24 pid: 33894 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.492224:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7432 00010000:00010000:1.0:1762167006.492226:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762167006.492252:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7433 00010000:00010000:1.0:1762167006.492252:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 34 pid: 33894 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.492253:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451803264:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167006.492264:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2358:x1847765451803392:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.492269:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 34 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.492269:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.492274:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.492297:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 24 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.492298:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 24 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.492298:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d09f36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34bb expref: 34 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.492328:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.492328:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 24 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.492329:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 24 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.492332:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.492338:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.492358:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.492360:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a1ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb359b expref: 24 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.492371:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.492372:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d09f3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34c2 expref: 23 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.492375:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.492381:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.492400:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.492401:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.492401:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.492406:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.492412:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.492422:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.492422:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.492433:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451803136:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 219us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.492441:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7431 00000100:00100000:2.0:1762167006.492442:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451803392:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 182us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.492449:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7433 00010000:00010000:0.0:1762167006.492452:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167006.492469:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.492471:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.492475:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.492485:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451803264:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 249us (386us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167006.492489:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.492491:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.492496:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.492507:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7432 00010000:00010000:2.0:1762167006.492526:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.492526:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.492528:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.492545:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.492552:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.492555:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.492557:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.492577:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.492579:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.492580:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167006.492586:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.492600:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.492600:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167006.492601:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.492605:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.492609:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.492616:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.492617:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.492623:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.492627:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a293 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.492628:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.492645:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a28c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.492646:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.492664:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a285 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.492698:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451802752:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2617us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.492698:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451803008:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2587us (2713us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.492706:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16691 00000100:00100000:2.0:1762167006.492710:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16689 00000100:00100000:3.0:1762167006.492757:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451802880:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2660us (2808us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.492791:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16690 00000100:00100000:0.0:1762167006.494104:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.494169:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451803520 00000100:00100000:3.0:1762167006.494176:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451803520 00000100:00100000:3.0:1762167006.494214:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16692 00000100:00100000:3.0:1762167006.494227:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451803520:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:0.0:1762167006.494229:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167006.494243:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167006.494266:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451803648 00000100:00100000:1.0:1762167006.494272:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451803648 00000100:00100000:1.0:1762167006.494307:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16693 00000100:00100000:1.0:1762167006.494321:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451803648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.494330:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.494347:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a29a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35fd expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167006.494365:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888de, atime: 0x690888dd, ctime: 0x690888de, blocks: 0x3 00010000:00010000:1.0:1762167006.494382:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.494384:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.494401:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a29a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35fd expref: 33 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.494408:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a2a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb35f6 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.494417:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a29a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35fd expref: 33 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.494439:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7be00, rc 0) 00002000:00010000:3.0:1762167006.494442:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 205925, mtime: 0x690888de, atime: 0x690888de, ctime: 0x690888de, blocks: 0x185 00010000:00010000:3.0:1762167006.494457:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.494459:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.494467:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a2a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35f6 expref: 20 pid: 7858 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167006.494473:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167006.494489:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a2a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35f6 expref: 20 pid: 7858 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167006.494491:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765451803648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 168us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.494507:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16693 00010000:00010000:3.0:1762167006.494510:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:2.0:1762167006.494528:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451803776 00000100:00100000:2.0:1762167006.494534:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451803776 00000100:00100000:3.0:1762167006.494541:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451803520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 317us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.494551:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16692 00000100:00100000:3.0:1762167006.494575:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16694 00000100:00100000:3.0:1762167006.494587:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451803776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167006.494666:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.494678:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a2a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3604 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167006.494691:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888de, atime: 0x690888dd, ctime: 0x690888de, blocks: 0x3 00010000:00010000:3.0:1762167006.494699:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.494701:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.494706:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3604 expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.494717:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3604 expref: 21 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.494785:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167006.494818:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451803776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 234us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.494824:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16694 00000100:00100000:0.0:1762167006.519371:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.519427:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451803904 00000100:00100000:2.0:1762167006.519436:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451803904 00000100:00100000:2.0:1762167006.519493:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2840 00000100:00100000:2.0:1762167006.519500:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451803904:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167006.519533:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.519560:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.519562:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.519568:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.519582:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.521440:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.521456:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.521466:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.521473:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.521482:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.521492:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.521508:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.521513:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.521567:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451803904:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2064us (2204us total) trans 0 rc 205925/205925 00000100:00100000:2.0:1762167006.521577:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2840 00000100:00100000:1.0:1762167006.523489:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.523540:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451804032 00000100:00100000:2.0:1762167006.523549:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451804032 00000100:00100000:2.0:1762167006.523612:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2841 00000100:00100000:2.0:1762167006.523623:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451804032:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:2.0:1762167006.523650:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.523661:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a262 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e1 expref: 33 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.523667:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.523669:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.523671:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.523696:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a262 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e1 expref: 33 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.523704:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a262 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e1 expref: 33 pid: 33894 timeout: 727 lvb_type: 1 00000100:00100000:2.0:1762167006.523714:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454425472:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.523792:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7540 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.524717:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:6539:1847765454425472:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.524737:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.525014:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.525065:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451804160 00000100:00100000:0.0:1762167006.525071:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451804160 00010000:00010000:0.0:1762167006.525098:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a262 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e1 expref: 34 pid: 33894 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1762167006.525127:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7434 00000100:00100000:0.0:1762167006.525133:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451804160:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167006.525145:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.525160:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a262 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e1 expref: 34 pid: 33894 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.525169:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a262 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e1 expref: 34 pid: 33894 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.525183:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a262 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e1 expref: 34 pid: 33894 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.525192:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.525193:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.525197:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.525203:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.525220:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.525244:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.525253:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451804160:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 118us (238us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167006.525254:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.525270:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7434 00000001:00080000:1.0:1762167006.536455:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875701 is committed 00000001:00080000:1.0:1762167006.536475:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875693 is committed 00000001:00080000:3.0:1762167006.536483:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875716 is committed 00000001:00080000:1.0:1762167006.536491:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875717 is committed 00002000:00010000:2.0:1762167006.536492:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 0 -> 205925 00000001:00080000:3.0:1762167006.536495:0:34175:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875713 is committed 00002000:00010000:2.0:1762167006.536498:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 0 -> 1762167006 00002000:00010000:2.0:1762167006.536503:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 0 -> 1762167006 00002000:00010000:2.0:1762167006.536506:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 1 -> 515 00010000:00010000:2.0:1762167006.536520:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.536531:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.536541:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.536548:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.536554:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.536563:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.536583:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.536591:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.536699:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451804032:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13072us (13209us total) trans 17179875717 rc 0/0 00000100:00100000:2.0:1762167006.536709:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2841 00000100:00100000:0.0:1762167006.538198:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.538257:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451804288 00000100:00100000:1.0:1762167006.538265:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451804288 00000100:00100000:1.0:1762167006.538316:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19711 00000100:00100000:1.0:1762167006.538326:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56197:x1847765451804288:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762167006.547588:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952794 is committed 00000001:00080000:2.0:1762167006.547609:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952799 is committed 00000020:00080000:2.0:1762167006.547635:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969180 batchid updated 00000100:00100000:1.0:1762167006.547663:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56197:x1847765451804288:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 9333us (9463us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.547676:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19711 00000020:00080000:0.0:1762167006.547794:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969180 00000020:00080000:0.0:1762167006.547954:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969180 cancel update log [0x200000bd0:0x1:0x0].48: rc = 0 00000020:00080000:0.0:1762167006.547962:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969180 00000100:00100000:3.0:1762167006.548748:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.548792:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.548801:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451804416 00000100:00100000:0.0:1762167006.548812:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451804416 00000100:00100000:2.0:1762167006.548840:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451804544 00000100:00100000:2.0:1762167006.548846:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451804544 00000100:00100000:0.0:1762167006.548860:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16695 00000100:00100000:0.0:1762167006.548871:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451804416:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762167006.548892:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16696 00000100:00100000:1.0:1762167006.548906:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451804544:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:0.0:1762167006.548946:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451804416:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.548954:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16695 00000100:00100000:1.0:1762167006.548961:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451804544:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 58us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.548970:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16696 00000100:00100000:0.0:1762167006.555026:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.555059:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.555093:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451804672 00000100:00100000:1.0:1762167006.555104:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451804672 00000100:00100000:3.0:1762167006.555116:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451804928 00000100:00100000:3.0:1762167006.555123:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451804928 00000100:00100000:0.0:1762167006.555150:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.555172:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451804800 00000100:00100000:1.0:1762167006.555178:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451804800 00000100:00100000:3.0:1762167006.555185:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16697 00000100:00100000:0.0:1762167006.555200:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16698 00000100:00100000:2.0:1762167006.555211:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16699 00000100:00100000:0.0:1762167006.555214:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451804928:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167006.555227:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451804800:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167006.555235:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451804672:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167006.555265:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2bd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.555266:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a2cb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.555266:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2c4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.555288:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.555293:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.555296:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.555296:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.555298:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.555300:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.555301:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.555308:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.555309:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a2cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.555313:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.555336:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.555338:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a2cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.555361:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.555368:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2c4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.555375:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.555376:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a2cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.555381:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.555407:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.555422:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a2cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.555429:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167006.555435:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.555436:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.555440:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a2cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.555460:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.555461:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167006.555462:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167006.555471:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.555472:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a2cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.555477:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.555500:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.555502:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a2bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.555503:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a2cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.555526:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.555532:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a2cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.555535:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.555561:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a2cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.555579:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451804800:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 358us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.555585:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16699 00000100:00100000:0.0:1762167006.555594:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451804928:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 383us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.555607:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16698 00000100:00100000:3.0:1762167006.555608:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451804672:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 408us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.555619:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16697 00000100:00100000:3.0:1762167006.556469:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.556517:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451805184 00000100:00100000:1.0:1762167006.556522:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451805184 00000100:00100000:1.0:1762167006.556553:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19712 00000100:00100000:1.0:1762167006.556559:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56197:x1847765451805184:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167006.556598:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.556618:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0a25b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x649:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35da expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.556633:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee345a77b00) 00010000:00010000:1.0:1762167006.556648:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.556694:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x649:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.556704:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.556712:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:1.0:1762167006.556881:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000024083b92 reply state 000000001c1a0b31 transno 8589952800 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.556889:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167006.556958:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56197:x1847765451805184:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 397us (488us total) trans 8589952800 rc 0/0 00000100:00100000:1.0:1762167006.556965:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19712 00010000:00010000:0.0:1762167006.557557:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.557565:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.557570:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.557577:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.557580:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.557585:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.557591:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:0.0:1762167006.557593:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.557595:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.557599:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a2d2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x649:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167006.557756:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.557829:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451805312 00000100:00100000:1.0:1762167006.557834:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451805312 00000100:00100000:1.0:1762167006.557871:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19713 00000100:00100000:1.0:1762167006.557881:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56197:x1847765451805312:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.557894:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.557907:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a2d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x649:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb360b expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.557944:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb360b expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.557957:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb360b expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.557973:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:1.0:1762167006.557977:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167006.557979:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00000100:00100000:1.0:1762167006.558014:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56197:x1847765451805312:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 135us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.558022:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19713 00000100:00100000:1.0:1762167006.558786:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.558809:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451805440 00000100:00100000:3.0:1762167006.558815:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451805440 00000100:00100000:1.0:1762167006.558823:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.558853:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451805568 00000100:00100000:3.0:1762167006.558857:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451805568 00000100:00100000:0.0:1762167006.558865:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16700 00000100:00100000:0.0:1762167006.558878:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451805440:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167006.558890:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16701 00000100:00100000:3.0:1762167006.558902:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451805568:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762167006.559105:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167006.559110:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 0 -> 1762167006 00002000:00010000:3.0:1762167006.559112:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 0 -> 1762167006 00002000:00010000:3.0:1762167006.559115:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 0 -> 1762167006 00002000:00010000:3.0:1762167006.559117:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167006.559127:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451805440:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 251us (340us total) trans 17179875718 rc 0/0 00000100:00100000:0.0:1762167006.559136:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16700 00000100:00100000:3.0:1762167006.559146:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451805568:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 245us (320us total) trans 21474843250 rc 0/0 00000100:00100000:3.0:1762167006.559155:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16701 00000100:00100000:0.0:1762167006.559959:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.559990:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451805824 00000100:00100000:1.0:1762167006.559996:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451805824 00000100:00100000:1.0:1762167006.560031:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19714 00000100:00100000:1.0:1762167006.560045:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56197:x1847765451805824:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:1.0:1762167006.560084:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a2e0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x649:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.560096:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.560104:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.560121:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.560126:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a2e0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.560132:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a2e0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.560135:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ba00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167006.560137:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a2e0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.560142:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a2e0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.560148:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:1.0:1762167006.560150:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762167006.560152:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a2e0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x649:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.560156:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a2e0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x649:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.560201:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56197:x1847765451805824:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 162us (242us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762167006.560209:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19714 00000100:00100000:1.0:1762167006.560939:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.560969:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451806080 00000100:00100000:0.0:1762167006.560973:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451806080 00000100:00100000:0.0:1762167006.561008:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19715 00000100:00100000:0.0:1762167006.561015:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56197:x1847765451806080:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167006.561044:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.561061:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a200 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35be expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.561077:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:0.0:1762167006.561080:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.561105:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.561114:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.561121:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:0.0:1762167006.561241:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e5f74e4a reply state 0000000014877dd0 transno 8589952801 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167006.561250:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167006.561309:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56197:x1847765451806080:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 293us (370us total) trans 8589952801 rc 0/0 00000100:00100000:0.0:1762167006.561316:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19715 00010000:00010000:2.0:1762167006.561914:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.561924:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.561930:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.561936:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.561939:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.561946:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.561956:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:2.0:1762167006.561959:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.561963:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.561972:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a2e7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.562160:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.562185:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.562214:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.562233:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451806208 00000100:00100000:3.0:1762167006.562238:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451806464 00000100:00100000:0.0:1762167006.562240:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451806208 00000100:00100000:3.0:1762167006.562242:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451806464 00000100:00100000:2.0:1762167006.562262:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451806336 00000100:00100000:2.0:1762167006.562268:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451806336 00000100:00100000:3.0:1762167006.562277:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16702 00000100:00100000:0.0:1762167006.562283:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16703 00000100:00100000:3.0:1762167006.562287:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451806464:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:0.0:1762167006.562289:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451806208:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167006.562297:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16704 00000100:00100000:1.0:1762167006.562309:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451806336:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762167006.562454:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167006.562454:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 205925 -> 205925 00002000:00010000:0.0:1762167006.562458:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.562461:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.562462:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.562464:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.562465:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167005 -> 1762167006 00002000:00010000:3.0:1762167006.562467:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.562467:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167006.562467:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 389 -> 389 00002000:00010000:3.0:1762167006.562474:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167006.562474:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.562480:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167005 -> 1762167006 00002000:00010000:1.0:1762167006.562483:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.562486:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167006.562516:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451806464:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 230us (328us total) trans 21474843252 rc 0/0 00000100:00100000:0.0:1762167006.562516:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451806208:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 225us (356us total) trans 21474843251 rc 0/0 00000100:00100000:1.0:1762167006.562525:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451806336:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 218us (308us total) trans 17179875719 rc 0/0 00000100:00100000:3.0:1762167006.562527:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16702 00000100:00100000:0.0:1762167006.562536:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16703 00000100:00100000:1.0:1762167006.562545:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16704 00000100:00100000:3.0:1762167006.563615:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.563658:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451806720 00000100:00100000:2.0:1762167006.563664:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451806720 00000100:00100000:2.0:1762167006.563697:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7308 00000100:00100000:2.0:1762167006.563703:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56197:x1847765451806720:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167006.563757:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a277 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35ef expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.563803:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.563813:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1c8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a9 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.563818:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.563844:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a9 expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.563853:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a9 expref: 894 pid: 30818 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.563862:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454425600:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.563914:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.564985:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454425600:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.565003:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167006.565010:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.565060:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451806848 00000100:00100000:1.0:1762167006.565066:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451806848 00010000:00010000:1.0:1762167006.565094:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a9 expref: 895 pid: 30818 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1762167006.565131:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7435 00000100:00100000:1.0:1762167006.565141:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451806848:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.565153:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.565159:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a9 expref: 895 pid: 30818 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.565175:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a9 expref: 895 pid: 30818 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.565190:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a1c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35a9 expref: 895 pid: 30818 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.565201:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:1.0:1762167006.565204:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.565210:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.565214:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.565231:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.565253:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.565264:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167006.565268:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451806848:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 129us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.565279:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7435 00010000:00010000:0.0:1762167006.565293:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.565306:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a2d9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb360b expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.565327:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.565354:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb360b expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.565367:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a2d9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb360b expref: 893 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.565379:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454425728:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.565446:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.566174:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454425728:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.566193:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167006.566302:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.566342:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451806976 00000100:00100000:1.0:1762167006.566347:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451806976 00010000:00010000:1.0:1762167006.566368:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a2d9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb360b expref: 894 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1762167006.566412:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7436 00000100:00100000:1.0:1762167006.566421:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765451806976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.566431:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.566436:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a2d9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb360b expref: 894 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.566444:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb360b expref: 894 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.566456:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a2d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x649:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb360b expref: 894 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.566468:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:1.0:1762167006.566472:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.566479:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.566485:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.566507:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.566533:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167006.566533:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2361:x1847765451806976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 114us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.566547:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7436 00010000:00010000:2.0:1762167006.566550:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167006.567032:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454425856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.567062:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.567080:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.567106:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454425856 00000100:00100000:3.0:1762167006.567110:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454425856 00000100:00100000:3.0:1762167006.567138:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1762167006.567143:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454425856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.567196:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454425856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.567202:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:2.0:1762167006.567214:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843240 gen 2 00000004:00080000:2.0:1762167006.567219:0:30820:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843232 committed transno 21474843240 00000004:00080000:2.0:1762167006.567234:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354e300, transno 21474843233 00000004:00080000:2.0:1762167006.567246:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354ed80, transno 21474843234 00000004:00080000:2.0:1762167006.567249:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e473b80, transno 21474843235 00000004:00080000:2.0:1762167006.567251:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354f480, transno 21474843236 00000004:00080000:2.0:1762167006.567254:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354dc00, transno 21474843237 00000004:00080000:2.0:1762167006.567256:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e472680, transno 21474843238 00000004:00080000:2.0:1762167006.567259:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24354d180, transno 21474843239 00000004:00080000:2.0:1762167006.567271:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e472d80, transno 21474843240 00000100:00100000:2.0:1762167006.567282:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454425856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.567324:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454425984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.567351:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.567373:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.567398:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454425984 00000100:00100000:3.0:1762167006.567403:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454425984 00000100:00100000:3.0:1762167006.567430:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1762167006.567439:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454425984:12345-0@lo:1000:mdt_rdpg00_000.0 00000004:00080000:0.0:1762167006.567458:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:3.0:1762167006.567497:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454425984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.567505:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1762167006.567522:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875713 gen 2 00000004:00080000:2.0:1762167006.567527:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb7100, transno 17179875696 00000004:00080000:2.0:1762167006.567540:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc5b100, transno 17179875697 00000004:00080000:2.0:1762167006.567542:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc59500, transno 17179875698 00000004:00080000:2.0:1762167006.567543:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc5bb80, transno 17179875699 00000004:00080000:2.0:1762167006.567546:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc58700, transno 17179875700 00000004:00080000:2.0:1762167006.567547:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc58000, transno 17179875701 00000004:00080000:2.0:1762167006.567549:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc59880, transno 17179875702 00000004:00080000:2.0:1762167006.567551:0:30820:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875705 committed transno 17179875713 00000004:00080000:2.0:1762167006.567562:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825b480, transno 17179875706 00000004:00080000:2.0:1762167006.567565:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825a300, transno 17179875707 00000004:00080000:2.0:1762167006.567567:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258700, transno 17179875708 00000004:00080000:2.0:1762167006.567569:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258380, transno 17179875709 00000004:00080000:2.0:1762167006.567571:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825ad80, transno 17179875710 00000004:00080000:2.0:1762167006.567573:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259880, transno 17179875711 00000004:00080000:2.0:1762167006.567574:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825aa00, transno 17179875712 00000004:00080000:2.0:1762167006.567576:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825a680, transno 17179875713 00000100:00100000:2.0:1762167006.567579:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454425984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.567614:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.567633:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.567650:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.567688:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454426112 00000100:00100000:3.0:1762167006.567693:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454426112 00000004:00080000:1.0:1762167006.567712:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 7 done 00000100:00100000:3.0:1762167006.567722:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1762167006.567729:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.567801:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.567807:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1762167006.567820:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426112:0@lo:1000:mdt_rdpg00_000.0 00000004:00080000:1.0:1762167006.567840:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:2.0:1762167006.567857:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.567875:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.567891:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.567904:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454426240 00000100:00100000:3.0:1762167006.567908:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454426240 00000100:00100000:3.0:1762167006.567925:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1762167006.567929:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.567965:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 36us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.567970:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1762167006.567991:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.568018:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.568034:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.568048:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242943840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.568062:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454426368 00000100:00100000:3.0:1762167006.568066:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454426368 00000100:00100000:3.0:1762167006.568090:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1762167006.568098:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.568149:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.568155:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.568159:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1762167006.568187:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.568201:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.568213:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2429433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.568222:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454426496 00000100:00100000:3.0:1762167006.568225:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454426496 00000100:00100000:3.0:1762167006.568244:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1762167006.568250:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.568297:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 46us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.568303:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:2.0:1762167006.568311:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.568336:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.568351:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.568364:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2429433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.568377:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454426624 00000100:00100000:3.0:1762167006.568382:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454426624 00000100:00100000:3.0:1762167006.568416:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1762167006.568423:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426624:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.568476:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426624:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.568480:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1762167006.568505:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.568524:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.568539:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.568553:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2429433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.568558:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454426752 00000100:00100000:3.0:1762167006.568562:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454426752 00000100:00100000:3.0:1762167006.568578:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1762167006.568582:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.568622:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 38us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.568629:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1762167006.568640:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.568671:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.568691:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167006.568711:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454426880 00000100:00100000:2.0:1762167006.568713:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2429433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.568715:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454426880 00000100:00100000:3.0:1762167006.568734:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1762167006.568738:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.568805:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454426880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.568813:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1762167006.568823:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454426880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.568858:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427008:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.568881:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.568900:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.568910:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454427008 00000100:00100000:3.0:1762167006.568915:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454427008 00000100:00100000:3.0:1762167006.568937:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1762167006.568945:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427008:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.568995:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427008:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.569003:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427008:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.569009:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1762167006.569041:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427136:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.569059:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.569075:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.569086:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454427136 00000100:00100000:3.0:1762167006.569091:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454427136 00000100:00100000:3.0:1762167006.569117:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1762167006.569124:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427136:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.569183:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427136:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 59us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.569190:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427136:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.569192:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1762167006.569223:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.569240:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.569256:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.569266:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454427264 00000100:00100000:3.0:1762167006.569271:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454427264 00000100:00100000:3.0:1762167006.569294:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1762167006.569302:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.569352:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 51us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.569359:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.569360:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1762167006.569411:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.569429:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.569444:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.569454:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454427392 00000100:00100000:3.0:1762167006.569459:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454427392 00000100:00100000:3.0:1762167006.569483:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1762167006.569490:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.569539:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.569547:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1762167006.569547:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.569579:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.569596:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.569611:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.569621:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454427520 00000100:00100000:3.0:1762167006.569626:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454427520 00000100:00100000:3.0:1762167006.569651:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1762167006.569659:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.569704:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 47us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.569709:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1762167006.569715:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.569743:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.569780:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.569798:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.569807:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454427648 00000100:00100000:3.0:1762167006.569811:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454427648 00000100:00100000:3.0:1762167006.569829:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1762167006.569834:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.569878:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.569882:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1762167006.569889:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.569915:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.569932:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.569947:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.569958:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454427776 00000100:00100000:3.0:1762167006.569963:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454427776 00000100:00100000:3.0:1762167006.569988:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1762167006.569995:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.570035:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 41us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.570040:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1762167006.570047:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.570076:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.570094:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167006.570112:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454427904 00000100:00100000:0.0:1762167006.570112:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.570116:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454427904 00000100:00100000:3.0:1762167006.570133:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1762167006.570137:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.570170:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454427904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 32us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.570174:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1762167006.570183:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454427904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.570212:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454428032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.570231:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167006.570248:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454428032 00000100:00100000:0.0:1762167006.570248:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.570253:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454428032 00000100:00100000:3.0:1762167006.570270:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1762167006.570275:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454428032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.570317:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454428032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 41us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.570324:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454428032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.570325:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000040:00080000:0.0:1762167006.570553:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].49, 1000 off62536 00000001:00080000:0.0:1762167006.570560:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952802 00000100:00100000:0.0:1762167006.570607:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454428160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.570629:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.570646:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.570663:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454428160 00000100:00100000:3.0:1762167006.570667:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454428160 00000100:00100000:3.0:1762167006.570685:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1762167006.570689:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454428160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.570927:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454428160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 235us (295us total) trans 21474843253 rc 0/0 00000100:00100000:3.0:1762167006.570934:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1762167006.570939:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24354ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454428160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.570962:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454428288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.570982:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.570998:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.571019:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454428288 00000100:00100000:3.0:1762167006.571023:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454428288 00000100:00100000:3.0:1762167006.571048:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1762167006.571054:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454428288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.571233:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454428288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 177us (249us total) trans 17179875720 rc 0/0 00000100:00100000:0.0:1762167006.571241:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454428288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.571242:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000001:00080000:0.0:1762167006.571314:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952803 00010000:00010000:0.0:1762167006.571336:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571345:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571352:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571358:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.571362:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571368:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571382:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:0.0:1762167006.571396:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762167006.571401:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571407:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a2f5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x649:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571427:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571438:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571444:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571448:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.571451:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571456:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571463:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:0.0:1762167006.571465:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762167006.571468:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571473:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a2ee lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.571483:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23500) 00010000:00010000:0.0:1762167006.571485:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167006.571491:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a277 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35ef expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.571563:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56197:x1847765451806720:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 7860us (7950us total) trans 8589952804 rc 0/0 00000100:00100000:0.0:1762167006.571572:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7308 00000020:00080000:0.0:1762167006.571576:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762167006.572589:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.572631:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451807104 00000100:00100000:0.0:1762167006.572636:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451807104 00000100:00100000:0.0:1762167006.572666:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19716 00000100:00100000:0.0:1762167006.572671:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56197:x1847765451807104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.572683:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.572698:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a2fc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3612 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.572734:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a2fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3612 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.572743:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a2fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3612 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.572754:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167006.572756:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167006.572758:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8e00, rc 0) 00000100:00100000:0.0:1762167006.572803:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56197:x1847765451807104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 131us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.572808:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19716 00000100:00100000:2.0:1762167006.574076:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.574116:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451807360 00000100:00100000:0.0:1762167006.574120:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451807360 00000100:00100000:0.0:1762167006.574151:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7309 00000100:00100000:0.0:1762167006.574159:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56197:x1847765451807360:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167006.574289:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56197:x1847765451807360:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 130us (212us total) trans 8589952805 rc 0/0 00000100:00100000:0.0:1762167006.574296:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7309 00000100:00100000:3.0:1762167006.574939:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.574977:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451807616 00000100:00100000:0.0:1762167006.574983:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451807616 00000100:00100000:0.0:1762167006.575011:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7310 00000100:00100000:0.0:1762167006.575020:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56197:x1847765451807616:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762167006.575175:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x649:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762167006.575245:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x649:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.575258:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.575268:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.575276:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.575283:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.575288:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.575319:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762167006.575336:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167006.575348:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.575356:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.575360:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.575368:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x649:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.575381:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x649:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167006.575394:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762167006.575399:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x649:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.575404:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a303 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x649:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167006.575417:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56197:x1847765451807616:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 398us (477us total) trans 8589952806 rc 0/0 00010000:00010000:2.0:1762167006.575423:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167006.575428:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167006.575428:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7310 00010000:00010000:2.0:1762167006.575433:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167006.583809:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.583852:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451807744 00000100:00100000:0.0:1762167006.583861:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451807744 00000100:00100000:0.0:1762167006.583906:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19717 00000100:00100000:0.0:1762167006.583914:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56198:x1847765451807744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.583935:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.583956:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a30a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3619 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.584016:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a311 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584029:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a311 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584040:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a311 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584054:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a318 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584060:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a318 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584065:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a318 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584190:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584199:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584205:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.584236:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 205925 00000004:00200000:0.0:1762167006.584240:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167006.584257:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584268:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584276:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a311 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584282:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a311 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584288:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a311 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584294:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.584298:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a311 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584306:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a311 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584318:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167006.584321:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.584325:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a311 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584330:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a311 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584342:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a318 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584347:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a318 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584352:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a318 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584357:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.584360:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a318 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584365:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a318 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584371:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167006.584373:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.584375:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a318 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584381:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a318 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.584424:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a30a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3619 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.584438:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3619 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.584445:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167006.584448:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167006.584451:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:0.0:1762167006.584523:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56198:x1847765451807744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 608us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.584531:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19717 00000100:00100000:1.0:1762167006.586528:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.586579:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451808000 00000100:00100000:0.0:1762167006.586588:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451808000 00000100:00100000:0.0:1762167006.586639:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19718 00000100:00100000:0.0:1762167006.586652:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56198:x1847765451808000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.586683:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.586697:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a326 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3620 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.586813:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a32d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.586823:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a32d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.586830:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a32d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.586840:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 205925 00010000:00010000:0.0:1762167006.586962:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a326 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3620 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.586978:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a32d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3620 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.586986:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167006.586989:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762167006.586992:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:0.0:1762167006.587051:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56198:x1847765451808000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 401us (528us total) trans 8589952807 rc 0/0 00000100:00100000:0.0:1762167006.587059:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19718 00000100:00100000:3.0:1762167006.588833:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.588886:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451808256 00000100:00100000:0.0:1762167006.588893:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451808256 00000100:00100000:0.0:1762167006.588941:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19719 00000100:00100000:0.0:1762167006.588961:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56198:x1847765451808256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.588983:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.588996:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a33b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3627 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.589053:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a342 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.589062:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a342 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.589068:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a342 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.589076:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 205925 00010000:00010000:0.0:1762167006.589170:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a33b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3627 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.589186:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a342 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3627 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.589192:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167006.589194:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167006.589196:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:0.0:1762167006.589236:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56198:x1847765451808256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 281us (409us total) trans 8589952808 rc 0/0 00000100:00100000:0.0:1762167006.589242:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19719 00000100:00100000:3.0:1762167006.614383:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.614471:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451808384 00000100:00100000:2.0:1762167006.614482:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451808384 00000100:00100000:2.0:1762167006.614553:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2842 00000100:00100000:2.0:1762167006.614564:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451808384:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167006.614599:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a350 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.614612:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.614614:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.614621:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a350 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.614634:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a350 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.616425:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a350 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.616440:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a350 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.616449:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.616456:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.616460:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.616469:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a350 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.616485:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a350 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.616492:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a350 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.616555:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451808384:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1991us (2179us total) trans 0 rc 205925/205925 00000100:00100000:2.0:1762167006.616565:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2842 00000100:00100000:3.0:1762167006.618844:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.618879:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451808512 00000100:00100000:2.0:1762167006.618887:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451808512 00000100:00100000:2.0:1762167006.618944:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2843 00000100:00100000:2.0:1762167006.618951:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765451808512:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:2.0:1762167006.618988:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81e:0x0] initial LVB size: 205925, mtime: 0x690888de, atime: 0x690888de, ctime: 0x690888de, blocks: 0x203 00010000:00010000:2.0:1762167006.618995:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a357 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.619008:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.619010:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.619014:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a357 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.619023:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a357 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.620636:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a357 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.620655:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a357 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.620663:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.620670:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.620674:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.620681:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a357 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.620698:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a357 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.620705:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a357 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->208895] (req 0->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.620815:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765451808512:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1862us (1976us total) trans 0 rc 205925/205925 00000100:00100000:2.0:1762167006.620823:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2843 00000100:00100000:1.0:1762167006.629442:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.629513:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451808640 00000100:00100000:0.0:1762167006.629525:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451808640 00000100:00100000:0.0:1762167006.629596:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 639 00000100:00100000:0.0:1762167006.629607:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56198:x1847765451808640:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:0.0:1762167006.629622:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.629653:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a342 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3627 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.629672:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167006.629677:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167006.629740:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56198:x1847765451808640:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 134us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.629748:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 639 00000100:00100000:1.0:1762167006.630946:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.630999:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451808896 00000100:00100000:0.0:1762167006.631006:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451808896 00000100:00100000:0.0:1762167006.631045:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7311 00000100:00100000:0.0:1762167006.631053:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56198:x1847765451808896:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167006.631251:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56198:x1847765451808896:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 198us (308us total) trans 8589952809 rc 0/0 00000100:00100000:0.0:1762167006.631260:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7311 00010000:00010000:1.0:1762167006.631960:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167006.633758:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.633856:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451809152 00000100:00100000:0.0:1762167006.633866:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451809152 00000100:00100000:0.0:1762167006.633920:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19720 00000100:00100000:0.0:1762167006.633931:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56065:x1847765451809152:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167006.633952:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.633971:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a35e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb362e expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.634074:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.634093:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3619 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.634101:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.634133:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3619 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.634147:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3619 expref: 903 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.634160:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454428416:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.634244:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.635443:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454428416:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.635480:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167006.635809:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.635888:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451809280 00000100:00100000:0.0:1762167006.635894:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451809280 00010000:00010000:0.0:1762167006.635922:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3619 expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.635960:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7437 00000100:00100000:0.0:1762167006.635973:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2360:x1847765451809280:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167006.635985:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.635991:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3619 expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.636004:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3619 expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.636028:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a31f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3619 expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.636044:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167006.636047:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.636053:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.636058:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.636080:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.636106:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.636115:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167006.636131:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2360:x1847765451809280:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 159us (323us total) trans 0 rc 0/0 00000004:00200000:1.0:1762167006.636144:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 205925 00000100:00100000:0.0:1762167006.636149:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7437 00010000:00010000:1.0:1762167006.636295:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a35e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb362e expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.636318:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb362e expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.636326:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:1.0:1762167006.636329:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762167006.636331:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9e00, rc 0) 00000100:00100000:1.0:1762167006.636379:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451809152:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2450us (2627us total) trans 8589952810 rc 0/0 00000100:00100000:1.0:1762167006.636397:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19720 00000100:00100000:3.0:1762167006.637490:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.637539:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451809408 00000100:00100000:1.0:1762167006.637546:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451809408 00000100:00100000:1.0:1762167006.637597:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19721 00000100:00100000:1.0:1762167006.637606:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451809408:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.637620:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.637633:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a373 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3635 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.637686:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.637694:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb362e expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.637699:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.637719:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb362e expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.637727:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb362e expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1762167006.637736:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243182a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454428544:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167006.637816:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.638744:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243182a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454428544:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167006.638787:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167006.638833:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.638877:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451809536 00000100:00100000:0.0:1762167006.638883:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451809536 00010000:00010000:0.0:1762167006.638906:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb362e expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.638935:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7438 00000100:00100000:0.0:1762167006.638942:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2360:x1847765451809536:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167006.638952:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.638957:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb362e expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.638968:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb362e expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.638986:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a365 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb362e expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.638999:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167006.639004:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.639012:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.639018:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.639047:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167006.639077:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2360:x1847765451809536:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 136us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.639082:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7438 00010000:00010000:1.0:1762167006.639130:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.639138:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167006.639169:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 205925 00000004:00200000:1.0:1762167006.639173:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167006.639190:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.639213:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a373 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3635 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.639230:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3635 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.639249:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:1.0:1762167006.639252:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167006.639255:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ae00, rc 0) 00000100:00100000:1.0:1762167006.639294:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451809408:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1688us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.639301:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19721 00000100:00100000:3.0:1762167006.640830:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.640867:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.640898:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451809664 00000100:00100000:1.0:1762167006.640906:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451809664 00000100:00100000:0.0:1762167006.640940:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451809792 00000100:00100000:0.0:1762167006.640947:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451809792 00000100:00100000:1.0:1762167006.640955:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16705 00000100:00100000:1.0:1762167006.640968:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451809664:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.640984:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762167006.640991:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16706 00000100:00100000:0.0:1762167006.641002:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451809792:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.641007:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a381 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb363c expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.641010:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.641021:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a388 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3643 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167006.641034:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81e:0x0] initial LVB size: 205925, mtime: 0x690888de, atime: 0x690888de, ctime: 0x690888de, blocks: 0x203 00010000:00010000:0.0:1762167006.641041:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.641044:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.641048:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.641052:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.641052:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3643 expref: 25 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.641061:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a381 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb363c expref: 24 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.641074:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3643 expref: 25 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.641087:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a381 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb363c expref: 24 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.641089:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00010000:00010000:1.0:1762167006.641102:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b600, rc 0) 00000100:00100000:0.0:1762167006.641149:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451809792:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 147us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.641150:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451809664:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 181us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.641167:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16706 00000100:00100000:1.0:1762167006.641174:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16705 00000100:00100000:2.0:1762167006.642663:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.642729:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451810048 00000100:00100000:1.0:1762167006.642736:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451810048 00000100:00100000:1.0:1762167006.642809:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19722 00000100:00100000:1.0:1762167006.642820:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451810048:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167006.642874:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.642899:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a37a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3635 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.642920:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:1.0:1762167006.642924:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.643139:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.643155:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.643165:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:1.0:1762167006.643217:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952811 00000004:00010000:1.0:1762167006.643242:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000d62d20e reply state 00000000811a9b24 transno 8589952812 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.643250:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167006.643344:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451810048:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 522us (681us total) trans 8589952812 rc 0/0 00000100:00100000:1.0:1762167006.643353:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19722 00000020:00080000:1.0:1762167006.643358:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167006.644347:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.644361:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.644367:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.644374:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.644378:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.644384:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.644413:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167006.644417:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.644421:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.644426:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a38f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167006.644597:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.644643:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451810304 00000100:00100000:0.0:1762167006.644651:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451810304 00000100:00100000:0.0:1762167006.644694:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7312 00000100:00100000:0.0:1762167006.644703:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451810304:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167006.644918:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451810304:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 215us (322us total) trans 8589952813 rc 0/0 00000100:00100000:0.0:1762167006.644926:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7312 00000100:00100000:3.0:1762167006.645948:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.645994:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451810560 00000100:00100000:1.0:1762167006.645999:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451810560 00000100:00100000:1.0:1762167006.646031:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19723 00000100:00100000:1.0:1762167006.646037:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451810560:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.646049:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.646051:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762167006.646068:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a32d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3620 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.646080:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a2fc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3612 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.646086:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:1.0:1762167006.646094:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.646103:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a396 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb364a expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.646132:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a39d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.646140:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a39d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.646146:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a39d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000040:00080000:1.0:1762167006.646591:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5393, 88 off434968 00000004:00080000:1.0:1762167006.646597:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627438834572ns, next at 626774750597ns, rc = 0 00000040:00080000:1.0:1762167006.646629:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5401, 88 off436024 00000004:00080000:1.0:1762167006.646632:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627438869088ns, next at 626774785189ns, rc = 0 00000040:00080000:1.0:1762167006.646667:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5402, 88 off436112 00000004:00080000:1.0:1762167006.646673:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627438909848ns, next at 626774785189ns, rc = 0 00000040:00080000:1.0:1762167006.646699:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5394, 88 off435056 00000004:00080000:1.0:1762167006.646705:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627438942768ns, next at 626774750597ns, rc = 0 00000040:00080000:1.0:1762167006.646737:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5403, 88 off436200 00000004:00080000:1.0:1762167006.646742:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627438979151ns, next at 626774785189ns, rc = 0 00000040:00080000:1.0:1762167006.646804:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5395, 88 off435144 00000004:00080000:1.0:1762167006.646809:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627439046375ns, next at 626774750597ns, rc = 0 00000040:00080000:1.0:1762167006.646834:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5396, 88 off435232 00000004:00080000:1.0:1762167006.646838:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627439075230ns, next at 626774750597ns, rc = 0 00000040:00080000:1.0:1762167006.646864:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5404, 88 off436288 00000004:00080000:1.0:1762167006.646869:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627439106662ns, next at 626774785189ns, rc = 0 00000040:00080000:1.0:1762167006.646901:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5405, 88 off436376 00000004:00080000:1.0:1762167006.646907:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627439144682ns, next at 626774785189ns, rc = 0 00000040:00080000:1.0:1762167006.646934:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5397, 88 off435320 00000004:00080000:1.0:1762167006.646938:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627439175575ns, next at 626774750597ns, rc = 0 00000040:00080000:1.0:1762167006.646964:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5406, 88 off436464 00000004:00080000:1.0:1762167006.646970:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627439206587ns, next at 626774785189ns, rc = 0 00000040:00080000:1.0:1762167006.647004:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5398, 88 off435408 00000004:00080000:1.0:1762167006.647008:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627439245566ns, next at 626774750597ns, rc = 0 00000040:00080000:1.0:1762167006.647032:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5407, 88 off436552 00000004:00080000:1.0:1762167006.647036:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627439273146ns, next at 626774785189ns, rc = 0 00000040:00080000:1.0:1762167006.647059:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5399, 88 off435496 00000004:00080000:1.0:1762167006.647063:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627439300432ns, next at 626774750597ns, rc = 0 00000040:00080000:1.0:1762167006.647098:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5400, 88 off435584 00000004:00080000:1.0:1762167006.647102:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627439339591ns, next at 626774750597ns, rc = 0 00000040:00080000:1.0:1762167006.647125:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5408, 88 off436640 00000004:00080000:1.0:1762167006.647130:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627439367446ns, next at 626774785189ns, rc = 0 00000040:00080000:1.0:1762167006.647158:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5409, 88 off436728 00000004:00080000:1.0:1762167006.647165:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627439401176ns, next at 626774785189ns, rc = 0 00000040:00080000:1.0:1762167006.647205:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5401, 88 off435672 00000004:00080000:1.0:1762167006.647210:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627439447066ns, next at 626774750597ns, rc = 0 00010000:00010000:2.0:1762167006.658923:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a39d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb364a expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.658952:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:2.0:1762167006.658956:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762167006.658975:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a396 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb364a expref: 906 pid: 32138 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1762167006.658995:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a39d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb364a expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.659027:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:2.0:1762167006.659031:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762167006.659033:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a600, rc 0) 00000100:00100000:2.0:1762167006.659103:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451810560:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 13063us (13155us total) trans 8589952814 rc 0/0 00000100:00100000:2.0:1762167006.659114:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19723 00000001:00080000:2.0:1762167006.659163:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952813 is committed 00000020:00080000:2.0:1762167006.659189:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee37f4e7840 refcount 2 committed 0 result 0 batchid 4294969181 00000020:00080000:2.0:1762167006.659193:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee381dabd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37f4e7cc0 00000020:00080000:2.0:1762167006.659197:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee381dab500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37f4e73c0 00000020:00080000:2.0:1762167006.659202:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee381dab200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee342b8d000 00000020:00080000:2.0:1762167006.659205:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].49 00000001:00080000:2.0:1762167006.659235:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952814 is committed 00000004:00080000:2.0:1762167006.659239:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3509 committed 00000020:00080000:0.0:1762167006.659253:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969181 committed batchid 4294969180 00000004:00080000:2.0:1762167006.659254:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3522 committed 00000004:00080000:2.0:1762167006.659271:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3521 committed 00000004:00080000:2.0:1762167006.659276:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3508 committed 00000004:00080000:2.0:1762167006.659278:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3507 committed 00000004:00080000:2.0:1762167006.659281:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3520 committed 00000004:00080000:2.0:1762167006.659285:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3506 committed 00000004:00080000:2.0:1762167006.659288:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3519 committed 00000004:00080000:2.0:1762167006.659290:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3505 committed 00000004:00080000:2.0:1762167006.659294:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3518 committed 00000004:00080000:2.0:1762167006.659296:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3517 committed 00000004:00080000:2.0:1762167006.659299:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3504 committed 00000004:00080000:2.0:1762167006.659303:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3503 committed 00000004:00080000:2.0:1762167006.659306:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3516 committed 00000004:00080000:2.0:1762167006.659309:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3502 committed 00000004:00080000:2.0:1762167006.659312:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3515 committed 00000004:00080000:2.0:1762167006.659317:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3514 committed 00000004:00080000:2.0:1762167006.659321:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3501 committed 00000100:00100000:2.0:1762167006.659502:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454428928:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1762167006.659523:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969180 00000100:00100000:1.0:1762167006.659539:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454428672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.659562:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167006.659588:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454428800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.659607:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454428928 00000100:00100000:2.0:1762167006.659612:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454429440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167006.659616:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454428928 00000100:00100000:1.0:1762167006.659626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.659662:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454428800 00000100:00100000:2.0:1762167006.659667:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.659668:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454428800 00000100:00100000:1.0:1762167006.659669:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454429312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.659698:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454429952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.659705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.659705:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454429440 00000100:00100000:0.0:1762167006.659711:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454429440 00000100:00100000:1.0:1762167006.659736:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454429824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167006.659738:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454429312 00000100:00100000:2.0:1762167006.659739:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.659745:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454429312 00000100:00100000:2.0:1762167006.659791:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454430464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.659795:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454429952 00000100:00100000:1.0:1762167006.659797:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.659802:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454429952 00000100:00100000:1.0:1762167006.659821:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454430336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.659823:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454429824 00000100:00100000:0.0:1762167006.659828:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454429824 00000100:00100000:2.0:1762167006.659829:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.659848:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1762167006.659852:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454430464 00000100:00100000:0.0:1762167006.659856:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454430464 00000100:00100000:2.0:1762167006.659858:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454429056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167006.659866:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.659874:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454430336 00000100:00100000:0.0:1762167006.659879:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454430336 00000100:00100000:1.0:1762167006.659888:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1762167006.659894:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167006.659899:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454430208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.659900:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16707 00000100:00100000:2.0:1762167006.659912:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454429568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167006.659915:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454428928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.659933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.659948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.659966:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454430080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167006.659970:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454429056 00000100:00100000:1.0:1762167006.659975:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454429056 00000100:00100000:2.0:1762167006.659993:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167006.660003:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454430208 00000100:00100000:1.0:1762167006.660007:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454430208 00000100:00100000:2.0:1762167006.660008:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454430592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.660026:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454429568 00000100:00100000:1.0:1762167006.660030:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454429568 00000100:00100000:2.0:1762167006.660035:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167006.660050:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454430080 00000100:00100000:1.0:1762167006.660053:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454430080 00000100:00100000:2.0:1762167006.660065:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454430592 00000100:00100000:2.0:1762167006.660071:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454430592 00000100:00100000:1.0:1762167006.660074:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16708 00000100:00100000:1.0:1762167006.660084:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454428800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167006.660103:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16709 00000100:00100000:2.0:1762167006.660112:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454429440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167006.660149:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167006.660154:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.660157:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.660161:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.660163:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167006.660167:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16710 00000100:00100000:3.0:1762167006.660181:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454429312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167006.660210:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454428928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 299us (651us total) trans 17179875721 rc 0/0 00000100:00100000:0.0:1762167006.660219:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16707 00000100:00100000:0.0:1762167006.660242:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16711 00000100:00100000:0.0:1762167006.660252:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454429952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167006.660263:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.660268:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167006.660271:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167006.660273:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167006.660275:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167006.660280:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167006.660284:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167006.660287:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167006.660290:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.660293:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x815:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167006.660319:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454428800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (700us total) trans 17179875722 rc 0/0 00000100:00100000:1.0:1762167006.660329:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16708 00000100:00100000:2.0:1762167006.660337:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454429440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (671us total) trans 21474843254 rc 0/0 00000100:00100000:2.0:1762167006.660347:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16709 00000100:00100000:1.0:1762167006.660354:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16712 00000100:00100000:1.0:1762167006.660366:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454429824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.660371:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16713 00000100:00100000:2.0:1762167006.660381:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454430464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167006.660403:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454429312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (701us total) trans 21474843255 rc 0/0 00002000:00010000:0.0:1762167006.660405:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167006.660412:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00000100:00100000:3.0:1762167006.660417:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16710 00002000:00010000:0.0:1762167006.660417:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167006.660423:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.660426:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167006.660441:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16714 00000100:00100000:3.0:1762167006.660452:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454430336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.660463:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454429952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (732us total) trans 17179875723 rc 0/0 00000100:00100000:0.0:1762167006.660471:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16711 00000100:00100000:0.0:1762167006.660486:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16715 00000100:00100000:0.0:1762167006.660496:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454429056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167006.660518:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.660522:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.660525:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167006.660528:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.660530:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167006.660569:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454429824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (775us total) trans 21474843256 rc 0/0 00000100:00100000:1.0:1762167006.660578:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16712 00000100:00100000:2.0:1762167006.660582:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454430464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (752us total) trans 17179875724 rc 0/0 00000100:00100000:2.0:1762167006.660588:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16713 00000100:00100000:1.0:1762167006.660600:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16716 00000100:00100000:2.0:1762167006.660614:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16717 00000100:00100000:1.0:1762167006.660615:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454430208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167006.660623:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 154055 -> 154055 00000100:00100000:2.0:1762167006.660628:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454429568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167006.660630:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.660636:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167006.660639:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.660642:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167006.660652:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167006.660657:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.660661:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.660665:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.660667:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167006.660678:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454430336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (815us total) trans 17179875725 rc 0/0 00000100:00100000:3.0:1762167006.660685:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16714 00000100:00100000:3.0:1762167006.660704:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16718 00000100:00100000:0.0:1762167006.660710:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454429056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (816us total) trans 21474843257 rc 0/0 00000100:00100000:3.0:1762167006.660716:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454430080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167006.660724:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16715 00000100:00100000:0.0:1762167006.660745:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16719 00000100:00100000:0.0:1762167006.660756:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454430592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167006.660802:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167006.660806:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.660809:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167006.660811:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.660815:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167006.660827:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454430208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (893us total) trans 17179875726 rc 0/0 00000100:00100000:1.0:1762167006.660838:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16716 00000100:00100000:2.0:1762167006.660856:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454429568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 231us (907us total) trans 21474843258 rc 0/0 00000100:00100000:2.0:1762167006.660864:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16717 00000100:00100000:1.0:1762167006.660871:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.660884:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454428672 00000100:00100000:2.0:1762167006.660889:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454428672 00000100:00100000:1.0:1762167006.660902:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454429184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.660916:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16720 00002000:00010000:0.0:1762167006.660917:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167006.660922:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167006.660928:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167006.660929:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454428672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167006.660930:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454430080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 214us (933us total) trans 21474843259 rc 0/0 00002000:00010000:0.0:1762167006.660934:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:1.0:1762167006.660942:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167006.660943:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167006.660948:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16718 00000100:00100000:1.0:1762167006.660965:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454429696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167006.660967:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454429184 00000100:00100000:3.0:1762167006.660972:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454429184 00000100:00100000:0.0:1762167006.660991:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454430592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (954us total) trans 17179875727 rc 0/0 00000100:00100000:3.0:1762167006.660998:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16721 00000100:00100000:1.0:1762167006.661003:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.661009:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16719 00000100:00100000:3.0:1762167006.661011:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454429184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167006.661034:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454429696 00000100:00100000:0.0:1762167006.661039:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454429696 00002000:00010000:2.0:1762167006.661052:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 205925 -> 205925 00002000:00010000:2.0:1762167006.661057:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.661059:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000004:00080000:1.0:1762167006.661061:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258380/2, rc 0, transno 17179875726 00000100:00100000:0.0:1762167006.661063:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16722 00002000:00010000:2.0:1762167006.661065:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.661070:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 389 -> 389 00000100:00100000:0.0:1762167006.661074:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454429696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.661080:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454430208:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167006.661095:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f402300/2, rc 0, transno 17179875722 00000100:00100000:1.0:1762167006.661099:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454428800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167006.661112:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243181500/2, rc 0, transno 21474843255 00000100:00100000:2.0:1762167006.661117:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454428672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (245us total) trans 21474843260 rc 0/0 00000100:00100000:1.0:1762167006.661121:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454429312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.661130:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16720 00000004:00080000:1.0:1762167006.661131:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180380/2, rc 0, transno 21474843256 00000100:00100000:1.0:1762167006.661137:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454429824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167006.661148:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825ad80/2, rc 0, transno 17179875725 00000100:00100000:1.0:1762167006.661151:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454430336:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167006.661173:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243182a00/2, rc 0, transno 21474843260 00000100:00100000:1.0:1762167006.661177:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454428672:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167006.661217:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167006.661221:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.661224:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167006.661226:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.661229:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167006.661248:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1762167006.661248:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454429696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 174us (247us total) trans 17179875728 rc 0/0 00000100:00100000:1.0:1762167006.661260:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454430720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167006.661260:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16722 00000100:00100000:3.0:1762167006.661266:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454429184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 257us (327us total) trans 21474843261 rc 0/0 00000100:00100000:3.0:1762167006.661274:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16721 00000100:00100000:1.0:1762167006.661291:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.661309:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454430720 00000100:00100000:0.0:1762167006.661314:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454430720 00000100:00100000:0.0:1762167006.661344:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16723 00000100:00100000:0.0:1762167006.661353:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454430720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.661354:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454430848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167006.661377:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.661403:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451810688 00000100:00100000:1.0:1762167006.661409:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451810688 00000100:00100000:1.0:1762167006.661439:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16724 00000100:00100000:1.0:1762167006.661449:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56065:x1847765451810688:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167006.661459:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.661474:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3651 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167006.661476:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 205925 -> 205925 00002000:00010000:0.0:1762167006.661484:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.661491:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.661493:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.661496:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00010000:00010000:1.0:1762167006.661505:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a2a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35f6 expref: 26 pid: 7858 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1762167006.661512:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243181c00/2, rc 0, transno 21474843261 00010000:00010000:1.0:1762167006.661515:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762167006.661517:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454429184:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762167006.661518:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.661522:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.661531:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454430720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (240us total) trans 17179875729 rc 0/0 00000004:00080000:2.0:1762167006.661532:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825a300/2, rc 0, transno 17179875728 00000100:00100000:2.0:1762167006.661540:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454429696:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762167006.661547:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a2a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35f6 expref: 26 pid: 7858 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167006.661547:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16723 00010000:00010000:1.0:1762167006.661564:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a2a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35f6 expref: 26 pid: 7858 timeout: 727 lvb_type: 1 00000100:00100000:1.0:1762167006.661577:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454430976:192.168.203.35@tcp:104: 00000004:00080000:0.0:1762167006.661591:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243183480/2, rc 0, transno 21474843257 00000100:00100000:0.0:1762167006.661595:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454429056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167006.661602:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243181880/2, rc 0, transno 21474843258 00000100:00100000:0.0:1762167006.661604:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454429568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167006.661610:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243181f80/2, rc 0, transno 21474843259 00000100:00100000:0.0:1762167006.661612:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454430080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167006.661618:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825aa00/2, rc 0, transno 17179875727 00000100:00100000:0.0:1762167006.661620:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454430592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167006.661631:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258700/2, rc 0, transno 17179875723 00000100:00100000:0.0:1762167006.661634:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454429952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.661635:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9e40 going to sleep for 11 seconds 00000004:00080000:0.0:1762167006.661648:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348259880/2, rc 0, transno 17179875724 00000100:00100000:0.0:1762167006.661651:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454430464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.661656:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167006.661664:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825b480/2, rc 0, transno 17179875721 00000100:00100000:0.0:1762167006.661667:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454428928:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167006.661676:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243183b80/2, rc 0, transno 21474843254 00000100:00100000:0.0:1762167006.661679:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454429440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.661695:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454430848 00000004:00080000:1.0:1762167006.661696:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aa8a80/2, rc 0, transno 17179875729 00000100:00100000:2.0:1762167006.661700:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454430848 00000100:00100000:1.0:1762167006.661701:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454430720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167006.661744:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16725 00000100:00100000:1.0:1762167006.661752:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454430848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167006.661867:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.661871:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.661873:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.661875:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.661877:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167006.661914:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454430848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (259us total) trans 21474843262 rc 0/0 00000100:00100000:1.0:1762167006.661920:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16725 00000004:00080000:2.0:1762167006.661960:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aa8000/2, rc 0, transno 21474843262 00000100:00100000:2.0:1762167006.661965:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454430848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167006.662521:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454430976:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.662542:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.662557:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a000, rc 0) 00000100:00100000:2.0:1762167006.662594:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56065:x1847765451810688:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1146us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.662600:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16724 00000100:00100000:3.0:1762167006.662847:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.662886:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451810816 00000100:00100000:0.0:1762167006.662891:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451810816 00010000:00010000:0.0:1762167006.662916:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a2a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35f6 expref: 26 pid: 7858 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1762167006.662949:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7439 00000100:00100000:0.0:1762167006.662958:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451810816:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167006.662969:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.662981:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a2a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35f6 expref: 26 pid: 7858 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.662990:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a2a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35f6 expref: 26 pid: 7858 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.663005:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a2a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35f6 expref: 26 pid: 7858 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.663015:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.663016:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.663021:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 25 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.663027:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 25 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.663053:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 25 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.663064:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454431104:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167006.663114:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.664209:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.664232:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454431104:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762167006.664253:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.664264:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451810944 00000100:00100000:2.0:1762167006.664271:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451810944 00000100:00100000:0.0:1762167006.664298:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451810816:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1340us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.664314:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7439 00000100:00100000:2.0:1762167006.664325:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16726 00000100:00100000:2.0:1762167006.664339:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56065:x1847765451810944:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167006.664354:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.664369:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3658 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.664405:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a29a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35fd expref: 25 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.664413:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.664416:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.664420:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 25 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.664447:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a29a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35fd expref: 25 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.664459:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a29a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35fd expref: 25 pid: 12400 timeout: 727 lvb_type: 1 00000100:00100000:2.0:1762167006.664470:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454431232:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.664522:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242943180 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.665513:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454431232:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.665538:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 25 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.665556:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:2.0:1762167006.665598:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56065:x1847765451810944:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1263us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.665605:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16726 00000100:00100000:3.0:1762167006.665993:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.666047:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451811072 00000100:00100000:0.0:1762167006.666054:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451811072 00010000:00010000:0.0:1762167006.666079:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a29a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35fd expref: 25 pid: 12400 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1762167006.666113:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7440 00000100:00100000:0.0:1762167006.666120:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451811072:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167006.666129:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.666146:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a29a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35fd expref: 25 pid: 12400 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.666158:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a29a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35fd expref: 25 pid: 12400 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.666178:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a29a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35fd expref: 25 pid: 12400 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.666196:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.666198:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.666204:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.666214:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.666240:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.666253:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454431360:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167006.666307:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.667265:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454431360:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762167006.667279:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167006.667316:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451811072:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1195us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.667327:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7440 00000100:00100000:3.0:1762167006.667415:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.667460:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451811200 00000100:00100000:2.0:1762167006.667465:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451811200 00000100:00100000:2.0:1762167006.667495:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16727 00000100:00100000:2.0:1762167006.667501:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56065:x1847765451811200:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167006.667510:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.667521:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb365f expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.667540:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a2a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3604 expref: 26 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.667547:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.667549:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.667553:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.667576:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3604 expref: 26 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.667588:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a2a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3604 expref: 26 pid: 7858 timeout: 727 lvb_type: 1 00000100:00100000:2.0:1762167006.667598:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454431488:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.667645:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242943180 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.668485:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454431488:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.668505:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.668519:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:2.0:1762167006.668559:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56065:x1847765451811200:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1056us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.668567:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16727 00000100:00100000:3.0:1762167006.668682:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.668746:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451811328 00000100:00100000:0.0:1762167006.668753:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451811328 00010000:00010000:0.0:1762167006.668800:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a2a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3604 expref: 26 pid: 7858 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1762167006.668828:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7441 00000100:00100000:0.0:1762167006.668835:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451811328:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167006.668844:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.668863:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a2a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3604 expref: 26 pid: 7858 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.668875:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3604 expref: 26 pid: 7858 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.668893:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a2a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3604 expref: 26 pid: 7858 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167006.668907:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.668908:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.668914:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 25 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.668923:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 25 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.668947:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 25 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.668959:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454431616:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167006.669010:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e7540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.669886:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454431616:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762167006.669897:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167006.669924:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451811328:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1090us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.669930:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7441 00000100:00100000:1.0:1762167006.670636:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.670670:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.670692:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451811584 00000100:00100000:2.0:1762167006.670698:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451811584 00000100:00100000:1.0:1762167006.670704:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:2.0:1762167006.670724:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:2.0:1762167006.670730:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa9f80 with x1847765451811584 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167006.670730:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451811712 00000100:00100000:0.0:1762167006.670737:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451811712 00002000:00010000:2.0:1762167006.670742:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee346aa9f80. 00002000:00010000:0.0:1762167006.670755:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:0.0:1762167006.670760:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa8700 with x1847765451811712 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167006.670792:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aa8700. 00000100:00100000:2.0:1762167006.670798:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451811456 00000100:00100000:2.0:1762167006.670803:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451811456 00000100:00100000:3.0:1762167006.670805:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2844 00000100:00100000:1.0:1762167006.670816:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2845 00002000:00010000:2.0:1762167006.670818:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (218281->18446744073709551615) 00000100:00100000:3.0:1762167006.670822:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451811584:12345-192.168.203.35@tcp:10:fsx.0 00002000:00100000:2.0:1762167006.670824:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa8e00 with x1847765451811456 ext(218281->18446744073709551615) 00000100:00100000:1.0:1762167006.670834:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451811712:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:2.0:1762167006.670835:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aa8e00. 00000100:00100000:2.0:1762167006.670864:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2846 00000100:00100000:2.0:1762167006.670872:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451811456:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167006.671112:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167006.671115:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.671117:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.671118:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 205925 -> 218281 00002000:00010000:3.0:1762167006.671121:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.671125:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.671126:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.671128:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.671132:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.671135:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.671135:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.671137:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167006.671141:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.671144:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167006.671146:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 389 -> 389 00000100:00100000:1.0:1762167006.671186:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451811712:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 360us (514us total) trans 21474843263 rc 0/0 00000100:00100000:3.0:1762167006.671197:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451811584:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 379us (560us total) trans 17179875730 rc 0/0 00000100:00100000:1.0:1762167006.671199:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2845 00000100:00100000:2.0:1762167006.671200:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451811456:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 324us (492us total) trans 21474843264 rc 0/0 00002000:00010000:1.0:1762167006.671206:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167006.671213:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa8700 with x1847765451811712 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167006.671221:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2846 00002000:00010000:1.0:1762167006.671223:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aa8700. 00002000:00010000:2.0:1762167006.671226:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (218281->18446744073709551615) 00000100:00100000:3.0:1762167006.671230:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2844 00002000:00100000:2.0:1762167006.671232:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa8e00 with x1847765451811456 ext(218281->18446744073709551615) 00002000:00010000:3.0:1762167006.671237:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167006.671243:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa9f80 with x1847765451811584 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167006.671248:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aa8e00. 00002000:00010000:3.0:1762167006.671252:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee346aa9f80. 00000100:00100000:3.0:1762167006.672447:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.672503:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451811840 00000100:00100000:2.0:1762167006.672510:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451811840 00000100:00100000:2.0:1762167006.672548:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19724 00000100:00100000:2.0:1762167006.672558:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451811840:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167006.672584:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.672615:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a3b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3666 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.672697:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3c0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.672712:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.672723:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.672749:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 218283 00000004:00200000:2.0:1762167006.672753:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167006.672797:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.672824:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a3b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3666 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.672841:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3666 expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.672849:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:2.0:1762167006.672851:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167006.672854:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:2.0:1762167006.672904:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451811840:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 348us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.672910:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19724 00000100:00100000:0.0:1762167006.674825:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.674875:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451812096 00000100:00100000:2.0:1762167006.674884:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451812096 00000100:00100000:2.0:1762167006.674932:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19725 00000100:00100000:2.0:1762167006.674942:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451812096:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167006.674989:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762167006.675013:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3c0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3666 expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.675032:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a39d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb364a expref: 890 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.675043:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77900) 00010000:00010000:2.0:1762167006.675055:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.675304:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.675316:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.675324:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:2.0:1762167006.675404:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952815 00000004:00010000:2.0:1762167006.675431:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008994ae10 reply state 000000009ea5fbee transno 8589952816 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167006.675440:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167006.675526:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451812096:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 585us (706us total) trans 8589952816 rc 0/0 00000100:00100000:2.0:1762167006.675533:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19725 00000020:00080000:2.0:1762167006.675539:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167006.676315:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.676326:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.676337:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.676343:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.676347:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.676354:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.676364:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:2.0:1762167006.676367:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.676371:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.676378:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3c7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167006.676562:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.676617:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451812224 00000100:00100000:2.0:1762167006.676628:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451812224 00000100:00100000:2.0:1762167006.676666:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19726 00000100:00100000:2.0:1762167006.676674:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451812224:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167006.676701:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.676716:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a3ce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb366d expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.676786:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a3ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb366d expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.676806:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a3ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb366d expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.676828:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.676831:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167006.676834:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167006.676880:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451812224:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 206us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.676887:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19726 00000100:00100000:1.0:1762167006.678682:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.678715:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.678735:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451812352 00000100:00100000:3.0:1762167006.678742:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451812352 00000100:00100000:2.0:1762167006.678785:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451812480 00000100:00100000:2.0:1762167006.678791:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451812480 00002000:00010000:3.0:1762167006.678799:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (26859->18446744073709551615) 00002000:00100000:3.0:1762167006.678805:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aaa680 with x1847765451812352 ext(26859->18446744073709551615) 00002000:00010000:2.0:1762167006.678810:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:1.0:1762167006.678810:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:3.0:1762167006.678816:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aaa680. 00002000:00100000:2.0:1762167006.678822:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa8380 with x1847765451812480 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167006.678832:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee346aa8380. 00000100:00100000:3.0:1762167006.678836:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451812608 00000100:00100000:3.0:1762167006.678841:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451812608 00002000:00010000:3.0:1762167006.678854:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167006.678858:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01180 with x1847765451812608 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167006.678863:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2847 00002000:00010000:3.0:1762167006.678865:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de01180. 00000100:00100000:2.0:1762167006.678874:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2848 00000100:00100000:0.0:1762167006.678880:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451812352:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167006.678888:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451812480:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167006.678892:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2849 00000100:00100000:1.0:1762167006.678906:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451812608:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167006.679161:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167006.679162:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.679168:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.679169:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.679174:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.679175:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.679181:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.679182:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.679189:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167006.679189:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167006.679246:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451812608:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 344us (435us total) trans 21474843265 rc 0/0 00000100:00100000:2.0:1762167006.679254:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451812480:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 367us (534us total) trans 17179875731 rc 0/0 00000100:00100000:1.0:1762167006.679263:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2849 00002000:00010000:0.0:1762167006.679264:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 218281 -> 26859 00002000:00010000:0.0:1762167006.679269:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167006.679270:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:0.0:1762167006.679272:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167006.679274:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2848 00002000:00100000:1.0:1762167006.679278:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01180 with x1847765451812608 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167006.679278:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167006.679281:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:0.0:1762167006.679284:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 389 -> 389 00002000:00010000:1.0:1762167006.679288:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de01180. 00002000:00100000:2.0:1762167006.679290:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa8380 with x1847765451812480 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167006.679299:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee346aa8380. 00000100:00100000:0.0:1762167006.679315:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451812352:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 441us (638us total) trans 21474843266 rc 0/0 00000100:00100000:0.0:1762167006.679323:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2847 00002000:00010000:0.0:1762167006.679327:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (26859->18446744073709551615) 00002000:00100000:0.0:1762167006.679330:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aaa680 with x1847765451812352 ext(26859->18446744073709551615) 00002000:00010000:0.0:1762167006.679335:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aaa680. 00000100:00100000:3.0:1762167006.680449:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.680498:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451812736 00000100:00100000:2.0:1762167006.680506:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451812736 00000100:00100000:2.0:1762167006.680544:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19727 00000100:00100000:2.0:1762167006.680550:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451812736:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167006.680561:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.680574:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a3d5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3674 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.680631:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.680644:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.680655:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.680677:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00000004:00200000:2.0:1762167006.680680:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167006.680693:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.680710:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a3d5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3674 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.680721:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3674 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.680726:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.680729:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167006.680740:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167006.680827:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451812736:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 275us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.680836:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19727 00000100:00100000:3.0:1762167006.682992:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.683189:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451812864 00000100:00100000:0.0:1762167006.683198:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451812864 00002000:00100000:0.0:1762167006.683238:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->28671) req@ffff9ee348258000 x1847765451812864/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167006.683255:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348258000 with x1847765451812864 ext(24576->28671) 00002000:00010000:0.0:1762167006.683260:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348258000 00000100:00100000:0.0:1762167006.683290:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2850 00000100:00100000:0.0:1762167006.683298:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451812864:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167006.683526:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451812864:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 228us (540us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167006.683534:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2850 00002000:00100000:0.0:1762167006.683541:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->28671) req@ffff9ee348258000 x1847765451812864/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/4536 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167006.683550:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348258000 with x1847765451812864 ext(24576->28671) 00002000:00010000:0.0:1762167006.683553:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348258000 00000100:00100000:1.0:1762167006.686008:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.686068:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451812992 00000100:00100000:0.0:1762167006.686075:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451812992 00002000:00100000:0.0:1762167006.686106:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (0->24575) req@ffff9ee36de02300 x1847765451812992/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/0 e 0 to 0 dl 1762167017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167006.686114:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de02300 with x1847765451812992 ext(0->24575) 00002000:00010000:0.0:1762167006.686118:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de02300 00000100:00100000:0.0:1762167006.686139:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2851 00000100:00100000:0.0:1762167006.686145:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451812992:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167006.687250:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451812992:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1100us (1245us total) trans 0 rc 24576/24576 00000100:00100000:0.0:1762167006.687260:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2851 00002000:00100000:0.0:1762167006.687270:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (0->24575) req@ffff9ee36de02300 x1847765451812992/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:37/0 lens 488/440 e 0 to 0 dl 1762167017 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167006.687281:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de02300 with x1847765451812992 ext(0->24575) 00002000:00010000:0.0:1762167006.687286:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de02300 00000100:00100000:3.0:1762167006.691503:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.691581:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451813248 00000100:00100000:0.0:1762167006.691591:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451813248 00000100:00100000:0.0:1762167006.691652:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7313 00000100:00100000:0.0:1762167006.691662:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451813248:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167006.692006:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451813248:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 344us (511us total) trans 8589952817 rc 0/0 00000100:00100000:0.0:1762167006.692015:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7313 00000100:00100000:1.0:1762167006.701053:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.701109:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451813504 00000100:00100000:2.0:1762167006.701118:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451813504 00000100:00100000:2.0:1762167006.701174:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19728 00000100:00100000:2.0:1762167006.701185:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56199:x1847765451813504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.701208:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.701227:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a3e3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb367b expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.701329:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3ea lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701340:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3ea lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701349:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3ea lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701359:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3f1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701363:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701367:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701496:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a3f8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701503:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701507:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.701514:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:2.0:1762167006.701607:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3ea lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701615:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3ea lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701622:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3ea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701627:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.701630:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3ea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701635:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3ea lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701645:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167006.701647:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.701652:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3ea lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701658:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a3ea lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701670:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701680:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3f1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701685:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701690:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.701693:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701699:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3f1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701705:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0200) 00010000:00010000:2.0:1762167006.701707:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.701710:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3f1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701715:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a3f1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.701747:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a3e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb367b expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.701759:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb367b expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.701808:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.701810:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167006.701811:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167006.701859:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56199:x1847765451813504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 673us (811us total) trans 8589952818 rc 0/0 00000100:00100000:2.0:1762167006.701865:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19728 00000100:00100000:3.0:1762167006.703189:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.703253:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451813632 00000100:00100000:0.0:1762167006.703260:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451813632 00000100:00100000:0.0:1762167006.703313:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 640 00000100:00100000:0.0:1762167006.703323:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765451813632:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167006.703338:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.703358:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a3f8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb367b expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.703374:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:0.0:1762167006.703401:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167006.703447:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765451813632:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 126us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.703454:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 640 00000100:00100000:3.0:1762167006.703690:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.703739:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451813888 00000100:00100000:0.0:1762167006.703743:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451813888 00000100:00100000:0.0:1762167006.703803:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7314 00000100:00100000:0.0:1762167006.703867:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56199:x1847765451813888:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167006.704036:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56199:x1847765451813888:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 176us (346us total) trans 8589952819 rc 0/0 00000100:00100000:0.0:1762167006.704043:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7314 00000100:00100000:1.0:1762167006.705329:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.705381:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451814144 00000100:00100000:2.0:1762167006.705398:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451814144 00000100:00100000:2.0:1762167006.705443:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19729 00000100:00100000:2.0:1762167006.705453:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56199:x1847765451814144:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.705471:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.705487:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a406 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3682 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.705571:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a40d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.705584:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a40d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.705594:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a40d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.705604:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:2.0:1762167006.705705:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a406 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3682 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.705721:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a40d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3682 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.705729:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.705737:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762167006.705741:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167006.705811:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56199:x1847765451814144:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 359us (486us total) trans 8589952820 rc 0/0 00000100:00100000:2.0:1762167006.705820:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19729 00000100:00100000:3.0:1762167006.707733:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.707813:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451814400 00000100:00100000:2.0:1762167006.707819:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451814400 00000100:00100000:2.0:1762167006.707867:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19730 00000100:00100000:2.0:1762167006.707877:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56199:x1847765451814400:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.707897:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.707914:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a41b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3689 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.707997:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a422 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.708012:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3674 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.708020:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a422 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.708053:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3674 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.708067:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3674 expref: 899 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.708081:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454431744:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.708154:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242943180 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.709063:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454431744:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.709078:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a422 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167006.709259:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.709305:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451814528 00000100:00100000:0.0:1762167006.709310:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451814528 00010000:00010000:0.0:1762167006.709337:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3674 expref: 900 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.709369:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7442 00000100:00100000:0.0:1762167006.709375:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2360:x1847765451814528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167006.709395:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.709400:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3674 expref: 900 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.709410:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3674 expref: 900 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.709427:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a3dc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3674 expref: 900 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.709442:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:0.0:1762167006.709446:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a422 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.709454:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a422 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.709464:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a422 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.709487:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.709514:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a422 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.709522:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a422 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.709536:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00000100:00100000:0.0:1762167006.709536:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765451814528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 159us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.709548:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7442 00010000:00010000:2.0:1762167006.709668:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a41b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3689 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.709688:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a422 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3689 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.709696:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.709699:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167006.709701:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:2.0:1762167006.709741:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56199:x1847765451814400:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1866us (2018us total) trans 8589952821 rc 0/0 00000100:00100000:2.0:1762167006.709747:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19730 00000100:00100000:3.0:1762167006.710948:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.711001:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451814656 00000100:00100000:0.0:1762167006.711007:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451814656 00000100:00100000:0.0:1762167006.711048:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7315 00000100:00100000:0.0:1762167006.711058:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56199:x1847765451814656:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:0.0:1762167006.711164:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56199:x1847765451814656:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 107us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.711173:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7315 00000100:00100000:3.0:1762167006.712245:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.712292:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451814912 00000100:00100000:0.0:1762167006.712297:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451814912 00000100:00100000:0.0:1762167006.712336:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7316 00000100:00100000:0.0:1762167006.712346:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56199:x1847765451814912:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167006.712546:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56199:x1847765451814912:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 202us (304us total) trans 8589952822 rc 0/0 00000100:00100000:0.0:1762167006.712551:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7316 00000100:00100000:1.0:1762167006.713896:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.713926:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451815168 00000100:00100000:2.0:1762167006.713933:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451815168 00000100:00100000:2.0:1762167006.713982:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19731 00000100:00100000:2.0:1762167006.713991:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56199:x1847765451815168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.714007:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.714010:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762167006.714032:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a422 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3689 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.714055:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a40d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3682 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.714062:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.714065:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.714079:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a430 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3690 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.714146:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a437 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.714158:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a437 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.714167:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a437 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.714178:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:2.0:1762167006.714275:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a430 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3690 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.714289:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a437 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3690 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.714296:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.714299:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167006.714302:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167006.714348:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56199:x1847765451815168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 357us (456us total) trans 8589952823 rc 0/0 00000100:00100000:2.0:1762167006.714357:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19731 00000100:00100000:3.0:1762167006.715440:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.715486:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451815424 00000100:00100000:0.0:1762167006.715493:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451815424 00000100:00100000:0.0:1762167006.715534:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7317 00000100:00100000:0.0:1762167006.715543:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358651050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56199:x1847765451815424:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762167006.715588:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a437 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3690 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.715614:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.715624:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a3ce lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb366d expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.715632:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.715663:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a3ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb366d expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.715676:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a3ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb366d expref: 900 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.715705:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454431872:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.715814:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.716697:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454431872:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.716720:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167006.716951:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.716997:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451815552 00000100:00100000:0.0:1762167006.717002:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451815552 00010000:00010000:0.0:1762167006.717026:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a3ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb366d expref: 901 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.717059:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7443 00000100:00100000:0.0:1762167006.717066:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:2361:x1847765451815552:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167006.717076:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.717081:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a3ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb366d expref: 901 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.717090:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a3ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb366d expref: 901 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.717102:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a3ce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb366d expref: 901 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.717112:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:0.0:1762167006.717115:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.717122:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.717129:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.717152:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.717184:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.717192:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167006.717193:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2361:x1847765451815552:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 125us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.717207:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7443 00010000:00010000:2.0:1762167006.717536:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.717545:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.717551:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.717557:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.717561:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.717568:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.717577:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.717580:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167006.717584:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.717590:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a445 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.717601:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.717603:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167006.717608:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a437 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3690 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.717731:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358651050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56199:x1847765451815424:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 2188us (2293us total) trans 8589952824 rc -22/-22 00000100:00100000:2.0:1762167006.717740:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7317 00000100:00100000:3.0:1762167006.718696:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.718750:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451815680 00000100:00100000:2.0:1762167006.718757:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451815680 00000100:00100000:2.0:1762167006.718837:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19732 00000100:00100000:2.0:1762167006.718845:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56199:x1847765451815680:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.718861:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.718875:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a44c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3697 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.718916:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a44c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3697 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.718924:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a44c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3697 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.718941:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:2.0:1762167006.718944:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167006.718947:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:2.0:1762167006.718990:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56199:x1847765451815680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 146us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.718997:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19732 00000100:00100000:3.0:1762167006.720454:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.720494:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451815936 00000100:00100000:2.0:1762167006.720501:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451815936 00000100:00100000:2.0:1762167006.720545:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19733 00000100:00100000:2.0:1762167006.720555:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56199:x1847765451815936:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.720570:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.720583:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a453 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb369e expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.721122:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.721134:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.721143:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.721151:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64a:0x0]: returning size 0 00010000:00010000:2.0:1762167006.721187:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a453 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb369e expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.721199:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb369e expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.721204:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64a:0x0].0x0 (ffff9ee2429d0500) 00010000:00010000:2.0:1762167006.721206:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167006.721208:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167006.721253:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56199:x1847765451815936:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 700us (803us total) trans 8589952825 rc 0/0 00000100:00100000:2.0:1762167006.721260:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19733 00000100:00100000:1.0:1762167006.722722:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.722802:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451816192 00000100:00100000:2.0:1762167006.722810:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451816192 00000100:00100000:2.0:1762167006.722849:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19734 00000100:00100000:2.0:1762167006.722859:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56199:x1847765451816192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.722876:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.722891:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a468 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36a5 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.722973:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a46f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.722983:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a46f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.722989:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a46f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.722998:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:2.0:1762167006.723086:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a468 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36a5 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.723100:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a46f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36a5 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.723107:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:2.0:1762167006.723110:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167006.723113:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167006.723169:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56199:x1847765451816192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 311us (450us total) trans 8589952826 rc 0/0 00000100:00100000:2.0:1762167006.723176:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19734 00000100:00100000:3.0:1762167006.724484:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.724533:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451816448 00000100:00100000:2.0:1762167006.724540:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451816448 00000100:00100000:2.0:1762167006.724585:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7318 00000100:00100000:2.0:1762167006.724596:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56199:x1847765451816448:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167006.724654:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a46f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36a5 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.724683:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.724693:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a44c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3697 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.724701:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.724731:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a44c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3697 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.724743:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a44c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3697 expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.724757:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454432000:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.724851:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.725848:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454432000:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.725868:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167006.726397:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.726473:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451816576 00000100:00100000:0.0:1762167006.726480:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451816576 00010000:00010000:0.0:1762167006.726513:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a44c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3697 expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.726557:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7444 00000100:00100000:0.0:1762167006.726567:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2360:x1847765451816576:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167006.726582:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.726589:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a44c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3697 expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.726601:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a44c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3697 expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.726619:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a44c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3697 expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.726634:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:0.0:1762167006.726638:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.726651:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.726659:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.726690:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167006.726738:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2360:x1847765451816576:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.726747:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7444 00010000:00010000:2.0:1762167006.726948:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.726955:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.726975:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.726986:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb369e expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.726993:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.727023:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb369e expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.727035:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb369e expref: 903 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.727047:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454432128:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.727107:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.728156:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454432128:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.728173:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167006.728587:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.728652:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451816704 00000100:00100000:1.0:1762167006.728660:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451816704 00010000:00010000:1.0:1762167006.728688:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb369e expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1762167006.728725:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7445 00000100:00100000:1.0:1762167006.728735:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2361:x1847765451816704:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.728748:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.728754:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb369e expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.728789:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb369e expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.728808:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a45a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb369e expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.728821:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64a:0x0].0x0 (ffff9ee2429d0500) 00010000:00010000:1.0:1762167006.728825:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.728832:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.728842:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.728863:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.728876:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.728884:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167006.728904:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2361:x1847765451816704:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 170us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.728912:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7445 00000100:00100000:2.0:1762167006.729444:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.729485:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.729511:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242943840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.729540:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454432256 00000100:00100000:3.0:1762167006.729544:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454432256 00000100:00100000:3.0:1762167006.729580:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1762167006.729588:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.729662:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.729670:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1762167006.729696:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.729735:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.729757:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.729790:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2429433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.729805:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454432384 00000100:00100000:3.0:1762167006.729810:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454432384 00000100:00100000:3.0:1762167006.729838:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1762167006.729846:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.729901:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.729906:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1762167006.729934:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.729981:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.730006:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.730028:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.730051:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454432512 00000100:00100000:3.0:1762167006.730056:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454432512 00000100:00100000:3.0:1762167006.730083:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1762167006.730090:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432512:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.730166:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432512:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.730172:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1762167006.730204:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.730227:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.730243:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.730257:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.730284:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454432640 00000100:00100000:3.0:1762167006.730289:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454432640 00000100:00100000:3.0:1762167006.730315:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1762167006.730322:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.730374:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.730380:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1762167006.730417:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.730445:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.730461:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.730489:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee359ee0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.730513:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454432768 00000100:00100000:3.0:1762167006.730519:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454432768 00000100:00100000:3.0:1762167006.730547:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1762167006.730554:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.730607:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.730614:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1762167006.730624:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.730655:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.730676:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.730694:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.730705:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454432896 00000100:00100000:3.0:1762167006.730710:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454432896 00000100:00100000:3.0:1762167006.730742:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1762167006.730749:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.730819:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454432896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.730827:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1762167006.730836:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454432896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.730869:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.730891:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.730910:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.730913:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454433024 00000100:00100000:3.0:1762167006.730918:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454433024 00000100:00100000:3.0:1762167006.730962:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1762167006.730968:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.731031:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.731038:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1762167006.731043:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.731076:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.731097:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.731109:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee359ee0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.731111:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454433152 00000100:00100000:0.0:1762167006.731117:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454433152 00000100:00100000:0.0:1762167006.731149:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1762167006.731156:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.731219:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.731227:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1762167006.731236:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.731267:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.731286:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.731311:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.731353:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454433280 00000100:00100000:0.0:1762167006.731357:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454433280 00000100:00100000:0.0:1762167006.731382:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1762167006.731398:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.732040:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 641us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.732049:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1762167006.732062:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.732106:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.732138:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.732161:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.732184:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454433408 00000100:00100000:0.0:1762167006.732190:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454433408 00000100:00100000:0.0:1762167006.732223:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1762167006.732231:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.732287:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.732292:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1762167006.732310:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.732345:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.732367:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.732402:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee359ee0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.732418:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454433536 00000100:00100000:0.0:1762167006.732423:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454433536 00000100:00100000:0.0:1762167006.732452:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1762167006.732459:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.732512:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.732520:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1762167006.732531:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.732562:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.732584:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.732603:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.732622:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454433664 00000100:00100000:0.0:1762167006.732626:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454433664 00000100:00100000:0.0:1762167006.732654:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1762167006.732660:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.732711:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 51us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.732718:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1762167006.732731:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.732804:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.732828:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.732852:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.732867:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454433792 00000100:00100000:0.0:1762167006.732872:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454433792 00000100:00100000:0.0:1762167006.732890:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1762167006.732897:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.732964:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 67us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.732971:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1762167006.732996:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.733026:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.733048:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.733068:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee359ee0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.733184:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454433920 00000100:00100000:0.0:1762167006.733189:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454433920 00000100:00100000:0.0:1762167006.733223:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1762167006.733231:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.733286:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454433920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.733295:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1762167006.733312:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454433920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.733346:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454434048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.733367:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.733396:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.733402:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454434048 00000100:00100000:0.0:1762167006.733407:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454434048 00000100:00100000:0.0:1762167006.733436:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1762167006.733442:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454434048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.733619:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454434048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 175us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.733627:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1762167006.733637:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454434048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.733669:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454434176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.733693:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.733710:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.733718:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454434176 00000100:00100000:0.0:1762167006.733723:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454434176 00000100:00100000:0.0:1762167006.733753:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1762167006.733787:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454434176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.733855:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454434176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.733862:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1762167006.733867:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454434176:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1762167006.734189:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].50, 816 off63352 00000001:00080000:2.0:1762167006.734197:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952827 00000100:00100000:2.0:1762167006.734256:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454434304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.734311:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.734340:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.734405:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454434304 00000100:00100000:0.0:1762167006.734410:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454434304 00000100:00100000:0.0:1762167006.734440:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1762167006.734447:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454434304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.734640:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454434304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 189us (323us total) trans 21474843267 rc 0/0 00000100:00100000:0.0:1762167006.734647:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1762167006.734674:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454434304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.734695:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454434432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167006.734716:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.734735:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.734757:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454434432 00000100:00100000:0.0:1762167006.734781:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454434432 00000100:00100000:0.0:1762167006.734818:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1762167006.734825:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:30820:x1847765454434432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.734981:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454434432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 155us (262us total) trans 17179875732 rc 0/0 00000100:00100000:0.0:1762167006.734992:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1762167006.735014:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454434432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762167006.735100:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952828 00010000:00010000:2.0:1762167006.735127:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735138:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735146:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735153:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ee8000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.735157:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735165:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735180:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64a:0x0].0x0 (ffff9ee2429d0500) 00010000:00010000:2.0:1762167006.735183:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167006.735187:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735193:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0a484 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735215:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735221:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735231:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735250:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.735253:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735260:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735267:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:2.0:1762167006.735269:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167006.735272:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735278:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a47d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.735290:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:2.0:1762167006.735292:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167006.735299:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a46f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36a5 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.735396:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56199:x1847765451816448:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 10789us (10904us total) trans 8589952829 rc 0/0 00000100:00100000:2.0:1762167006.735406:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7318 00000020:00080000:2.0:1762167006.735411:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762167006.736689:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.736741:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451816832 00000100:00100000:2.0:1762167006.736748:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451816832 00000100:00100000:2.0:1762167006.736829:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19735 00000100:00100000:2.0:1762167006.736839:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56199:x1847765451816832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.736860:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.736880:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0a48b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36ac expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.736939:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0a48b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ac expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.736953:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0a48b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ac expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.736969:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.736973:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167006.736977:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ee8c00, rc 0) 00000100:00100000:2.0:1762167006.737032:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56199:x1847765451816832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 194us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.737039:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19735 00000100:00100000:3.0:1762167006.739414:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.739553:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451817088 00000100:00100000:2.0:1762167006.739563:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451817088 00000100:00100000:2.0:1762167006.739623:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7319 00000100:00100000:2.0:1762167006.739633:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56199:x1847765451817088:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762167006.740186:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x64a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762167006.740323:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5410, 64 off436792 00000004:00080000:2.0:1762167006.740332:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627532568124ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167006.740378:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5402, 64 off435736 00000004:00080000:2.0:1762167006.740383:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627532619920ns, next at 628532618837ns, rc = 0 00000001:00080000:2.0:1762167006.740403:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952830 00010000:00010000:2.0:1762167006.740455:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.740471:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.740482:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.740490:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.740496:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.740501:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.740532:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762167006.740662:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56199:x1847765451817088:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 1029us (1257us total) trans 8589952831 rc 0/0 00000100:00100000:2.0:1762167006.740672:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7319 00000020:00080000:2.0:1762167006.740679:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167006.740698:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167006.740707:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.740715:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167006.740720:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.740728:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.740740:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64a:0x0].0x0 (ffff9ee2429d0d00) 00010000:00010000:0.0:1762167006.740744:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762167006.740749:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.740755:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a492 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.740817:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167006.740820:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167006.740822:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167006.742237:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.742288:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451817344 00000100:00100000:2.0:1762167006.742297:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451817344 00000100:00100000:2.0:1762167006.742357:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7320 00000100:00100000:2.0:1762167006.742367:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56199:x1847765451817344:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167006.742663:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56199:x1847765451817344:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 297us (431us total) trans 8589952832 rc 0/0 00000100:00100000:2.0:1762167006.742672:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7320 00000100:00100000:3.0:1762167006.753101:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.753174:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451817472 00000100:00100000:2.0:1762167006.753184:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451817472 00000100:00100000:2.0:1762167006.753250:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19736 00000100:00100000:2.0:1762167006.753263:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56200:x1847765451817472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.753288:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.753308:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a499 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36b3 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.753373:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4a0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753398:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753409:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753423:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753429:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753434:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753540:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753548:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753555:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.753587:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00000004:00200000:2.0:1762167006.753591:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167006.753608:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753618:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753627:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753633:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4a0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753639:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753644:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.753648:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753655:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4a0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753665:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167006.753668:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.753672:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4a0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753678:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4a0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753691:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753697:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4a7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753706:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753711:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.753713:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753718:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753726:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0200) 00010000:00010000:2.0:1762167006.753728:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.753731:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4a7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753736:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4a7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.753811:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a499 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36b3 expref: 910 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.753826:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36b3 expref: 909 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.753834:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.753836:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167006.753839:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167006.753899:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56200:x1847765451817472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 641us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.753907:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19736 00000100:00100000:3.0:1762167006.756031:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.756093:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451817728 00000100:00100000:2.0:1762167006.756101:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451817728 00000100:00100000:2.0:1762167006.756152:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19737 00000100:00100000:2.0:1762167006.756163:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56200:x1847765451817728:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.756180:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.756196:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a4b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36ba expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.756283:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.756296:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.756305:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.756315:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:2.0:1762167006.756467:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a4b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ba expref: 912 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.756483:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ba expref: 911 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.756490:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.756493:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762167006.756495:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167006.756548:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56200:x1847765451817728:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 388us (525us total) trans 8589952833 rc 0/0 00000100:00100000:2.0:1762167006.756555:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19737 00000100:00100000:3.0:1762167006.758903:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.759019:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451817984 00000100:00100000:2.0:1762167006.759027:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451817984 00000100:00100000:2.0:1762167006.759082:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19738 00000100:00100000:2.0:1762167006.759091:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56200:x1847765451817984:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.759114:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.759129:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36c1 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.759217:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4d1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.759231:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.759242:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.759254:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:2.0:1762167006.759370:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a4ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c1 expref: 914 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.759397:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4d1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c1 expref: 913 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.759406:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.759409:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167006.759412:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167006.759462:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56200:x1847765451817984:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 371us (564us total) trans 8589952834 rc 0/0 00000100:00100000:2.0:1762167006.759469:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19738 00000100:00100000:3.0:1762167006.761507:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.761586:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451818112 00000100:00100000:1.0:1762167006.761595:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451818112 00000100:00100000:1.0:1762167006.761646:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 641 00000100:00100000:1.0:1762167006.761653:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56200:x1847765451818112:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167006.761670:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.761696:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a4d1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c1 expref: 913 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.761716:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:1.0:1762167006.761721:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167006.761802:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56200:x1847765451818112:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 148us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.761812:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 641 00000100:00100000:3.0:1762167006.762901:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.762953:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451818368 00000100:00100000:2.0:1762167006.762961:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451818368 00000100:00100000:2.0:1762167006.763010:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7321 00000100:00100000:2.0:1762167006.763020:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56200:x1847765451818368:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167006.763279:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56200:x1847765451818368:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 259us (381us total) trans 8589952835 rc 0/0 00000100:00100000:2.0:1762167006.763287:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7321 00000100:00100000:3.0:1762167006.765831:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.765972:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451818624 00000100:00100000:2.0:1762167006.765988:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451818624 00000100:00100000:2.0:1762167006.766075:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19739 00000100:00100000:2.0:1762167006.766087:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56065:x1847765451818624:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167006.766109:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.766127:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a4df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36c8 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.766239:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.766253:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36b3 expref: 914 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.766262:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.766298:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36b3 expref: 914 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.766313:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36b3 expref: 914 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.766333:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454434560:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.766439:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.767702:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454434560:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.767726:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167006.768313:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.768443:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451818752 00000100:00100000:1.0:1762167006.768450:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451818752 00010000:00010000:1.0:1762167006.768480:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36b3 expref: 915 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1762167006.768518:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7446 00000100:00100000:1.0:1762167006.768528:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:2361:x1847765451818752:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.768542:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.768549:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36b3 expref: 915 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.768563:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36b3 expref: 915 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.768583:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a4ae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36b3 expref: 915 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.768599:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:1.0:1762167006.768603:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.768610:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.768615:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.768639:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.768677:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.768688:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.768691:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:2361:x1847765451818752:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 159us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.768705:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7446 00000004:00200000:2.0:1762167006.768710:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:2.0:1762167006.768897:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a4df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c8 expref: 915 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.768914:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c8 expref: 914 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.768922:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.768925:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167006.768927:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00000100:00100000:2.0:1762167006.768963:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56065:x1847765451818624:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2879us (3147us total) trans 8589952836 rc 0/0 00000100:00100000:2.0:1762167006.768971:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19739 00000100:00100000:3.0:1762167006.770310:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.770370:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451818880 00000100:00100000:2.0:1762167006.770377:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451818880 00000100:00100000:2.0:1762167006.770445:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19740 00000100:00100000:2.0:1762167006.770454:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56065:x1847765451818880:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167006.770472:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.770487:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a4f4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36cf expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.770564:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.770579:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c8 expref: 915 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.770588:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.770616:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c8 expref: 915 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.770626:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c8 expref: 915 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.770635:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454434688:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.770701:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.771863:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454434688:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.771884:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167006.772072:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.772124:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451819008 00000100:00100000:1.0:1762167006.772131:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451819008 00010000:00010000:1.0:1762167006.772166:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c8 expref: 916 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1762167006.772200:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7447 00000100:00100000:1.0:1762167006.772210:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:2361:x1847765451819008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.772223:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.772229:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c8 expref: 916 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.772242:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c8 expref: 916 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.772263:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a4e6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36c8 expref: 916 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.772285:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:1.0:1762167006.772289:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.772298:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.772305:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.772335:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.772358:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.772396:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.772401:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:2361:x1847765451819008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 191us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.772413:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7447 00000004:00200000:2.0:1762167006.772445:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00000004:00200000:2.0:1762167006.772451:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167006.772469:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.772506:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a4f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36cf expref: 915 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.772522:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36cf expref: 914 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.772528:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.772530:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167006.772532:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:2.0:1762167006.772562:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56065:x1847765451818880:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2111us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.772566:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19740 00000100:00100000:3.0:1762167006.774877:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.774936:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451819264 00000100:00100000:2.0:1762167006.774944:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451819264 00000100:00100000:2.0:1762167006.774998:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7322 00000100:00100000:2.0:1762167006.775008:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56065:x1847765451819264:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167006.776021:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56065:x1847765451819264:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 1011us (1150us total) trans 8589952837 rc 0/0 00000100:00100000:2.0:1762167006.776032:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7322 00000100:00100000:3.0:1762167006.787137:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.787195:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451819520 00000100:00100000:2.0:1762167006.787208:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451819520 00000100:00100000:2.0:1762167006.787280:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19741 00000100:00100000:2.0:1762167006.787292:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56201:x1847765451819520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.787320:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.787344:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a502 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36d6 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.787468:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a509 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787484:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a509 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787496:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a509 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787510:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a510 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787515:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a510 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787521:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a510 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787679:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a517 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787688:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a517 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787696:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a517 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.787705:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:2.0:1762167006.787839:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a509 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787845:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a509 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787849:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a509 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787862:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.787868:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a509 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787875:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a509 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787886:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167006.787890:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.787894:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a509 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787902:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a509 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787915:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a510 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787921:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a510 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787924:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a510 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787933:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.787935:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a510 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787941:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a510 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787948:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0200) 00010000:00010000:2.0:1762167006.787951:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.787954:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a510 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.787959:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a510 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.788005:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a502 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36d6 expref: 918 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.788016:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a517 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36d6 expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.788021:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.788022:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167006.788024:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167006.788081:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:56201:x1847765451819520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 793us (963us total) trans 8589952838 rc 0/0 00000100:00100000:2.0:1762167006.788086:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19741 00000100:00100000:3.0:1762167006.790023:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.790109:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.790115:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451819648 00000100:00100000:1.0:1762167006.790124:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451819648 00000100:00100000:2.0:1762167006.790149:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451819904 00000100:00100000:2.0:1762167006.790156:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451819904 00000100:00100000:1.0:1762167006.790197:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 642 00000100:00100000:2.0:1762167006.790204:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19742 00000100:00100000:1.0:1762167006.790211:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:2361:x1847765451819648:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167006.790225:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56201:x1847765451819904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.790232:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.790245:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.790262:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0a517 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36d6 expref: 918 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.790263:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a525 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36dd expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.790292:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:1.0:1762167006.790297:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167006.790352:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:2361:x1847765451819648:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 146us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.790360:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 642 00010000:00010000:2.0:1762167006.790799:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.790812:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.790820:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.790830:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64b:0x0]: returning size 0 00010000:00010000:2.0:1762167006.790881:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a525 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36dd expref: 919 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.790896:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36dd expref: 918 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.790903:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2429d0500) 00010000:00010000:2.0:1762167006.790906:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167006.790908:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167006.790950:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56201:x1847765451819904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 738us (842us total) trans 8589952839 rc 0/0 00000100:00100000:2.0:1762167006.790958:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19742 00000100:00100000:3.0:1762167006.793274:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.793438:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451820160 00000100:00100000:2.0:1762167006.793454:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451820160 00000100:00100000:2.0:1762167006.793537:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19743 00000100:00100000:2.0:1762167006.793548:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56201:x1847765451820160:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.793587:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.793620:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a53a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36e4 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.793795:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.793814:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36dd expref: 919 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.793823:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.793872:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36dd expref: 919 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.793888:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36dd expref: 919 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.793905:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454434816:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.794028:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.795956:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454434816:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.796000:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167006.796080:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.796143:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451820288 00000100:00100000:1.0:1762167006.796157:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451820288 00010000:00010000:1.0:1762167006.796211:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36dd expref: 920 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1762167006.796262:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7448 00000100:00100000:1.0:1762167006.796273:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:2360:x1847765451820288:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.796291:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.796298:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36dd expref: 920 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.796310:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36dd expref: 920 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.796333:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a52c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36dd expref: 920 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.796351:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2429d0500) 00010000:00010000:1.0:1762167006.796356:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.796364:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.796369:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.796420:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167006.796486:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:2360:x1847765451820288:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 214us (407us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167006.796495:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.796499:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7448 00010000:00010000:2.0:1762167006.796507:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.796532:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64b:0x0]: returning size 0 00000004:00080000:2.0:1762167006.797037:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81c:0x0], index 0: 0 00000004:00080000:2.0:1762167006.797051:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81f:0x0], index 1: 0 00010000:00010000:2.0:1762167006.797229:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.797246:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.797252:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.797258:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.797263:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.797273:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.797285:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2429d0500) 00010000:00010000:2.0:1762167006.797289:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167006.797293:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.797300:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a541 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.797397:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a53a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36e4 expref: 919 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.797413:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167006.797416:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762167006.797420:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a53a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36e4 expref: 919 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.797431:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167006.797493:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56201:x1847765451820160:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3947us (4235us total) trans 8589952840 rc 301/301 00000100:00100000:2.0:1762167006.797501:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19743 00000100:00100000:3.0:1762167006.798903:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.798976:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451820544 00000100:00100000:2.0:1762167006.798989:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451820544 00000100:00100000:2.0:1762167006.799053:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7323 00000100:00100000:2.0:1762167006.799064:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:56201:x1847765451820544:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167006.799423:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:56201:x1847765451820544:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 361us (530us total) trans 8589952841 rc 0/0 00000100:00100000:2.0:1762167006.799429:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7323 00000100:00100000:3.0:1762167006.801285:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.801349:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451820672 00000100:00100000:2.0:1762167006.801362:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451820672 00000100:00100000:2.0:1762167006.801443:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19744 00000100:00100000:2.0:1762167006.801454:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:56201:x1847765451820672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.801479:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.801505:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a54f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36eb expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.801580:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a556 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.801594:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a556 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.801605:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a556 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.801640:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64b:0x0]: returning size 0 00000004:00200000:2.0:1762167006.801644:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167006.801662:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a556 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.801690:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a54f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36eb expref: 921 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.801710:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a556 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36eb expref: 920 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.801720:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:2.0:1762167006.801723:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762167006.801727:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167006.801818:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56201:x1847765451820672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 366us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.801827:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19744 00000100:00100000:3.0:1762167006.803517:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.803560:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.803634:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451820800 00000100:00100000:2.0:1762167006.803651:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451820800 00000100:00100000:1.0:1762167006.803740:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451820928 00000100:00100000:2.0:1762167006.803751:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16728 00000100:00100000:1.0:1762167006.803759:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451820928 00000100:00100000:2.0:1762167006.803825:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451820800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.803848:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167006.803869:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16729 00000100:00100000:1.0:1762167006.803884:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451820928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.803893:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a55d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36f2 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.803906:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1762167006.803933:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167006.803934:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a564 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb36f9 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.803971:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1762167006.803975:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762167006.803977:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.803998:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f2 expref: 30 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.804001:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.804007:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.804022:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a564 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f9 expref: 27 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.804034:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f2 expref: 30 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.804046:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a564 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f9 expref: 27 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.804054:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00010000:00010000:1.0:1762167006.804065:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a800, rc 0) 00000100:00100000:1.0:1762167006.804156:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451820928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 276us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.804163:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16729 00000100:00100000:2.0:1762167006.804229:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451820800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 410us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.804237:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16728 00000100:00100000:3.0:1762167006.806448:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.806515:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451821184 00000100:00100000:2.0:1762167006.806539:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451821184 00000100:00100000:2.0:1762167006.806618:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19745 00000100:00100000:2.0:1762167006.806629:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:56201:x1847765451821184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.806658:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.806683:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a56b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3700 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.806891:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a572 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.806910:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a572 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.806927:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a572 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167006.806943:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:2.0:1762167006.807141:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a56b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3700 expref: 923 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.807160:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a572 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3700 expref: 922 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.807170:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.807173:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167006.807176:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167006.807262:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:56201:x1847765451821184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 634us (823us total) trans 8589952842 rc 0/0 00000100:00100000:2.0:1762167006.807270:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19745 00000100:00100000:3.0:1762167006.809493:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.809554:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451821312 00000100:00100000:2.0:1762167006.809564:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451821312 00000100:00100000:3.0:1762167006.809576:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.809615:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.809623:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451821568 00000100:00100000:2.0:1762167006.809628:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451821568 00000100:00100000:1.0:1762167006.809643:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16730 00000100:00100000:1.0:1762167006.809658:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451821312:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167006.809678:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451821440 00000100:00100000:2.0:1762167006.809683:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451821440 00010000:00010000:1.0:1762167006.809701:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.809722:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16731 00010000:00010000:1.0:1762167006.809723:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 31 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.809735:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16732 00010000:00010000:1.0:1762167006.809735:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167006.809739:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1762167006.809742:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451821568:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167006.809745:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.809753:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451821440:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762167006.809803:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.809807:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.809824:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 31 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.809827:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.809834:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 31 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.809845:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.809851:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167006.809851:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.809856:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167006.809857:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.809861:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 31 pid: 12402 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.809862:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.809894:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 31 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.809897:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454434944:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.809907:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.809930:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 31 pid: 12402 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.809931:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 27 pid: 12402 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.809953:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454435072:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.809970:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454435200:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167006.809985:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9480 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.809990:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a180 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.810015:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.811366:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454434944:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.811368:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454435072:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.811376:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454435200:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167006.811409:0:33892:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.811411:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167006.811437:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167006.811517:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.811570:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451821696 00000100:00100000:1.0:1762167006.811576:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451821696 00000100:00100000:3.0:1762167006.811593:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167006.811604:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 32 pid: 12402 timeout: 727 lvb_type: 0 00000100:00100000:3.0:1762167006.811631:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.811651:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451821824 00000100:00100000:1.0:1762167006.811652:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451821952 00000100:00100000:0.0:1762167006.811658:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451821824 00000100:00100000:1.0:1762167006.811659:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451821952 00010000:00010000:1.0:1762167006.811682:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 33 pid: 12402 timeout: 727 lvb_type: 0 00000100:00100000:3.0:1762167006.811683:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7449 00010000:00010000:0.0:1762167006.811688:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 28 pid: 12402 timeout: 727 lvb_type: 0 00000100:00100000:3.0:1762167006.811705:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451821696:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167006.811719:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762167006.811722:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7450 00000100:00100000:1.0:1762167006.811733:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451821952:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762167006.811742:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7451 00010000:00010000:1.0:1762167006.811743:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167006.811758:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 33 pid: 12402 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.811759:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451821824:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.811782:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 33 pid: 12402 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.811803:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.811804:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 33 pid: 12402 timeout: 727 lvb_type: 0 00010000:00010000:3.0:1762167006.811809:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 33 pid: 12402 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.811823:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 28 pid: 12402 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.811841:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a3a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3651 expref: 33 pid: 12402 timeout: 727 lvb_type: 0 00010000:00010000:3.0:1762167006.811843:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a3b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb365f expref: 33 pid: 12402 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167006.811844:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 28 pid: 12402 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.811863:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.811867:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.811871:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.811872:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.811876:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.811883:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.811883:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a3ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3658 expref: 28 pid: 12402 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.811887:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.811909:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.811913:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.811917:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.811922:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.811931:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.811949:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167006.811951:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.811953:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167006.811969:0:33892:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.811978:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.811995:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451821952:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 263us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.811997:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451821696:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 298us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.812003:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451821824:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 247us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.812014:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7450 00000100:00100000:3.0:1762167006.812022:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7449 00000100:00100000:0.0:1762167006.812034:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7451 00010000:00010000:2.0:1762167006.812035:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.812051:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.812059:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.812063:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.812069:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.812076:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.812086:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.812090:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.812102:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.812108:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.812111:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.812114:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.812132:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a580 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.812136:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.812149:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.812154:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.812161:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.812166:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167006.812171:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.812175:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.812190:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167006.812193:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.812200:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451821312:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2546us (2778us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167006.812205:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.812215:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16730 00010000:00010000:0.0:1762167006.812222:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.812231:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.812234:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a587 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.812259:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.812268:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a58e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.812273:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451821568:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2539us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.812287:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16731 00000100:00100000:3.0:1762167006.812328:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451821440:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2581us (2713us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.812336:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16732 00000100:00100000:2.0:1762167006.814494:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.814560:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.814573:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451822080 00000100:00100000:3.0:1762167006.814581:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451822080 00000100:00100000:0.0:1762167006.814610:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451822208 00000100:00100000:0.0:1762167006.814616:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451822208 00000100:00100000:0.0:1762167006.814669:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16733 00000100:00100000:0.0:1762167006.814682:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451822208:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:3.0:1762167006.814689:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16734 00000100:00100000:3.0:1762167006.814701:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451822080:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.814703:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.814714:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.814725:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a595 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb370e expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.814731:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a59c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3707 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.814747:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:3.0:1762167006.814757:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 26859, mtime: 0x690888de, atime: 0x690888de, ctime: 0x690888de, blocks: 0x185 00002000:00010000:0.0:1762167006.814757:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888de, atime: 0x690888de, ctime: 0x690888de, blocks: 0x3 00010000:00010000:3.0:1762167006.814800:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.814800:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.814803:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.814804:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.814816:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a59c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3707 expref: 29 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.814816:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a595 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb370e expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762167006.814822:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451822336 00000100:00100000:2.0:1762167006.814827:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451822336 00010000:00010000:0.0:1762167006.814849:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a595 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb370e expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.814850:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a59c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3707 expref: 30 pid: 12402 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762167006.814856:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16735 00000100:00100000:2.0:1762167006.814867:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2358:x1847765451822336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.814876:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9400, rc 0) 00010000:00010000:3.0:1762167006.814878:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00010000:00010000:2.0:1762167006.814878:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.814889:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a5a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3715 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167006.814901:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888de, atime: 0x690888de, ctime: 0x690888de, blocks: 0x3 00010000:00010000:2.0:1762167006.814913:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.814916:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.814921:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3715 expref: 31 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.814932:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3715 expref: 31 pid: 26444 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167006.814939:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451822208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 259us (376us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167006.814946:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00000100:00100000:0.0:1762167006.814952:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16733 00000100:00100000:3.0:1762167006.814968:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765451822080:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 267us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.814977:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765451822336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 110us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.814980:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16734 00000100:00100000:2.0:1762167006.814990:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16735 00000100:00100000:2.0:1762167006.841725:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.841832:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451822464 00000100:00100000:0.0:1762167006.841843:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451822464 00000100:00100000:0.0:1762167006.841908:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2852 00000100:00100000:0.0:1762167006.841915:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451822464:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167006.841949:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.841964:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.841966:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.841972:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.841987:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.843403:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.843420:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.843430:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.843437:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167006.843442:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.843451:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.843471:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.843479:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.843550:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451822464:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1632us (1834us total) trans 0 rc 26859/26859 00000100:00100000:0.0:1762167006.843559:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2852 00000100:00100000:1.0:1762167006.845351:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.845426:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451822592 00000100:00100000:0.0:1762167006.845433:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451822592 00000100:00100000:0.0:1762167006.845493:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2853 00000100:00100000:0.0:1762167006.845503:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451822592:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762167006.845535:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.845552:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a55d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f2 expref: 30 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.845561:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.845563:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.845566:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.845600:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f2 expref: 30 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.845614:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a55d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f2 expref: 30 pid: 12402 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1762167006.845630:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:14122:1847765454435328:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.845712:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.847127:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:14122:1847765454435328:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.847153:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.847375:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.847443:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451822720 00000100:00100000:2.0:1762167006.847450:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451822720 00010000:00010000:2.0:1762167006.847482:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a55d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f2 expref: 31 pid: 12402 timeout: 727 lvb_type: 1 00000100:00100000:2.0:1762167006.847523:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7452 00000100:00100000:2.0:1762167006.847533:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451822720:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.847548:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.847568:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a55d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f2 expref: 31 pid: 12402 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.847580:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f2 expref: 31 pid: 12402 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.847601:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a55d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f2 expref: 31 pid: 12402 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.847617:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.847619:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.847623:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.847632:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.847660:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.847705:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451822720:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.847713:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7452 00010000:00010000:0.0:1762167006.847726:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.847751:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167006.862506:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843268 is committed 00000001:00080000:3.0:1762167006.862524:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843267 is committed 00002000:00010000:0.0:1762167006.862623:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 0 -> 26859 00002000:00010000:0.0:1762167006.862626:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 0 -> 1762167007 00002000:00010000:0.0:1762167006.862628:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 0 -> 1762167007 00002000:00010000:0.0:1762167006.862630:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 1 -> 67 00010000:00010000:0.0:1762167006.862642:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.862653:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.862662:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.862669:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167006.862674:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.862683:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.862703:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.862711:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.862854:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451822592:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 17347us (17504us total) trans 21474843268 rc 0/0 00000100:00100000:0.0:1762167006.862868:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2853 00000100:00100000:2.0:1762167006.864847:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.864894:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451822848 00000100:00100000:1.0:1762167006.864904:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451822848 00000100:00100000:1.0:1762167006.864964:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19746 00000100:00100000:1.0:1762167006.864975:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+922:56201:x1847765451822848:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762167006.876833:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952822 is committed 00000020:00080000:2.0:1762167006.876856:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969181 batchid updated 00000001:00080000:2.0:1762167006.876871:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952842 is committed 00000020:00080000:1.0:1762167006.876893:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969181 00000004:00080000:2.0:1762167006.876896:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3510 committed 00000004:00080000:2.0:1762167006.876912:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3523 committed 00000100:00100000:0.0:1762167006.876931:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56201:x1847765451822848:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 11952us (12082us total) trans 0 rc 0/0 00000020:00080000:2.0:1762167006.876937:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee2429433c0 refcount 2 committed 0 result 0 batchid 4294969182 00000020:00080000:2.0:1762167006.876943:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee242421c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee360731480 00000100:00100000:0.0:1762167006.876947:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19746 00000020:00080000:2.0:1762167006.876949:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee381dab600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee242943840 00000020:00080000:2.0:1762167006.876954:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee381dabb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37f8b2800 00000020:00080000:2.0:1762167006.876958:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].50 00000100:00100000:0.0:1762167006.877063:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454435456:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1762167006.877109:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969181 cancel update log [0x200000bd0:0x1:0x0].49: rc = 0 00000100:00100000:0.0:1762167006.877117:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1762167006.877120:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969182 committed batchid 4294969181 00000100:00100000:2.0:1762167006.877162:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454435456 00000100:00100000:2.0:1762167006.877171:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454435456 00000100:00100000:2.0:1762167006.877217:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16736 00000100:00100000:2.0:1762167006.877228:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765454435456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762167006.877256:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2069 count 1 00000020:00080000:1.0:1762167006.877259:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969181 00010000:00010000:2.0:1762167006.877281:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.877302:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 17 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.877312:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.877315:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167006.877318:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167006.877346:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454435584:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762167006.877350:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 17 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.877369:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 17 pid: 7858 timeout: 727 lvb_type: 0 00000100:00100000:3.0:1762167006.877393:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167006.877403:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454435712:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.877457:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454435584 00000100:00100000:2.0:1762167006.877461:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.877463:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454435584 00000100:00100000:0.0:1762167006.877496:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16737 00000100:00100000:0.0:1762167006.877504:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454435584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762167006.877517:0:12402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2072 count 1 00002000:00010000:0.0:1762167006.877551:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x818:0x0] initial LVB size: 154055, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888de, blocks: 0x203 00010000:00010000:0.0:1762167006.877558:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.877566:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.877568:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.877572:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.877584:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.877593:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.877600:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.877619:0:12402:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762167006.877647:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167006.877655:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.877665:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167006.877670:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.877680:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.877696:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.877703:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a5bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.877727:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167006.877729:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167006.877731:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167006.878003:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454435584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 499us (619us total) trans 17179875733 rc 0/0 00000100:00100000:0.0:1762167006.878010:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16737 00000004:00080000:3.0:1762167006.878038:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03800/2, rc 0, transno 17179875733 00000100:00100000:3.0:1762167006.878045:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454435584:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762167006.878714:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.878751:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454435712:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.878790:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.878797:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451822976 00000100:00100000:0.0:1762167006.878803:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451822976 00000100:00100000:3.0:1762167006.878827:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.878847:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451823104 00000100:00100000:0.0:1762167006.878851:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451823104 00000100:00100000:0.0:1762167006.878891:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16738 00000100:00100000:1.0:1762167006.878902:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16739 00000100:00100000:0.0:1762167006.878902:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451822976:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762167006.878920:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451823104:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:3.0:1762167006.878947:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.878970:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451822976:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.878978:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451823104:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 62us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.878985:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16738 00000100:00100000:2.0:1762167006.878989:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451823232 00000100:00100000:1.0:1762167006.878994:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16739 00000100:00100000:2.0:1762167006.878996:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451823232 00010000:00010000:2.0:1762167006.879026:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 18 pid: 7858 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.879050:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7453 00000100:00100000:2.0:1762167006.879056:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451823232:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.879064:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.879069:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 18 pid: 7858 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.879077:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 18 pid: 7858 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.879090:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a0cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb354e expref: 18 pid: 7858 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.879097:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.879099:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.879101:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.879109:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.879132:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.879163:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451823232:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 107us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.879172:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7453 00010000:00010000:3.0:1762167006.879183:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.879195:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.879203:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.879211:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.879231:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762167006.879251:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167006.879257:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.879266:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.879270:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.879278:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.879290:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.879297:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.879314:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167006.879317:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167006.879320:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167006.879739:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765454435456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2513us (2621us total) trans 21474843269 rc 0/0 00000100:00100000:3.0:1762167006.879747:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16736 00000100:00100000:0.0:1762167006.879809:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843267 gen 2 00000004:00080000:0.0:1762167006.879815:0:3293:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843253 committed transno 21474843267 00000004:00080000:0.0:1762167006.879831:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243183b80, transno 21474843254 00000004:00080000:0.0:1762167006.879843:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243181500, transno 21474843255 00000004:00080000:0.0:1762167006.879849:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180380, transno 21474843256 00000004:00080000:0.0:1762167006.879852:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243183480, transno 21474843257 00000004:00080000:0.0:1762167006.879856:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243181880, transno 21474843258 00000004:00080000:0.0:1762167006.879858:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243181f80, transno 21474843259 00000004:00080000:0.0:1762167006.879862:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243182a00, transno 21474843260 00000004:00080000:0.0:1762167006.879865:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243181c00, transno 21474843261 00000004:00080000:0.0:1762167006.879868:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aa8000, transno 21474843262 00000004:00080000:0.0:1762167006.879872:0:3293:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843267 committed transno 21474843267 00000100:00100000:0.0:1762167006.879885:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee247858700 x1847765454435456/t21474843269(21474843269) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762167022 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762167006.879896:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247858700/2, rc 0, transno 21474843269 00000100:00100000:0.0:1762167006.879901:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454435456:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1762167006.880008:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 3 in progress, 0 in flight, 7 done 00000100:00100000:3.0:1762167006.885426:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.885460:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.885479:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.885493:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451823360 00000100:00100000:2.0:1762167006.885504:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451823360 00000100:00100000:1.0:1762167006.885511:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451823488 00000100:00100000:1.0:1762167006.885518:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451823488 00000100:00100000:0.0:1762167006.885533:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451823616 00000100:00100000:0.0:1762167006.885540:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451823616 00000100:00100000:2.0:1762167006.885563:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16740 00000100:00100000:2.0:1762167006.885577:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451823360:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167006.885585:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16741 00000100:00100000:0.0:1762167006.885594:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16742 00000100:00100000:1.0:1762167006.885599:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451823488:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:0.0:1762167006.885608:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451823616:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167006.885629:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.885629:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a5cd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.885633:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.885659:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.885660:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.885660:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.885662:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.885665:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.885666:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.885668:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.885673:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.885674:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a5cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.885687:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.885697:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.885701:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a5cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.885734:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.885735:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a5cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.885737:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.885755:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.885791:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.885792:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.885810:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a5cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.885812:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167006.885822:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.885823:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.885824:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a5cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.885847:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167006.885849:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167006.885853:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a5cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.885857:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.885859:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.885870:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a5cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.885883:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.885886:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.885890:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a5cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.885906:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a5c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.885908:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.885909:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a5cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.885933:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.885989:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451823488:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 394us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.885994:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451823360:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 415us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.885994:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451823616:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 384us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.886003:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16741 00000100:00100000:0.0:1762167006.886014:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16742 00000100:00100000:2.0:1762167006.886022:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16740 00000100:00100000:1.0:1762167006.887057:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.887097:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451823872 00000100:00100000:0.0:1762167006.887103:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451823872 00000100:00100000:0.0:1762167006.887142:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19747 00000100:00100000:0.0:1762167006.887150:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56201:x1847765451823872:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167006.887190:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.887210:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a556 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36eb expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.887223:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2429d0200) 00010000:00010000:0.0:1762167006.887234:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.887280:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.887295:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.887302:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:0.0:1762167006.887476:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000938fd5ed reply state 00000000c9c1507f transno 8589952843 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167006.887485:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167006.887557:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56201:x1847765451823872:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 407us (501us total) trans 8589952843 rc 0/0 00000100:00100000:0.0:1762167006.887564:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19747 00010000:00010000:0.0:1762167006.888145:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.888156:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.888162:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.888168:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.888172:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.888179:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.888189:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167006.888192:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.888195:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.888202:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a5db lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.888524:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.888566:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451824000 00000100:00100000:0.0:1762167006.888571:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451824000 00000100:00100000:0.0:1762167006.888610:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19748 00000100:00100000:0.0:1762167006.888622:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56201:x1847765451824000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.888637:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.888651:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a5e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb371c expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.888692:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb371c expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.888705:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb371c expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.888722:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.888725:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167006.888728:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8c00, rc 0) 00000100:00100000:0.0:1762167006.888795:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56201:x1847765451824000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 176us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.888803:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19748 00000100:00100000:3.0:1762167006.889774:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.889847:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451824128 00000100:00100000:2.0:1762167006.889852:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451824128 00000100:00100000:2.0:1762167006.889884:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16743 00000100:00100000:2.0:1762167006.889891:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56201:x1847765451824128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.889903:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.889915:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a5e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3723 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167006.889932:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 26859, mtime: 0x690888df, atime: 0x0, ctime: 0x690888df, blocks: 0x43 00010000:00010000:2.0:1762167006.889944:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.889945:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.889949:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a5e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3723 expref: 18 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.889962:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a5e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3723 expref: 18 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.889969:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d400, rc 0) 00000100:00100000:2.0:1762167006.890004:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56201:x1847765451824128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.890011:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16743 00000100:00100000:3.0:1762167006.890865:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.890905:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451824256 00000100:00100000:2.0:1762167006.890911:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451824256 00000100:00100000:2.0:1762167006.890947:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16744 00000100:00100000:2.0:1762167006.890953:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56201:x1847765451824256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167006.890962:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167006.890973:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb372a expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.890988:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a564 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f9 expref: 28 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.890993:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.890994:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.890997:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 28 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.891019:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a564 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f9 expref: 28 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167006.891031:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a564 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f9 expref: 28 pid: 33892 timeout: 727 lvb_type: 1 00000100:00100000:2.0:1762167006.891042:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454435840:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.891094:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.892001:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454435840:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.892021:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 28 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.892033:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167006.892061:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56201:x1847765451824256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1108us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.892067:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16744 00000100:00100000:3.0:1762167006.892213:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.892261:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451824384 00000100:00100000:2.0:1762167006.892266:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451824384 00010000:00010000:2.0:1762167006.892289:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a564 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f9 expref: 28 pid: 33892 timeout: 727 lvb_type: 1 00000100:00100000:2.0:1762167006.892322:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7454 00000100:00100000:2.0:1762167006.892331:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451824384:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.892343:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.892373:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a564 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f9 expref: 28 pid: 33892 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.892403:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a564 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f9 expref: 28 pid: 33892 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.892422:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a564 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36f9 expref: 28 pid: 33892 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.892431:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.892432:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.892436:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.892443:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.892461:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.892469:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454435968:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167006.892506:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.893356:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454435968:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167006.893373:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167006.893417:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451824384:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1087us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.893426:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7454 00000100:00100000:3.0:1762167006.893568:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.893627:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451824640 00000100:00100000:2.0:1762167006.893633:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451824640 00000100:00100000:2.0:1762167006.893673:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16745 00000100:00100000:2.0:1762167006.893682:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451824640:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167006.893715:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.893795:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451824512 00000100:00100000:1.0:1762167006.893800:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451824512 00000100:00100000:1.0:1762167006.893837:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16746 00000100:00100000:1.0:1762167006.893845:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451824512:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762167006.894018:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167006.894020:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 26859 -> 26859 00002000:00010000:2.0:1762167006.894023:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 0 -> 1762167006 00002000:00010000:1.0:1762167006.894025:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167007 -> 1762167006 00002000:00010000:2.0:1762167006.894029:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 0 -> 1762167006 00002000:00010000:1.0:1762167006.894031:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 0 -> 1762167006 00002000:00010000:2.0:1762167006.894034:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 0 -> 1762167007 00002000:00010000:1.0:1762167006.894036:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167006.894039:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1762167006.894040:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 67 -> 67 00000100:00100000:2.0:1762167006.894084:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451824640:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 402us (515us total) trans 17179875734 rc 0/0 00000100:00100000:1.0:1762167006.894086:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451824512:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 239us (368us total) trans 21474843270 rc 0/0 00000100:00100000:2.0:1762167006.894100:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16745 00000100:00100000:1.0:1762167006.894110:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16746 00000100:00100000:1.0:1762167006.895440:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.895491:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451824896 00000100:00100000:0.0:1762167006.895497:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451824896 00000100:00100000:0.0:1762167006.895546:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19749 00000100:00100000:0.0:1762167006.895556:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56201:x1847765451824896:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:0.0:1762167006.895618:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5f7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.895634:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.895644:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.895672:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.895678:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5f7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.895684:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.895690:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.895695:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.895703:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5f7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.895714:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.895718:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1762167006.895722:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5f7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.895728:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a5f7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167006.895826:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56201:x1847765451824896:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 271us (389us total) trans 0 rc -22/-22 00000100:00100000:0.0:1762167006.895835:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19749 00000100:00100000:3.0:1762167006.896702:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.896742:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451825152 00000100:00100000:0.0:1762167006.896747:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451825152 00000100:00100000:0.0:1762167006.896802:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19750 00000100:00100000:0.0:1762167006.896812:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56201:x1847765451825152:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167006.896849:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167006.896868:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a4fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36cf expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.896881:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:0.0:1762167006.896885:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.896913:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.896923:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.896929:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:0.0:1762167006.897071:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002fe9f6ae reply state 00000000b465349f transno 8589952844 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167006.897080:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167006.897148:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56201:x1847765451825152:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 337us (446us total) trans 8589952844 rc 0/0 00000100:00100000:0.0:1762167006.897155:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19750 00010000:00010000:2.0:1762167006.897907:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.897916:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.897921:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.897924:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167006.897932:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.897938:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.897949:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.897952:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167006.897955:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.897961:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a5fe lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167006.898055:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.898101:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451825280 00000100:00100000:1.0:1762167006.898107:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451825280 00000100:00100000:1.0:1762167006.898150:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16747 00000100:00100000:1.0:1762167006.898158:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:56201:x1847765451825280:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167006.898169:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.898183:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3731 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.898205:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a59c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3707 expref: 20 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.898212:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.898214:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.898217:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.898246:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a59c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3707 expref: 20 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.898259:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a59c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3707 expref: 20 pid: 12402 timeout: 727 lvb_type: 1 00000100:00100000:1.0:1762167006.898270:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454436096:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167006.898336:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.899119:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454436096:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167006.899144:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.899163:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b200, rc 0) 00000100:00100000:1.0:1762167006.899203:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56201:x1847765451825280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1045us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.899209:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16747 00000100:00100000:3.0:1762167006.899433:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.899525:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451825408 00000100:00100000:2.0:1762167006.899531:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451825408 00010000:00010000:2.0:1762167006.899562:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a59c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3707 expref: 20 pid: 12402 timeout: 727 lvb_type: 1 00000100:00100000:2.0:1762167006.899590:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7455 00000100:00100000:2.0:1762167006.899599:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451825408:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.899611:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.899631:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a59c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3707 expref: 20 pid: 12402 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.899642:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a59c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3707 expref: 20 pid: 12402 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.899659:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a59c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3707 expref: 20 pid: 12402 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.899672:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.899673:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.899679:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.899688:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.899711:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.899722:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454436224:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167006.899809:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.900940:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.900950:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454436224:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167006.900964:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.901002:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451825408:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1404us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.901011:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7455 00000100:00100000:3.0:1762167006.901021:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451825536 00000100:00100000:3.0:1762167006.901026:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451825536 00000100:00100000:3.0:1762167006.901068:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16748 00000100:00100000:3.0:1762167006.901079:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56201:x1847765451825536:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167006.901092:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.901106:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3738 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.901169:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a595 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb370e expref: 29 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.901177:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.901179:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.901183:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 29 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.901209:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a595 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb370e expref: 29 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.901221:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a595 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb370e expref: 29 pid: 6532 timeout: 727 lvb_type: 1 00000100:00100000:3.0:1762167006.901232:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454436352:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167006.901278:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.902122:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454436352:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167006.902142:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 29 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.902216:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:3.0:1762167006.902259:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56201:x1847765451825536:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1182us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.902267:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16748 00000100:00100000:0.0:1762167006.902276:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.902329:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451825664 00000100:00100000:2.0:1762167006.902334:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451825664 00010000:00010000:2.0:1762167006.902353:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a595 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb370e expref: 29 pid: 6532 timeout: 727 lvb_type: 1 00000100:00100000:2.0:1762167006.902399:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7456 00000100:00100000:2.0:1762167006.902409:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451825664:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.902420:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.902439:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a595 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb370e expref: 29 pid: 6532 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.902452:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a595 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb370e expref: 29 pid: 6532 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.902475:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a595 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb370e expref: 29 pid: 6532 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.902487:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.902489:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.902494:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.902509:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.902535:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.902547:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454436480:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167006.902600:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.903512:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5740:1847765454436480:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167006.903524:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.903560:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451825664:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1153us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.903570:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7456 00000100:00100000:1.0:1762167006.903834:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.903889:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451825792 00000100:00100000:3.0:1762167006.903894:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451825792 00000100:00100000:3.0:1762167006.903922:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16749 00000100:00100000:3.0:1762167006.903927:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:56201:x1847765451825792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167006.903937:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.903948:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb373f expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.903964:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a5a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3715 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.903970:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.903971:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167006.903973:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.903989:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3715 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.903997:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a5a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3715 expref: 20 pid: 26444 timeout: 727 lvb_type: 1 00000100:00100000:3.0:1762167006.904004:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454436608:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167006.904051:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.904979:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454436608:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167006.905003:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.905017:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922200, rc 0) 00000100:00100000:1.0:1762167006.905058:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56201:x1847765451825792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1130us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.905066:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16749 00000100:00100000:3.0:1762167006.905203:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.905253:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451825920 00000100:00100000:2.0:1762167006.905259:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451825920 00010000:00010000:2.0:1762167006.905284:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a5a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3715 expref: 20 pid: 26444 timeout: 727 lvb_type: 1 00000100:00100000:2.0:1762167006.905319:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7457 00000100:00100000:2.0:1762167006.905330:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451825920:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.905346:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.905364:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a5a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3715 expref: 20 pid: 26444 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.905381:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3715 expref: 20 pid: 26444 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.905417:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a5a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3715 expref: 20 pid: 26444 timeout: 727 lvb_type: 1 00010000:00010000:2.0:1762167006.905428:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.905430:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.905435:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.905442:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.905469:0:5740:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 19 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.905479:0:5740:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454436736:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167006.905530:0:5740:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.906232:0:5740:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5740:1847765454436736:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167006.906243:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.906279:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451825920:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 952us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.906287:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7457 00000100:00100000:0.0:1762167006.906470:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.906537:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451826048 00000100:00100000:1.0:1762167006.906542:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451826048 00000100:00100000:1.0:1762167006.906582:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16750 00000100:00100000:1.0:1762167006.906589:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451826048:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167006.906717:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.906793:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451826176 00000100:00100000:2.0:1762167006.906799:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451826176 00000100:00100000:3.0:1762167006.906824:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:1.0:1762167006.906835:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 26859 -> 26859 00000100:00100000:2.0:1762167006.906836:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451826304 00002000:00010000:1.0:1762167006.906841:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167006.906842:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451826304 00002000:00010000:1.0:1762167006.906848:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:3.0:1762167006.906853:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16751 00002000:00010000:1.0:1762167006.906854:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00002000:00010000:1.0:1762167006.906859:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 389 -> 47 00000100:00100000:3.0:1762167006.906868:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451826176:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:0.0:1762167006.906874:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16752 00000100:00100000:0.0:1762167006.906889:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451826304:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167006.906896:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451826048:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 304us (424us total) trans 21474843271 rc 0/0 00000100:00100000:1.0:1762167006.906904:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16750 00002000:00010000:3.0:1762167006.907015:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167006.907020:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.907029:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167006.907033:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.907036:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167006.907038:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167006.907040:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167006.907061:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167006.907064:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00002000:00010000:3.0:1762167006.907066:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167006.907081:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451826304:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 196us (255us total) trans 21474843272 rc 0/0 00000100:00100000:0.0:1762167006.907090:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16752 00000100:00100000:3.0:1762167006.907096:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451826176:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 230us (377us total) trans 17179875735 rc 0/0 00000100:00100000:3.0:1762167006.907105:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16751 00000100:00100000:1.0:1762167006.908194:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.908239:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451826560 00000100:00100000:2.0:1762167006.908245:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451826560 00000100:00100000:2.0:1762167006.908284:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7324 00000100:00100000:2.0:1762167006.908293:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56201:x1847765451826560:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167006.908357:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a572 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3700 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.908402:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.908414:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0a48b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ac expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.908423:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ba expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.908431:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 5/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.908462:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ba expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.908471:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ba expref: 895 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.908481:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454436864:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.908546:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0a48b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ac expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.908556:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0a48b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ac expref: 895 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.908565:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454436992:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.908593:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167006.909727:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454436864:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167006.909755:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454436992:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167006.909809:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167006.909924:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.909952:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.910001:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451826688 00000100:00100000:2.0:1762167006.910012:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451826688 00010000:00010000:2.0:1762167006.910043:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0a48b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ac expref: 896 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:3.0:1762167006.910055:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451826944 00000100:00100000:3.0:1762167006.910061:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451826944 00000100:00100000:2.0:1762167006.910081:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7458 00000100:00100000:2.0:1762167006.910099:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451826688:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762167006.910103:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7325 00000100:00100000:3.0:1762167006.910116:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:49238:x1847765451826944:12345-192.168.203.35@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1762167006.910119:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.910128:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0a48b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ac expref: 897 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.910141:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0a48b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ac expref: 897 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.910160:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0a48b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ac expref: 897 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.910184:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.910188:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.910196:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.910202:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.910247:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451826688:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 151us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.910254:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7458 00000100:00100000:3.0:1762167006.910289:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:49238:x1847765451826944:12345-192.168.203.35@tcp:35:ldlm_bl.0 Request processed in 175us (364us total) trans 8589952845 rc 0/0 00000100:00100000:3.0:1762167006.910298:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7325 00000100:00100000:1.0:1762167006.911469:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.911551:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451827072 00000100:00100000:2.0:1762167006.911560:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451827072 00010000:00010000:2.0:1762167006.911587:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ba expref: 896 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.911623:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7459 00000100:00100000:2.0:1762167006.911632:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451827072:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.911644:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.911650:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ba expref: 896 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.911661:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ba expref: 896 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.911677:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a4bc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb36ba expref: 896 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.911695:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:2.0:1762167006.911700:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.911709:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.911715:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.911743:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.911806:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167006.911809:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451827072:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 177us (350us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167006.911822:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167006.911825:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7459 00010000:00010000:0.0:1762167006.911851:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.911864:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a5e2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb371c expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.911872:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.911899:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb371c expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.911908:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a5e2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb371c expref: 894 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.911922:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454437120:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.911970:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.912878:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454437120:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.912898:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167006.913130:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.913418:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451827200 00000100:00100000:2.0:1762167006.913424:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451827200 00010000:00010000:2.0:1762167006.913448:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a5e2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb371c expref: 895 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.913477:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7460 00000100:00100000:2.0:1762167006.913487:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765451827200:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.913498:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.913503:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a5e2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb371c expref: 895 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.913514:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb371c expref: 895 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.913533:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a5e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb371c expref: 895 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.913546:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167006.913550:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.913557:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.913563:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167006.913583:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.913597:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.913604:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167006.913622:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765451827200:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 137us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.913629:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7460 00000100:00100000:0.0:1762167006.914054:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.914093:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.914118:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.914141:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454437248 00000100:00100000:1.0:1762167006.914147:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454437248 00000100:00100000:1.0:1762167006.914184:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:1.0:1762167006.914192:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454437248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167006.914263:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454437248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.914270:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1762167006.914303:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.914339:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.914358:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.914374:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.914399:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454437376 00000100:00100000:1.0:1762167006.914404:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454437376 00000100:00100000:1.0:1762167006.914425:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1762167006.914429:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454437376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167006.914471:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454437376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 41us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.914475:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1762167006.914496:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.914532:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.914552:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.914575:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.914601:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454437504 00000100:00100000:1.0:1762167006.914606:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454437504 00000100:00100000:1.0:1762167006.914635:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1762167006.914643:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454437504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167006.914695:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454437504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.914701:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1762167006.914726:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.914759:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.914799:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.914818:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731f00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.914848:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454437632 00000100:00100000:1.0:1762167006.914854:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454437632 00000100:00100000:1.0:1762167006.914885:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1762167006.914892:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454437632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167006.914949:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454437632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.914955:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1762167006.914979:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.915015:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.915032:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.915045:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.915068:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454437760 00000100:00100000:1.0:1762167006.915072:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454437760 00000100:00100000:1.0:1762167006.915096:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1762167006.915103:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454437760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167006.915156:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454437760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.915164:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1762167006.915173:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.915205:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.915229:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.915250:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.915251:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454437888 00000100:00100000:1.0:1762167006.915255:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454437888 00000100:00100000:1.0:1762167006.915280:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1762167006.915286:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454437888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167006.915336:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454437888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.915343:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1762167006.915349:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454437888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.915405:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.915427:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.915446:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.915471:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454438016 00000100:00100000:3.0:1762167006.915476:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454438016 00000100:00100000:3.0:1762167006.915508:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1762167006.915517:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454438016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.915574:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454438016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.915581:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1762167006.915593:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.915626:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.915649:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.915669:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.915689:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454438144 00000100:00100000:3.0:1762167006.915694:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454438144 00000100:00100000:3.0:1762167006.915719:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1762167006.915726:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454438144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.915795:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454438144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.915801:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1762167006.915840:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.915872:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.915892:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.915910:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.915917:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454438272 00000100:00100000:3.0:1762167006.915921:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454438272 00000100:00100000:3.0:1762167006.915943:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1762167006.915950:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454438272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.916010:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454438272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.916016:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1762167006.916017:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916046:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916066:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.916081:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.916089:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454438400 00000100:00100000:3.0:1762167006.916093:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454438400 00000100:00100000:3.0:1762167006.916117:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1762167006.916124:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454438400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.916180:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454438400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 57us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.916186:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1762167006.916201:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916232:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916251:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.916267:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.916274:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454438528 00000100:00100000:3.0:1762167006.916278:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454438528 00000100:00100000:3.0:1762167006.916299:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1762167006.916305:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454438528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.916349:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454438528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 43us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.916354:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1762167006.916362:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916399:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916419:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167006.916443:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454438656 00000100:00100000:3.0:1762167006.916448:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454438656 00000100:00100000:3.0:1762167006.916481:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1762167006.916487:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454438656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916538:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.916598:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454438656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 110us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.916604:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1762167006.916628:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916654:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916689:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.916708:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.916718:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454438784 00000100:00100000:3.0:1762167006.916723:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454438784 00000100:00100000:3.0:1762167006.916753:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1762167006.916760:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454438784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.916830:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454438784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.916838:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1762167006.916850:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916883:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.916905:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.916925:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.916936:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454438912 00000100:00100000:3.0:1762167006.916941:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454438912 00000100:00100000:3.0:1762167006.916969:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1762167006.916975:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454438912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.917024:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454438912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.917030:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1762167006.917041:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454438912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.917067:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.917083:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.917097:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.917103:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454439040 00000100:00100000:3.0:1762167006.917106:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454439040 00000100:00100000:3.0:1762167006.917125:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1762167006.917129:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454439040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.917170:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454439040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 40us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.917177:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1762167006.917191:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.917222:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.917245:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.917264:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.917275:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454439168 00000100:00100000:3.0:1762167006.917279:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454439168 00000100:00100000:3.0:1762167006.917299:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1762167006.917303:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454439168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.917341:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454439168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 37us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.917348:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1762167006.917364:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242521880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.917409:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.917429:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.917446:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.917454:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454439296 00000100:00100000:3.0:1762167006.917458:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454439296 00000100:00100000:3.0:1762167006.917478:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1762167006.917482:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454439296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.917519:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454439296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 36us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.917524:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1762167006.917535:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.917566:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.917587:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.917604:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.917616:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454439424 00000100:00100000:3.0:1762167006.917621:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454439424 00000100:00100000:3.0:1762167006.917645:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1762167006.917652:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454439424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.917698:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454439424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 46us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167006.917706:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1762167006.917717:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439424:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:0.0:1762167006.918023:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].51, 1000 off64352 00000001:00080000:0.0:1762167006.918031:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952846 00000100:00100000:0.0:1762167006.918088:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.918111:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.918133:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.918173:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454439552 00000100:00100000:3.0:1762167006.918177:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454439552 00000100:00100000:3.0:1762167006.918204:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1762167006.918209:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454439552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.918469:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:30820:x1847765454439552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 258us (356us total) trans 21474843273 rc 0/0 00000100:00100000:3.0:1762167006.918478:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1762167006.918503:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.918524:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167006.918543:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167006.918562:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a480 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.918582:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454439680 00000100:00100000:3.0:1762167006.918586:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454439680 00000100:00100000:3.0:1762167006.918610:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1762167006.918614:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454439680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167006.918746:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:30820:x1847765454439680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 130us (200us total) trans 17179875736 rc 0/0 00000100:00100000:3.0:1762167006.918753:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1762167006.918809:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454439680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1762167006.918896:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952847 00010000:00010000:0.0:1762167006.918917:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.918925:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.918930:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.918936:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.918940:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.918947:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.918961:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.918964:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762167006.918968:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.918974:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a621 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.918995:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.919001:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.919006:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.919011:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.919014:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.919019:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.919026:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:0.0:1762167006.919028:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762167006.919031:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.919036:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a61a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.919047:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:0.0:1762167006.919049:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167006.919055:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a572 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3700 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.919137:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56201:x1847765451826560:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 10846us (10947us total) trans 8589952848 rc 0/0 00000100:00100000:0.0:1762167006.919146:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7324 00000020:00080000:0.0:1762167006.919150:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762167006.920719:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.920790:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451827328 00000100:00100000:0.0:1762167006.920797:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451827328 00000100:00100000:0.0:1762167006.920840:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19751 00000100:00100000:0.0:1762167006.920851:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56201:x1847765451827328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.920873:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.920894:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a628 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3746 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.920945:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a628 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3746 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.920958:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a628 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3746 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.920975:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167006.920979:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167006.920982:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8a00, rc 0) 00000100:00100000:0.0:1762167006.921026:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56201:x1847765451827328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 178us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.921033:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19751 00000100:00100000:1.0:1762167006.922898:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.922961:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451827584 00000100:00100000:0.0:1762167006.922968:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451827584 00000100:00100000:0.0:1762167006.923016:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7326 00000100:00100000:0.0:1762167006.923026:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56201:x1847765451827584:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167006.923220:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56201:x1847765451827584:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 196us (326us total) trans 8589952849 rc 0/0 00000100:00100000:0.0:1762167006.923229:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7326 00000100:00100000:1.0:1762167006.924736:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.924806:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451827840 00000100:00100000:0.0:1762167006.924813:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451827840 00000100:00100000:0.0:1762167006.924861:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7327 00000100:00100000:0.0:1762167006.924871:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee358653850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56201:x1847765451827840:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762167006.925113:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x64b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762167006.925225:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.925242:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.925254:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.925263:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.925270:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.925276:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167006.925299:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762167006.925345:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167006.925354:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.925362:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167006.925367:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.925375:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.925400:0:32135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64b:0x0].0x0 (ffff9ee2446b8f00) 00000100:00100000:0.0:1762167006.925402:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee358653850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56201:x1847765451827840:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 531us (669us total) trans 8589952850 rc 0/0 00010000:00010000:1.0:1762167006.925404:0:32135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762167006.925411:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 1/0,0 mode: --/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167006.925415:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7327 00010000:00010000:1.0:1762167006.925424:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0a62f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167006.925447:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167006.925450:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167006.925452:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167006.935031:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.935105:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451827968 00000100:00100000:0.0:1762167006.935116:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451827968 00000100:00100000:0.0:1762167006.935178:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19752 00000100:00100000:0.0:1762167006.935190:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56202:x1847765451827968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.935212:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.935244:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a636 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb374d expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.935322:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a63d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935339:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a63d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935349:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a63d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935363:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a644 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935369:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a644 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935375:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a644 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935490:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935498:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935504:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.935536:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00000004:00200000:0.0:1762167006.935540:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167006.935555:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935566:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935574:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a63d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935584:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a63d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935589:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a63d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935595:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.935599:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a63d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935605:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a63d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935616:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167006.935619:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.935623:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a63d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935629:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a63d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935642:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a644 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935647:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a644 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935653:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a644 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935657:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167006.935659:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a644 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935668:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a644 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935675:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167006.935677:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167006.935679:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a644 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935685:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a644 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.935718:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a636 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb374d expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.935731:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb374d expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.935738:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167006.935741:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167006.935743:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:0.0:1762167006.935822:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56202:x1847765451827968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 634us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.935830:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19752 00000100:00100000:3.0:1762167006.937460:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.937503:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451828224 00000100:00100000:0.0:1762167006.937510:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451828224 00000100:00100000:0.0:1762167006.937553:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19753 00000100:00100000:0.0:1762167006.937561:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56202:x1847765451828224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.937575:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.937590:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a652 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3754 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.937661:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a659 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.937669:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a659 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.937675:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a659 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.937683:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:0.0:1762167006.937802:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a652 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3754 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.937816:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a659 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3754 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.937824:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167006.937827:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762167006.937830:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8600, rc 0) 00000100:00100000:0.0:1762167006.937875:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56202:x1847765451828224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 315us (420us total) trans 8589952851 rc 0/0 00000100:00100000:0.0:1762167006.937882:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19753 00000100:00100000:1.0:1762167006.939214:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.939264:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451828480 00000100:00100000:0.0:1762167006.939272:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451828480 00000100:00100000:0.0:1762167006.939330:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19754 00000100:00100000:0.0:1762167006.939343:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56202:x1847765451828480:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.939360:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.939378:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a667 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb375b expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.939468:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a66e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.939480:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a66e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.939489:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a66e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.939501:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00010000:00010000:0.0:1762167006.939591:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a667 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb375b expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.939607:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a66e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb375b expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.939616:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167006.939619:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167006.939622:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:0.0:1762167006.939670:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56202:x1847765451828480:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 328us (460us total) trans 8589952852 rc 0/0 00000100:00100000:0.0:1762167006.939677:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19754 00000100:00100000:1.0:1762167006.965089:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.965162:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451828608 00000100:00100000:0.0:1762167006.965177:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451828608 00000100:00100000:0.0:1762167006.965247:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2854 00000100:00100000:0.0:1762167006.965255:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451828608:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167006.965287:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.965305:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.965320:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167006.965325:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167006.965328:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.965362:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.965376:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 21 pid: 33892 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.965413:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:14122:1847765454439808:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.965476:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a900 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.966523:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:14122:1847765454439808:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.966554:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.966693:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.966803:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451828736 00000100:00100000:2.0:1762167006.966810:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451828736 00010000:00010000:2.0:1762167006.966838:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 22 pid: 33892 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.966877:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7461 00000100:00100000:2.0:1762167006.966885:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451828736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.966897:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.966917:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 22 pid: 33892 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.966935:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 22 pid: 33892 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.966955:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0a605 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3731 expref: 22 pid: 33892 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.966969:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.966970:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167006.966975:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.966983:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.967008:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.967047:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.967059:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451828736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 172us (364us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167006.967060:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.967074:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7461 00010000:00010000:0.0:1762167006.968168:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.968181:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.968188:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.968194:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167006.968198:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.968205:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.968219:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.968226:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a67c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.968282:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451828608:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3025us (3202us total) trans 0 rc 26859/26859 00000100:00100000:0.0:1762167006.968291:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2854 00000100:00100000:3.0:1762167006.969977:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.970030:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.970067:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451828864 00000100:00100000:0.0:1762167006.970081:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451828864 00000100:00100000:1.0:1762167006.970102:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451828992 00000100:00100000:1.0:1762167006.970109:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451828992 00000100:00100000:0.0:1762167006.970156:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16753 00000100:00100000:0.0:1762167006.970172:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451828864:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:1.0:1762167006.970173:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16754 00000100:00100000:1.0:1762167006.970189:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451828992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167006.970193:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167006.970201:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.970211:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a683 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3762 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.970217:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a68a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3769 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.970265:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454439936:192.168.203.35@tcp:106: 00000100:00100000:1.0:1762167006.970266:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454440064:192.168.203.35@tcp:106: 00000100:00100000:1.0:1762167006.970351:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.970352:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167006.971269:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454440064:192.168.203.35@tcp:106: 00000100:00100000:0.0:1762167006.971272:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454439936:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762167006.971300:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a68a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3769 expref: 30 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.971301:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a683 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3762 expref: 21 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.971335:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a68a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3769 expref: 30 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.971336:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a683 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3762 expref: 21 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167006.971366:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00010000:00010000:0.0:1762167006.971367:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9000, rc 0) 00000100:00100000:0.0:1762167006.971428:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451828864:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1261us (1463us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167006.971434:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451828992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1245us (1401us total) trans 0 rc 301/301 00000100:00100000:0.0:1762167006.971441:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16753 00000100:00100000:3.0:1762167006.971450:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16754 00000100:00100000:2.0:1762167006.972751:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.972826:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451829120 00000100:00100000:0.0:1762167006.972833:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451829120 00000100:00100000:0.0:1762167006.972885:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2855 00000100:00100000:0.0:1762167006.972895:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451829120:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167006.972921:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.972934:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a5e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3723 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.972943:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167006.972944:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167006.972946:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.972970:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a5e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3723 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.972982:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a5e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3723 expref: 20 pid: 26444 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.972994:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:14122:1847765454440192:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.973051:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a900 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.973854:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:14122:1847765454440192:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.973872:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167006.974070:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167006.974116:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451829248 00000100:00100000:1.0:1762167006.974122:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451829248 00010000:00010000:1.0:1762167006.974147:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a5e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3723 expref: 21 pid: 26444 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1762167006.974178:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7462 00000100:00100000:1.0:1762167006.974187:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451829248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167006.974198:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167006.974216:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a5e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3723 expref: 21 pid: 26444 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.974227:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a5e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3723 expref: 21 pid: 26444 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.974243:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a5e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3723 expref: 21 pid: 26444 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1762167006.974253:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.974254:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167006.974257:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.974264:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.974284:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.974301:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.974312:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167006.974336:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451829248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 149us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.974345:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7462 00010000:00010000:0.0:1762167006.975108:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.975129:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.975140:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.975147:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167006.975151:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.975160:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.975172:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.975179:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a691 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167006.975221:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451829120:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2329us (2474us total) trans 0 rc 26859/26859 00000100:00100000:0.0:1762167006.975227:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2855 00000100:00100000:1.0:1762167006.982317:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.982421:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451829376 00000100:00100000:2.0:1762167006.982434:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451829376 00000100:00100000:2.0:1762167006.982513:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 643 00000100:00100000:2.0:1762167006.982525:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56202:x1847765451829376:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762167006.982548:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.982578:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0a66e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb375b expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167006.982622:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:2.0:1762167006.982629:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167006.982700:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56202:x1847765451829376:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 177us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.982709:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 643 00000100:00100000:2.0:1762167006.983967:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.984043:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451829632 00000100:00100000:0.0:1762167006.984057:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451829632 00000100:00100000:0.0:1762167006.984123:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7328 00000100:00100000:0.0:1762167006.984135:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56202:x1847765451829632:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167006.984399:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56202:x1847765451829632:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 254us (423us total) trans 8589952853 rc 0/0 00000100:00100000:0.0:1762167006.984408:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7328 00000100:00100000:1.0:1762167006.987062:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.987148:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451829888 00000100:00100000:0.0:1762167006.987156:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451829888 00000100:00100000:0.0:1762167006.987210:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19755 00000100:00100000:0.0:1762167006.987219:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451829888:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167006.987239:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.987257:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a698 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3770 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.987354:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.987368:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb374d expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.987395:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.987427:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb374d expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.987441:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb374d expref: 904 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.987455:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454440320:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.987533:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a480 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.988957:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454440320:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.988982:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.989493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.989546:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451830016 00000100:00100000:2.0:1762167006.989555:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451830016 00010000:00010000:2.0:1762167006.989590:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb374d expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.989628:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7463 00000100:00100000:2.0:1762167006.989638:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2361:x1847765451830016:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.989651:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.989657:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb374d expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.989669:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb374d expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.989692:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a64b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb374d expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.989709:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:2.0:1762167006.989715:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.989729:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.989737:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.989789:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167006.989821:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.989831:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167006.989852:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00000100:00100000:2.0:1762167006.989866:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2361:x1847765451830016:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 218us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167006.989877:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7463 00010000:00010000:0.0:1762167006.990038:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a698 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3770 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.990055:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3770 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.990062:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167006.990066:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167006.990068:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9a00, rc 0) 00000100:00100000:0.0:1762167006.990115:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451829888:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2896us (3062us total) trans 8589952854 rc 0/0 00000100:00100000:0.0:1762167006.990123:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19755 00000100:00100000:1.0:1762167006.991888:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167006.991936:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451830144 00000100:00100000:0.0:1762167006.991945:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451830144 00000100:00100000:0.0:1762167006.991997:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19756 00000100:00100000:0.0:1762167006.992008:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451830144:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167006.992035:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167006.992058:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a6ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3777 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.992140:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.992154:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3770 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.992161:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167006.992195:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3770 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167006.992209:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3770 expref: 905 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167006.992222:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454440448:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167006.992318:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a480 going to sleep for 11 seconds 00000100:00100000:0.0:1762167006.993564:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454440448:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167006.993588:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167006.994036:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167006.994546:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451830272 00000100:00100000:2.0:1762167006.994554:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451830272 00010000:00010000:2.0:1762167006.994586:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3770 expref: 906 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:2.0:1762167006.994631:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7464 00000100:00100000:2.0:1762167006.994641:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:2361:x1847765451830272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167006.994656:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167006.994664:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3770 expref: 906 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.994676:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3770 expref: 906 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.994697:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0a69f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3770 expref: 906 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167006.994715:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:2.0:1762167006.994720:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.994728:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.994735:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167006.994785:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167006.994804:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.994812:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167006.994843:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2361:x1847765451830272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 202us (807us total) trans 0 rc 0/0 00000004:00200000:1.0:1762167006.994849:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 26859 00000100:00100000:2.0:1762167006.994854:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7464 00000004:00200000:1.0:1762167006.994855:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167006.994872:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167006.994904:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a6ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3777 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.994921:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3777 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167006.994930:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:1.0:1762167006.994933:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167006.994936:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9800, rc 0) 00000100:00100000:1.0:1762167006.994985:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451830144:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2980us (3104us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167006.994990:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19756 00000100:00100000:1.0:1762167006.997254:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.997301:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451830400 00000100:00100000:3.0:1762167006.997309:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451830400 00000100:00100000:1.0:1762167006.997323:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167006.997358:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451830528 00000100:00100000:3.0:1762167006.997362:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451830528 00000100:00100000:0.0:1762167006.997379:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16755 00000100:00100000:0.0:1762167006.997406:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451830400:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167006.997424:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167006.997436:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16756 00000100:00100000:3.0:1762167006.997445:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451830528:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167006.997446:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a6bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb377e expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167006.997454:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167006.997465:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a6c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3785 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167006.997476:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 26859, mtime: 0x690888de, atime: 0x690888de, ctime: 0x690888df, blocks: 0x43 00010000:00010000:0.0:1762167006.997489:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.997491:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167006.997499:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a6bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb377e expref: 20 pid: 12400 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167006.997514:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454440576:192.168.203.35@tcp:106: 00010000:00010000:0.0:1762167006.997515:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a6bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb377e expref: 20 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167006.997528:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9400, rc 0) 00000100:00100000:0.0:1762167006.997577:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451830400:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 178us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167006.997586:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16755 00000100:00100000:3.0:1762167006.997596:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167006.998654:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454440576:192.168.203.35@tcp:106: 00010000:00010000:1.0:1762167006.998682:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a6c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3785 expref: 30 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.998699:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a6c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3785 expref: 30 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167006.998711:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:1.0:1762167006.998755:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451830528:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1310us (1431us total) trans 0 rc 301/301 00000100:00100000:1.0:1762167006.998797:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16756 00000100:00100000:1.0:1762167007.000144:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.000180:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451830656 00000100:00100000:3.0:1762167007.000187:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451830656 00000100:00100000:3.0:1762167007.000222:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16757 00000100:00100000:3.0:1762167007.000228:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451830656:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167007.000239:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.000249:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a6c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb378c expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.000284:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454440704:192.168.203.35@tcp:106: 00000100:00100000:3.0:1762167007.000331:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.001218:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454440704:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762167007.001245:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a6c9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb378c expref: 30 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.001263:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a6c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb378c expref: 30 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.001276:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:3.0:1762167007.001310:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451830656:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1082us (1169us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167007.001315:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16757 00000100:00100000:1.0:1762167007.002656:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.002717:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451830912 00000100:00100000:0.0:1762167007.002726:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451830912 00000100:00080000:2.0:1762167007.002800:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762167007.002889:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19757 00000100:00100000:0.0:1762167007.002902:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451830912:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167007.002956:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.002979:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3777 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.002997:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167007.003001:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.003221:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.003236:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.003243:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:0.0:1762167007.003292:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952855 00000004:00010000:0.0:1762167007.003320:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b46dcafd reply state 0000000085e3697a transno 8589952856 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167007.003328:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167007.003413:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56065:x1847765451830912:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 516us (761us total) trans 8589952856 rc 0/0 00000100:00100000:0.0:1762167007.003420:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19757 00000020:00080000:0.0:1762167007.003430:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167007.004416:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.004429:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.004437:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.004443:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167007.004448:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.004456:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.004471:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167007.004475:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167007.004479:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.004485:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6d0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167007.004516:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.004567:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451831168 00000100:00100000:0.0:1762167007.004575:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451831168 00000100:00100000:0.0:1762167007.004619:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7329 00000100:00100000:0.0:1762167007.004627:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451831168:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167007.004818:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56065:x1847765451831168:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 190us (302us total) trans 8589952857 rc 0/0 00000100:00100000:0.0:1762167007.004826:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7329 00000100:00100000:1.0:1762167007.006337:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.006422:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451831424 00000100:00100000:0.0:1762167007.006435:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451831424 00000100:00100000:0.0:1762167007.006510:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19758 00000100:00100000:0.0:1762167007.006522:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56065:x1847765451831424:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.006554:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.006559:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762167007.006601:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a659 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3754 expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.006629:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a628 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3746 expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.006640:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167007.006653:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.006675:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a6d7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3793 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.006742:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a6de lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.006757:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a6de lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.006811:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a6de lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000040:00080000:0.0:1762167007.007455:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5403, 88 off435824 00000004:00080000:0.0:1762167007.007468:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627799704208ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.007546:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5411, 88 off436880 00000004:00080000:0.0:1762167007.007553:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627799790622ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.007599:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5412, 88 off436968 00000004:00080000:0.0:1762167007.007605:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627799842236ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.007636:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5404, 88 off435912 00000004:00080000:0.0:1762167007.007641:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627799877638ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.007671:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5413, 88 off437056 00000004:00080000:0.0:1762167007.007675:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627799912585ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.007707:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5405, 88 off436000 00000004:00080000:0.0:1762167007.007712:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627799949275ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.007740:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5406, 88 off436088 00000004:00080000:0.0:1762167007.007744:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627799981598ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.007817:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5414, 88 off437144 00000004:00080000:0.0:1762167007.007822:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627800059753ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.007852:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5415, 88 off437232 00000004:00080000:0.0:1762167007.007857:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627800094623ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.007876:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5407, 88 off436176 00000004:00080000:0.0:1762167007.007881:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627800118285ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.007914:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5416, 88 off437320 00000004:00080000:0.0:1762167007.007918:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627800155508ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.007950:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5408, 88 off436264 00000004:00080000:0.0:1762167007.007955:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627800192388ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.007980:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5409, 88 off436352 00000004:00080000:0.0:1762167007.007984:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627800221758ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.008011:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5417, 88 off437408 00000004:00080000:0.0:1762167007.008016:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627800253070ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.008042:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5418, 88 off437496 00000004:00080000:0.0:1762167007.008047:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627800284150ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.008073:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5410, 88 off436440 00000004:00080000:0.0:1762167007.008077:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627800314183ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.008099:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5411, 88 off436528 00000004:00080000:0.0:1762167007.008102:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 627800339158ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.008111:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5419, 88 off437584 00000004:00080000:0.0:1762167007.008114:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 627800351716ns, next at 628532566027ns, rc = 0 00000001:00080000:2.0:1762167007.022197:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952858 is committed 00000004:00080000:2.0:1762167007.022208:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3532 committed 00000004:00080000:2.0:1762167007.022222:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3519 committed 00010000:00010000:3.0:1762167007.022229:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a6de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3793 expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762167007.022233:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3518 committed 00000004:00080000:2.0:1762167007.022236:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3531 committed 00000004:00080000:2.0:1762167007.022238:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3530 committed 00000004:00080000:2.0:1762167007.022242:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3517 committed 00010000:00010000:3.0:1762167007.022244:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee363960b00) 00000004:00080000:2.0:1762167007.022244:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3516 committed 00000004:00080000:2.0:1762167007.022247:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3529 committed 00010000:00010000:3.0:1762167007.022248:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:2.0:1762167007.022251:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3515 committed 00000004:00080000:2.0:1762167007.022253:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3528 committed 00000004:00080000:2.0:1762167007.022257:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3527 committed 00000004:00080000:2.0:1762167007.022260:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3514 committed 00000004:00080000:2.0:1762167007.022262:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3513 committed 00000004:00080000:2.0:1762167007.022264:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3526 committed 00010000:00010000:3.0:1762167007.022266:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a6d7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3793 expref: 906 pid: 32138 timeout: 0 lvb_type: 3 00000004:00080000:2.0:1762167007.022266:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3512 committed 00000004:00080000:2.0:1762167007.022269:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3525 committed 00000004:00080000:2.0:1762167007.022271:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3524 committed 00000004:00080000:2.0:1762167007.022274:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3511 committed 00010000:00010000:3.0:1762167007.022286:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a6de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3793 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1762167007.022308:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee349c6ad80 refcount 2 committed 0 result 0 batchid 4294969183 00000020:00080000:2.0:1762167007.022312:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee343ef4200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37fca8300 00010000:00010000:3.0:1762167007.022317:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee363960b00) 00000020:00080000:2.0:1762167007.022317:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee343ef4600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee349c6a0c0 00010000:00010000:3.0:1762167007.022321:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000020:00080000:2.0:1762167007.022321:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee343ef4a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37fa07c00 00010000:00010000:3.0:1762167007.022324:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8e00, rc 0) 00000020:00080000:2.0:1762167007.022324:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].51 00000020:00080000:2.0:1762167007.022350:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969182 batchid updated 00000100:00100000:3.0:1762167007.022402:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451831424:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 15881us (16076us total) trans 8589952858 rc 0/0 00000100:00100000:3.0:1762167007.022414:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19758 00000100:00100000:1.0:1762167007.022486:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454440832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.022501:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454440960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.022543:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.022593:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454441472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.022596:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.022623:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454441088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.022648:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.022648:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454441344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.022673:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454441600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.022682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.022703:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454441216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.022718:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454441856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.022726:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.022750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.022753:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454441728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.022937:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454440832 00000100:00100000:1.0:1762167007.022937:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454440960 00000100:00100000:1.0:1762167007.022946:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454440960 00000100:00100000:3.0:1762167007.022947:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454440832 00000100:00100000:0.0:1762167007.022955:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454442368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.022984:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.023125:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454441088 00000100:00100000:3.0:1762167007.023126:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454441344 00000100:00100000:2.0:1762167007.023127:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454441216 00000100:00100000:1.0:1762167007.023130:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454441088 00000100:00100000:3.0:1762167007.023132:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454441344 00000100:00100000:2.0:1762167007.023133:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454441216 00000100:00100000:1.0:1762167007.023154:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454441856 00000100:00100000:0.0:1762167007.023158:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454442368 00000100:00100000:1.0:1762167007.023159:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454441856 00000100:00100000:0.0:1762167007.023165:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454442368 00000100:00100000:2.0:1762167007.023169:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16758 00000100:00100000:3.0:1762167007.023176:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16759 00000100:00100000:2.0:1762167007.023178:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454440960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.023192:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454440832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.023195:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16760 00000100:00100000:0.0:1762167007.023206:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16761 00000100:00100000:1.0:1762167007.023208:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3293:x1847765454441088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.023218:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454441216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167007.023364:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.023368:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.023370:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.023373:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.023376:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167007.023403:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454440960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (810us total) trans 21474843275 rc 0/0 00000100:00100000:2.0:1762167007.023410:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16758 00000100:00100000:2.0:1762167007.023429:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16762 00000100:00100000:2.0:1762167007.023437:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454441344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.023443:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454441216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 229us (716us total) trans 21474843274 rc 0/0 00000100:00100000:0.0:1762167007.023450:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16761 00002000:00010000:1.0:1762167007.023459:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.023463:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.023465:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.023467:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.023469:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167007.023473:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16763 00002000:00010000:3.0:1762167007.023481:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167007.023485:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454441856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167007.023487:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167007.023494:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762167007.023496:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167007.023499:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.023501:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454441088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 295us (852us total) trans 17179875737 rc 0/0 00000100:00100000:1.0:1762167007.023507:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16760 00000100:00100000:1.0:1762167007.023521:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16764 00000100:00100000:1.0:1762167007.023529:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454442368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.023543:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454440832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 357us (999us total) trans 17179875738 rc 0/0 00000100:00100000:3.0:1762167007.023549:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16759 00000100:00100000:2.0:1762167007.023583:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454441344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (900us total) trans 17179875739 rc 0/0 00000100:00100000:2.0:1762167007.023590:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16762 00002000:00010000:1.0:1762167007.023636:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.023639:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.023642:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167007.023645:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.023647:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167007.023660:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454441856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (910us total) trans 21474843276 rc 0/0 00000100:00100000:0.0:1762167007.023668:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16763 00000100:00100000:1.0:1762167007.023682:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454442368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (695us total) trans 21474843277 rc 0/0 00000100:00100000:1.0:1762167007.023691:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16764 00000100:00100000:0.0:1762167007.023702:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.023719:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454441600 00000100:00100000:1.0:1762167007.023724:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454441600 00000100:00100000:0.0:1762167007.023735:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454442112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.023759:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.023851:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454442112 00000100:00100000:3.0:1762167007.023859:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16765 00000100:00100000:1.0:1762167007.023864:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454442112 00000100:00100000:0.0:1762167007.023865:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454442624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.023871:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454441600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.023888:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16766 00000100:00100000:0.0:1762167007.023898:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.023899:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454442112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.023927:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454442624 00000100:00100000:2.0:1762167007.023932:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454442624 00000004:00080000:0.0:1762167007.023946:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346a2f100/2, rc 0, transno 17179875737 00000100:00100000:0.0:1762167007.023959:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454441088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.023961:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16767 00000100:00100000:2.0:1762167007.023968:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454442624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.023980:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167007.023985:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.023990:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.023992:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167007.023994:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.023996:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.023997:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167007.023999:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.024001:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00000100:00100000:0.0:1762167007.024004:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454442240:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167007.024005:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.024012:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.024040:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454442112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (279us total) trans 21474843278 rc 0/0 00000100:00100000:3.0:1762167007.024046:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454441600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (345us total) trans 21474843279 rc 0/0 00000100:00100000:0.0:1762167007.024049:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.024053:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16766 00000100:00100000:3.0:1762167007.024057:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16765 00000100:00100000:3.0:1762167007.024070:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454442240 00000100:00100000:1.0:1762167007.024070:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454441728 00000100:00100000:3.0:1762167007.024073:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454442240 00000100:00100000:1.0:1762167007.024073:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454441728 00000100:00100000:0.0:1762167007.024078:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454442752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.024095:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16768 00000100:00100000:1.0:1762167007.024099:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16769 00000100:00100000:3.0:1762167007.024103:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454442240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.024108:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454441728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.024111:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.024115:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454442624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (220us total) trans 21474843280 rc 0/0 00000100:00100000:2.0:1762167007.024122:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16767 00000100:00100000:2.0:1762167007.024134:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454442752 00000004:00080000:0.0:1762167007.024134:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243304000/2, rc 0, transno 21474843274 00000100:00100000:2.0:1762167007.024138:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454442752 00000100:00100000:0.0:1762167007.024144:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454441216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.024162:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16770 00000100:00100000:2.0:1762167007.024170:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454442752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.024174:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.024194:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454441984:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167007.024214:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.024218:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167007.024219:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 154055 -> 154055 00002000:00010000:3.0:1762167007.024222:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167007.024226:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.024226:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167007.024226:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167007.024231:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167007.024236:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167007.024240:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454442496:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167007.024245:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.024251:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167007.024269:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.024272:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.024275:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.024276:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.024278:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167007.024346:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.024362:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454442240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 258us (315us total) trans 17179875740 rc 0/0 00000100:00100000:1.0:1762167007.024363:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454441728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 258us (383us total) trans 17179875741 rc 0/0 00000100:00100000:2.0:1762167007.024368:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454442752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (259us total) trans 21474843281 rc 0/0 00000100:00100000:3.0:1762167007.024375:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16768 00000004:00080000:0.0:1762167007.024378:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346a2ca80/2, rc 0, transno 17179875738 00000100:00100000:1.0:1762167007.024393:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16769 00000100:00100000:0.0:1762167007.024397:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454440832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.024401:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16770 00000100:00100000:3.0:1762167007.024402:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454441472 00000100:00100000:3.0:1762167007.024408:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454441472 00000100:00100000:1.0:1762167007.024408:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454441984 00000100:00100000:1.0:1762167007.024411:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454441984 00000100:00100000:0.0:1762167007.024421:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454442496 00000100:00100000:0.0:1762167007.024426:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454442496 00000100:00100000:2.0:1762167007.024430:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16771 00000100:00100000:3.0:1762167007.024436:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16772 00000100:00100000:2.0:1762167007.024438:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3296:x1847765454441472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.024448:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3296:x1847765454441984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.024448:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16773 00000100:00100000:1.0:1762167007.024456:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3296:x1847765454442496:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167007.024511:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346a2e680/2, rc 0, transno 17179875741 00000100:00100000:0.0:1762167007.024518:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454441728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167007.024527:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc2b800/2, rc 0, transno 17179875740 00000100:00100000:0.0:1762167007.024531:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454442240:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167007.024542:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de01f80/2, rc 0, transno 21474843281 00000100:00100000:0.0:1762167007.024546:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454442752:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167007.024553:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.024556:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.024559:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167007.024561:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.024564:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167007.024564:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454442880:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167007.024574:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 205925 -> 205925 00002000:00010000:1.0:1762167007.024580:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.024582:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.024585:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.024588:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167007.024594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.024607:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3296:x1847765454441472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (431us total) trans 17179875742 rc 0/0 00000100:00100000:3.0:1762167007.024613:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3296:x1847765454441984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (388us total) trans 17179875744 rc 0/0 00000100:00100000:2.0:1762167007.024620:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16771 00000100:00100000:3.0:1762167007.024627:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16772 00000004:00080000:0.0:1762167007.024627:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243307b80/2, rc 0, transno 21474843275 00000100:00100000:1.0:1762167007.024629:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3296:x1847765454442496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 174us (283us total) trans 17179875743 rc 0/0 00000100:00100000:2.0:1762167007.024635:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454442880 00000100:00100000:0.0:1762167007.024637:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454440960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.024639:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454442880 00000100:00100000:1.0:1762167007.024642:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16773 00000004:00080000:0.0:1762167007.024653:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346a2c700/2, rc 0, transno 17179875739 00000100:00100000:0.0:1762167007.024660:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454441344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.024665:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16774 00000100:00100000:1.0:1762167007.024673:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454442880:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167007.024675:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243305500/2, rc 0, transno 21474843276 00000100:00100000:0.0:1762167007.024681:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454441856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167007.024692:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de00a80/2, rc 0, transno 21474843277 00000100:00100000:0.0:1762167007.024696:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454442368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167007.024731:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346a2f480/2, rc 0, transno 17179875742 00000100:00100000:0.0:1762167007.024737:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454441472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167007.024749:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28e00/2, rc 0, transno 17179875744 00000100:00100000:0.0:1762167007.024754:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454441984:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167007.024781:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 26859 -> 26859 00002000:00010000:1.0:1762167007.024786:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00000004:00080000:0.0:1762167007.024786:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc2ad80/2, rc 0, transno 17179875743 00000100:00100000:2.0:1762167007.024792:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:1.0:1762167007.024794:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167007.024794:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454442496:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167007.024800:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.024804:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 67 -> 67 00000100:00100000:3.0:1762167007.024809:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451831552 00000100:00100000:3.0:1762167007.024813:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451831552 00000100:00100000:1.0:1762167007.024844:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454442880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (251us total) trans 21474843282 rc 0/0 00000100:00080000:2.0:1762167007.024846:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762167007.024846:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454443008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.024859:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16774 00000100:00100000:0.0:1762167007.024877:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.024905:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454443008 00000100:00100000:3.0:1762167007.024909:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454443008 00000100:00100000:1.0:1762167007.024913:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16775 00000100:00100000:1.0:1762167007.024920:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56065:x1847765451831552:12345-192.168.203.35@tcp:101:fsx.0 00000100:00100000:0.0:1762167007.024925:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16776 00010000:00010000:1.0:1762167007.024931:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762167007.024937:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3296:x1847765454443008:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762167007.024949:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a6e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb379a expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167007.024967:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 26859, mtime: 0x690888de, atime: 0x690888de, ctime: 0x690888df, blocks: 0x2f 00010000:00010000:1.0:1762167007.024982:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.024985:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.024993:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a6e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb379a expref: 21 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.025014:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a6e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb379a expref: 21 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.025025:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a000, rc 0) 00002000:00010000:0.0:1762167007.025026:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.025031:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.025033:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.025036:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.025038:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167007.025072:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56065:x1847765451831552:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 152us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.025080:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16775 00000100:00100000:0.0:1762167007.025087:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3296:x1847765454443008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (208us total) trans 17179875745 rc 0/0 00000100:00100000:0.0:1762167007.025094:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16776 00000020:00080000:1.0:1762167007.025100:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969183 committed batchid 4294969182 00000004:00080000:2.0:1762167007.025154:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2477d3100/2, rc 0, transno 17179875745 00000100:00100000:2.0:1762167007.025160:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454443008:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1762167007.025358:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969182 cancel update log [0x200000bd0:0x1:0x0].50: rc = 0 00000020:00080000:1.0:1762167007.025367:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969182 00000004:00080000:1.0:1762167007.025397:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243305180/2, rc 0, transno 21474843279 00000100:00100000:1.0:1762167007.025401:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454441600:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167007.025409:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242520700/2, rc 0, transno 21474843278 00000100:00100000:1.0:1762167007.025411:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454442112:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167007.025415:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03480/2, rc 0, transno 21474843280 00000100:00100000:1.0:1762167007.025417:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454442624:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167007.025429:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2477d2300/2, rc 0, transno 21474843282 00000100:00100000:1.0:1762167007.025431:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454442880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.026302:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.026334:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.026360:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451831680 00000100:00100000:0.0:1762167007.026366:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451831680 00000100:00100000:2.0:1762167007.026370:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:0.0:1762167007.026401:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (240971->18446744073709551615) 00000100:00100000:3.0:1762167007.026403:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451831808 00002000:00100000:0.0:1762167007.026405:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b1c00 with x1847765451831680 ext(240971->18446744073709551615) 00000100:00100000:3.0:1762167007.026410:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451831808 00002000:00010000:0.0:1762167007.026413:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b1c00. 00000100:00100000:0.0:1762167007.026438:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451831936 00002000:00010000:3.0:1762167007.026442:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:0.0:1762167007.026443:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451831936 00002000:00100000:3.0:1762167007.026448:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b3800 with x1847765451831808 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167007.026451:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2856 00000100:00080000:2.0:1762167007.026454:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1762167007.026456:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b3800. 00002000:00010000:0.0:1762167007.026460:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:1.0:1762167007.026466:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451831680:12345-192.168.203.35@tcp:10:fsx.0 00002000:00100000:0.0:1762167007.026466:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0a80 with x1847765451831936 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.026477:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b0a80. 00000100:00100000:3.0:1762167007.026482:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2857 00000100:00100000:3.0:1762167007.026494:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451831808:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167007.026510:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2858 00000100:00100000:2.0:1762167007.026522:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451831936:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167007.026646:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 26859 -> 240971 00002000:00010000:1.0:1762167007.026649:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:1.0:1762167007.026651:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.026653:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.026654:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 47 00002000:00010000:3.0:1762167007.026691:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.026695:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:2.0:1762167007.026697:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.026698:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.026704:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:3.0:1762167007.026705:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:1.0:1762167007.026708:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2358:x1847765451831680:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 245us (407us total) trans 21474843283 rc 0/0 00002000:00010000:3.0:1762167007.026713:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167007.026713:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.026721:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:1.0:1762167007.026721:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2856 00002000:00010000:2.0:1762167007.026728:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167007.026728:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (240971->18446744073709551615) 00002000:00100000:1.0:1762167007.026733:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b1c00 with x1847765451831680 ext(240971->18446744073709551615) 00002000:00010000:1.0:1762167007.026738:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b1c00. 00000100:00100000:3.0:1762167007.026744:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451831808:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 252us (409us total) trans 17179875746 rc 0/0 00000100:00100000:3.0:1762167007.026752:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2857 00002000:00010000:3.0:1762167007.026757:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167007.026788:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b3800 with x1847765451831808 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167007.026793:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b3800. 00000100:00100000:2.0:1762167007.026808:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765451831936:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 287us (437us total) trans 21474843284 rc 0/0 00000100:00100000:2.0:1762167007.026818:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2858 00002000:00010000:2.0:1762167007.026822:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:2.0:1762167007.026826:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0a80 with x1847765451831936 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167007.026832:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b0a80. 00000100:00100000:3.0:1762167007.028106:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.028176:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451832064 00000100:00100000:0.0:1762167007.028183:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451832064 00000100:00100000:0.0:1762167007.028233:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19759 00000100:00100000:0.0:1762167007.028242:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451832064:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.028259:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.028276:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a6ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37a1 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.028345:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.028358:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.028368:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167007.028401:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 240973 00000004:00200000:0.0:1762167007.028405:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.028420:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.028443:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a6ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a1 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.028458:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a1 expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.028471:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762167007.028474:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.028477:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9000, rc 0) 00000100:00100000:0.0:1762167007.028523:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451832064:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 282us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.028530:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19759 00000100:00100000:0.0:1762167007.031061:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.031161:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451832192 00000100:00100000:2.0:1762167007.031171:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451832192 00002000:00100000:2.0:1762167007.031213:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (180224->184319) req@ffff9ee2477d2a00 x1847765451832192/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167007.031224:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d2a00 with x1847765451832192 ext(180224->184319) 00002000:00010000:2.0:1762167007.031230:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d2a00 00000100:00100000:2.0:1762167007.031262:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2859 00000100:00100000:2.0:1762167007.031272:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451832192:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167007.031518:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451832192:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 247us (464us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167007.031527:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2859 00002000:00100000:2.0:1762167007.031534:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (180224->184319) req@ffff9ee2477d2a00 x1847765451832192/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/4536 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167007.031542:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d2a00 with x1847765451832192 ext(180224->184319) 00002000:00010000:2.0:1762167007.031545:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d2a00 00000100:00100000:2.0:1762167007.033599:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.033664:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451832320 00000100:00100000:3.0:1762167007.033673:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451832320 00002000:00100000:3.0:1762167007.033713:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (212992->217087) req@ffff9ee36e3b3100 x1847765451832320/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.033724:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b3100 with x1847765451832320 ext(212992->217087) 00002000:00010000:3.0:1762167007.033728:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b3100 00000100:00100000:3.0:1762167007.033755:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2860 00000100:00100000:3.0:1762167007.033796:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451832320:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167007.034011:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451832320:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 247us (416us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762167007.034020:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2860 00002000:00100000:3.0:1762167007.034027:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (212992->217087) req@ffff9ee36e3b3100 x1847765451832320/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/4536 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.034037:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b3100 with x1847765451832320 ext(212992->217087) 00002000:00010000:3.0:1762167007.034040:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b3100 00000100:00100000:3.0:1762167007.037402:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.037558:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451832448 00000100:00100000:2.0:1762167007.037577:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451832448 00002000:00100000:2.0:1762167007.037650:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (98304->163839) req@ffff9ee37fccd180 x1847765451832448/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167007.037664:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccd180 with x1847765451832448 ext(98304->163839) 00002000:00010000:2.0:1762167007.037672:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fccd180 00000100:00100000:2.0:1762167007.037722:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2861 00000100:00100000:2.0:1762167007.037738:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451832448:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167007.040112:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451832448:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 2369us (2718us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1762167007.040124:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2861 00002000:00100000:3.0:1762167007.040137:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (98304->163839) req@ffff9ee37fccd180 x1847765451832448/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/440 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.040147:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccd180 with x1847765451832448 ext(98304->163839) 00002000:00010000:3.0:1762167007.040153:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fccd180 00000100:00100000:1.0:1762167007.042953:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.043001:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451832576 00000100:00100000:3.0:1762167007.043013:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451832576 00002000:00100000:3.0:1762167007.043053:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (217088->241663) req@ffff9ee37fc29f80 x1847765451832576/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.043061:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc29f80 with x1847765451832576 ext(217088->241663) 00002000:00010000:3.0:1762167007.043066:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc29f80 00000100:00100000:3.0:1762167007.043094:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2862 00000100:00100000:3.0:1762167007.043103:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451832576:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167007.044319:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451832576:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1213us (1368us total) trans 0 rc 24576/24576 00000100:00100000:3.0:1762167007.044329:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2862 00002000:00100000:3.0:1762167007.044335:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (217088->241663) req@ffff9ee37fc29f80 x1847765451832576/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/440 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.044350:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc29f80 with x1847765451832576 ext(217088->241663) 00002000:00010000:3.0:1762167007.044357:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc29f80 00000100:00100000:2.0:1762167007.046433:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.046507:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451832832 00000100:00100000:0.0:1762167007.046517:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451832832 00000100:00100000:0.0:1762167007.046569:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19760 00000100:00100000:0.0:1762167007.046580:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451832832:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167007.046627:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167007.046656:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a6f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a1 expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.046679:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a6de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3793 expref: 890 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.046689:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee363960b00) 00010000:00010000:0.0:1762167007.046700:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.047004:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.047019:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.047029:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:0.0:1762167007.047090:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952859 00000004:00010000:0.0:1762167007.047117:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000abe7a0b1 reply state 00000000a40e4668 transno 8589952860 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167007.047140:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167007.047221:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451832832:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 642us (794us total) trans 8589952860 rc 0/0 00000100:00100000:0.0:1762167007.047228:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19760 00000020:00080000:0.0:1762167007.047233:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167007.048082:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.048094:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.048102:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.048112:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.048116:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.048124:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.048135:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167007.048138:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167007.048142:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.048147:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a6fa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167007.048481:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.048567:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451832960 00000100:00100000:0.0:1762167007.048574:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451832960 00000100:00100000:0.0:1762167007.048615:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19761 00000100:00100000:0.0:1762167007.048622:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451832960:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.048639:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.048654:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a701 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37a8 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.048706:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a701 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a8 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.048718:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a701 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a8 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.048739:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167007.048743:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167007.048745:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:0.0:1762167007.048821:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451832960:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 198us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.048831:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19761 00000100:00100000:1.0:1762167007.050329:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.050372:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451833088 00000100:00100000:3.0:1762167007.050380:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451833088 00000100:00100000:1.0:1762167007.050402:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:3.0:1762167007.050417:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (249707->18446744073709551615) 00002000:00100000:3.0:1762167007.050422:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc28a80 with x1847765451833088 ext(249707->18446744073709551615) 00000100:00100000:1.0:1762167007.050427:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:3.0:1762167007.050431:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc28a80. 00000100:00100000:2.0:1762167007.050457:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451833216 00000100:00100000:2.0:1762167007.050462:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451833216 00000100:00100000:0.0:1762167007.050473:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451833344 00002000:00010000:2.0:1762167007.050478:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:0.0:1762167007.050480:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451833344 00002000:00100000:2.0:1762167007.050485:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc28700 with x1847765451833216 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167007.050492:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fc28700. 00002000:00010000:0.0:1762167007.050501:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.050506:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc28380 with x1847765451833344 ext(0->18446744073709551615) 00000100:00100000:3.0:1762167007.050509:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2863 00002000:00010000:0.0:1762167007.050512:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc28380. 00000100:00100000:3.0:1762167007.050517:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451833088:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167007.050535:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2864 00000100:00100000:2.0:1762167007.050548:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451833216:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167007.050549:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2865 00000100:00100000:0.0:1762167007.050563:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451833344:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167007.050754:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 240971 -> 249707 00002000:00010000:0.0:1762167007.050754:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.050757:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.050759:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.050759:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.050781:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.050783:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.050784:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.050788:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.050789:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.050789:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167007.050794:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.050795:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 47 00002000:00010000:2.0:1762167007.050801:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.050805:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167007.050836:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451833088:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 318us (509us total) trans 21474843286 rc 0/0 00000100:00100000:0.0:1762167007.050836:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451833344:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 274us (408us total) trans 21474843285 rc 0/0 00000100:00100000:2.0:1762167007.050841:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451833216:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 295us (435us total) trans 17179875747 rc 0/0 00000100:00100000:0.0:1762167007.050850:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2865 00000100:00100000:3.0:1762167007.050854:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2863 00002000:00010000:0.0:1762167007.050854:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:3.0:1762167007.050857:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (249707->18446744073709551615) 00002000:00100000:0.0:1762167007.050857:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc28380 with x1847765451833344 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167007.050861:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2864 00002000:00100000:3.0:1762167007.050862:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc28a80 with x1847765451833088 ext(249707->18446744073709551615) 00002000:00010000:0.0:1762167007.050863:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc28380. 00002000:00010000:2.0:1762167007.050865:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:3.0:1762167007.050868:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc28a80. 00002000:00100000:2.0:1762167007.050869:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc28700 with x1847765451833216 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167007.050878:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fc28700. 00000100:00100000:1.0:1762167007.052059:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.052102:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451833472 00000100:00100000:0.0:1762167007.052109:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451833472 00000100:00100000:0.0:1762167007.052152:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19762 00000100:00100000:0.0:1762167007.052161:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451833472:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.052177:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.052194:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a708 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37af expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.052267:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a70f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.052282:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a70f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.052293:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a70f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167007.052320:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 249707 00000004:00200000:0.0:1762167007.052324:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.052340:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a70f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.052370:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a708 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37af expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.052400:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a70f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37af expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.052408:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167007.052410:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.052413:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8600, rc 0) 00000100:00100000:0.0:1762167007.052458:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451833472:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 297us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.052464:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19762 00000100:00100000:1.0:1762167007.057927:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.058014:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451833728 00000100:00100000:0.0:1762167007.058027:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451833728 00000100:00100000:0.0:1762167007.058098:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19763 00000100:00100000:0.0:1762167007.058108:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451833728:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167007.058162:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.058189:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a70f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37af expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.058214:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167007.058219:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.058429:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.058440:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.058448:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:0.0:1762167007.058488:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952861 00000004:00010000:0.0:1762167007.058510:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000091af20c7 reply state 00000000340e3e3a transno 8589952862 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167007.058517:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167007.058586:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451833728:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 478us (668us total) trans 8589952862 rc 0/0 00000100:00100000:0.0:1762167007.058592:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19763 00000020:00080000:0.0:1762167007.058597:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167007.059415:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.059424:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.059429:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.059437:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167007.059440:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.059445:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.059454:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167007.059456:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167007.059458:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.059462:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a716 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167007.060269:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.060304:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.060341:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.060357:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451833856 00000100:00100000:2.0:1762167007.060366:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451833856 00002000:00010000:2.0:1762167007.060408:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (97325->18446744073709551615) 00002000:00100000:2.0:1762167007.060413:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a9c00 with x1847765451833856 ext(97325->18446744073709551615) 00002000:00010000:2.0:1762167007.060421:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a9c00. 00000100:00100000:0.0:1762167007.060458:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451833984 00000100:00100000:2.0:1762167007.060460:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451834112 00000100:00100000:0.0:1762167007.060465:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451833984 00000100:00100000:2.0:1762167007.060466:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451834112 00000100:00100000:3.0:1762167007.060471:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2866 00002000:00010000:2.0:1762167007.060481:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:3.0:1762167007.060486:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451833856:12345-192.168.203.35@tcp:10:fsx.0 00002000:00100000:2.0:1762167007.060487:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a9180 with x1847765451834112 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.060491:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:2.0:1762167007.060496:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a9180. 00002000:00100000:0.0:1762167007.060497:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a8700 with x1847765451833984 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.060508:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2435a8700. 00000100:00100000:2.0:1762167007.060519:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2867 00000100:00100000:2.0:1762167007.060529:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451834112:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167007.060538:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2868 00000100:00100000:0.0:1762167007.060548:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451833984:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:2.0:1762167007.060728:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.060732:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.060735:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.060737:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.060739:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167007.060809:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451834112:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 281us (467us total) trans 21474843287 rc 0/0 00002000:00010000:0.0:1762167007.060813:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.060820:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 249707 -> 97325 00000100:00100000:2.0:1762167007.060820:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2867 00002000:00010000:0.0:1762167007.060820:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.060827:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:3.0:1762167007.060829:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.060829:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00100000:2.0:1762167007.060832:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a9180 with x1847765451834112 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167007.060837:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.060837:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.060840:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a9180. 00002000:00010000:3.0:1762167007.060842:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.060844:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167007.060848:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 47 00000100:00100000:0.0:1762167007.060880:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451833984:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 333us (573us total) trans 17179875748 rc 0/0 00000100:00100000:0.0:1762167007.060888:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2868 00002000:00010000:0.0:1762167007.060891:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.060894:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a8700 with x1847765451833984 ext(0->18446744073709551615) 00000100:00100000:3.0:1762167007.060900:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451833856:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 417us (631us total) trans 21474843288 rc 0/0 00002000:00010000:0.0:1762167007.060903:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2435a8700. 00000100:00100000:3.0:1762167007.060914:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2866 00002000:00010000:3.0:1762167007.060918:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (97325->18446744073709551615) 00002000:00100000:3.0:1762167007.060922:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a9c00 with x1847765451833856 ext(97325->18446744073709551615) 00002000:00010000:3.0:1762167007.060928:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a9c00. 00000100:00100000:1.0:1762167007.062226:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.062276:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451834240 00000100:00100000:0.0:1762167007.062283:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451834240 00000100:00100000:0.0:1762167007.062326:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19764 00000100:00100000:0.0:1762167007.062335:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451834240:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.062351:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.062368:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a71d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37b6 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.062453:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a724 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.062466:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a724 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.062475:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a724 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167007.062498:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 97325 00000004:00200000:0.0:1762167007.062502:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.062517:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a724 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.062554:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a71d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37b6 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.062571:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a724 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37b6 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.062580:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167007.062582:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.062585:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9e00, rc 0) 00000100:00100000:0.0:1762167007.062633:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451834240:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 299us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.062639:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19764 00000100:00100000:1.0:1762167007.067463:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.067594:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451834368 00000100:00100000:3.0:1762167007.067607:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451834368 00002000:00100000:3.0:1762167007.067666:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->69631) req@ffff9ee2435abb80 x1847765451834368/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.067677:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435abb80 with x1847765451834368 ext(4096->69631) 00002000:00010000:3.0:1762167007.067683:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435abb80 00000100:00100000:3.0:1762167007.067718:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2869 00000100:00100000:3.0:1762167007.067728:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451834368:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167007.069900:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451834368:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 2163us (2440us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1762167007.069915:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2869 00002000:00100000:3.0:1762167007.069927:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->69631) req@ffff9ee2435abb80 x1847765451834368/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/440 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.069939:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435abb80 with x1847765451834368 ext(4096->69631) 00002000:00010000:3.0:1762167007.069944:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435abb80 00000100:00100000:1.0:1762167007.072056:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.072131:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451834496 00000100:00100000:3.0:1762167007.072143:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451834496 00002000:00100000:3.0:1762167007.072202:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->98303) req@ffff9ee2435a8a80 x1847765451834496/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.072214:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a8a80 with x1847765451834496 ext(69632->98303) 00002000:00010000:3.0:1762167007.072220:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a8a80 00000100:00100000:3.0:1762167007.072255:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2870 00000100:00100000:3.0:1762167007.072266:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451834496:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167007.073723:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451834496:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1437us (1654us total) trans 0 rc 28672/28672 00000100:00100000:3.0:1762167007.073746:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2870 00002000:00100000:3.0:1762167007.073828:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->98303) req@ffff9ee2435a8a80 x1847765451834496/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/440 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.073837:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a8a80 with x1847765451834496 ext(69632->98303) 00002000:00010000:3.0:1762167007.073842:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a8a80 00000100:00100000:1.0:1762167007.077051:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.077147:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451834752 00000100:00100000:0.0:1762167007.077159:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451834752 00000100:00100000:0.0:1762167007.077215:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19765 00000100:00100000:0.0:1762167007.077227:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451834752:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167007.077288:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.077320:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a724 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37b6 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.077343:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167007.077348:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.077620:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.077634:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.077645:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:0.0:1762167007.077712:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952863 00000004:00010000:0.0:1762167007.077742:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000037987fc1 reply state 00000000293901ff transno 8589952864 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167007.077757:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167007.077916:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451834752:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 691us (873us total) trans 8589952864 rc 0/0 00000100:00100000:0.0:1762167007.077925:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19765 00000020:00080000:0.0:1762167007.077931:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167007.079147:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.079159:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.079163:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.079167:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.079170:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.079175:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.079185:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167007.079187:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167007.079190:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.079194:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a72b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167007.079929:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.079960:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.079992:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451835008 00000100:00100000:1.0:1762167007.079993:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.080005:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451835008 00002000:00010000:3.0:1762167007.080091:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167007.080097:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435ab480 with x1847765451835008 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167007.080107:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2435ab480. 00000100:00100000:0.0:1762167007.080109:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451834880 00000100:00100000:2.0:1762167007.080110:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451835136 00000100:00100000:0.0:1762167007.080114:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451834880 00000100:00100000:2.0:1762167007.080116:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451835136 00002000:00010000:0.0:1762167007.080137:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (92573->18446744073709551615) 00002000:00100000:0.0:1762167007.080142:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a9880 with x1847765451834880 ext(92573->18446744073709551615) 00000100:00100000:3.0:1762167007.080144:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2871 00002000:00010000:2.0:1762167007.080144:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:0.0:1762167007.080149:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a9880. 00002000:00100000:2.0:1762167007.080152:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435aad80 with x1847765451835136 ext(0->18446744073709551615) 00000100:00100000:3.0:1762167007.080160:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451835008:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:2.0:1762167007.080162:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435aad80. 00000100:00100000:1.0:1762167007.080172:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2872 00000100:00100000:0.0:1762167007.080186:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2873 00000100:00100000:1.0:1762167007.080190:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451834880:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167007.080199:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451835136:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167007.080423:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.080423:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.080428:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.080428:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.080431:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.080431:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.080435:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.080435:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.080438:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167007.080438:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167007.080456:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 97325 -> 92573 00002000:00010000:1.0:1762167007.080461:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.080464:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.080466:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.080469:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 47 00000100:00100000:3.0:1762167007.080495:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451835008:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 338us (569us total) trans 17179875749 rc 0/0 00000100:00100000:0.0:1762167007.080495:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451835136:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 298us (500us total) trans 21474843289 rc 0/0 00000100:00100000:1.0:1762167007.080498:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451834880:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 315us (536us total) trans 21474843290 rc 0/0 00000100:00100000:3.0:1762167007.080508:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2871 00002000:00010000:3.0:1762167007.080513:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:0.0:1762167007.080513:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2873 00002000:00100000:3.0:1762167007.080515:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435ab480 with x1847765451835008 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.080515:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.080519:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435aad80 with x1847765451835136 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167007.080521:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2872 00002000:00010000:3.0:1762167007.080524:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2435ab480. 00002000:00010000:0.0:1762167007.080525:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435aad80. 00002000:00010000:1.0:1762167007.080526:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (92573->18446744073709551615) 00002000:00100000:1.0:1762167007.080531:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2435a9880 with x1847765451834880 ext(92573->18446744073709551615) 00002000:00010000:1.0:1762167007.080537:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2435a9880. 00000100:00100000:1.0:1762167007.081983:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.082032:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451835264 00000100:00100000:0.0:1762167007.082040:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451835264 00000100:00100000:0.0:1762167007.082098:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19766 00000100:00100000:0.0:1762167007.082108:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451835264:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.082128:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.082146:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a732 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37bd expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.082233:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a739 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.082248:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a739 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.082258:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a739 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167007.082287:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92573 00000004:00200000:0.0:1762167007.082291:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.082309:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a739 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.082338:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a732 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37bd expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.082358:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a739 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37bd expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.082366:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167007.082369:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.082372:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8600, rc 0) 00000100:00100000:0.0:1762167007.082435:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451835264:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 329us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.082447:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19766 00000100:00100000:2.0:1762167007.086402:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.086592:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451835520 00000100:00100000:0.0:1762167007.086603:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451835520 00000100:00100000:0.0:1762167007.086665:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7330 00000100:00100000:0.0:1762167007.086677:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451835520:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167007.087091:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451835520:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 415us (706us total) trans 8589952865 rc 0/0 00000100:00100000:0.0:1762167007.087100:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7330 00000100:00100000:1.0:1762167007.097734:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.097858:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451835776 00000100:00100000:0.0:1762167007.097867:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451835776 00000100:00100000:0.0:1762167007.097944:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19767 00000100:00100000:0.0:1762167007.097954:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56203:x1847765451835776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.097976:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.097993:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a740 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37c4 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.098059:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a747 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098073:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a747 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098085:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a747 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098100:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a74e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098106:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a74e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098113:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a74e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098244:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a755 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098252:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a755 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098259:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a755 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167007.098268:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92573 00010000:00010000:0.0:1762167007.098352:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a747 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098359:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a747 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098366:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a747 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098372:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167007.098376:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a747 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098398:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a747 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098410:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167007.098413:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167007.098418:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a747 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098428:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0a747 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098442:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a74e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098447:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a74e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098453:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a74e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098458:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167007.098461:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a74e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098466:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a74e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098472:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167007.098474:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167007.098477:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a74e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098482:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a74e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.098519:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a740 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37c4 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.098531:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a755 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37c4 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.098556:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167007.098558:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.098561:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8a00, rc 0) 00000100:00100000:0.0:1762167007.098619:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56203:x1847765451835776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 666us (894us total) trans 8589952866 rc 0/0 00000100:00100000:0.0:1762167007.098626:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19767 00000100:00100000:1.0:1762167007.101133:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.101184:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451835904 00000100:00100000:0.0:1762167007.101194:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451835904 00000100:00100000:1.0:1762167007.101216:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.101264:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 644 00000100:00100000:3.0:1762167007.101272:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451836160 00000100:00100000:0.0:1762167007.101277:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2360:x1847765451835904:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762167007.101280:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451836160 00010000:00010000:0.0:1762167007.101297:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.101321:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a755 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37c4 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.101334:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19768 00010000:00010000:0.0:1762167007.101341:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167007.101347:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167007.101424:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2360:x1847765451835904:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 150us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.101432:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 644 00000100:00100000:3.0:1762167007.101470:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56203:x1847765451836160:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.101487:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.101501:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a763 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37cb expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.102178:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.102192:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.102201:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167007.102216:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64c:0x0]: returning size 0 00010000:00010000:3.0:1762167007.102260:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a763 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37cb expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.102276:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37cb expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.102284:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167007.102286:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167007.102289:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:3.0:1762167007.102329:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56203:x1847765451836160:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 986us (1111us total) trans 8589952867 rc 0/0 00000100:00100000:3.0:1762167007.102335:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19768 00000100:00100000:1.0:1762167007.104062:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.104204:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451836416 00000100:00100000:3.0:1762167007.104215:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451836416 00000100:00100000:3.0:1762167007.104272:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19769 00000100:00100000:3.0:1762167007.104285:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56203:x1847765451836416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.104311:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.104331:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a778 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37d2 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.104443:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.104458:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37cb expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.104466:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.104503:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37cb expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.104518:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37cb expref: 902 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:3.0:1762167007.104532:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454443136:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167007.104610:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.105990:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454443136:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167007.106016:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167007.106287:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.106348:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451836544 00000100:00100000:0.0:1762167007.106355:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451836544 00010000:00010000:0.0:1762167007.106397:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37cb expref: 903 pid: 32138 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167007.106431:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7465 00000100:00100000:0.0:1762167007.106440:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2360:x1847765451836544:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.106456:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.106462:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37cb expref: 903 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167007.106474:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37cb expref: 903 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167007.106494:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0a76a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37cb expref: 903 pid: 32138 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167007.106511:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:0.0:1762167007.106515:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.106523:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.106530:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167007.106553:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167007.106584:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.106594:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167007.106609:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2360:x1847765451836544:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 169us (320us total) trans 0 rc 0/0 00000004:00200000:3.0:1762167007.106611:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64c:0x0]: returning size 0 00000100:00100000:0.0:1762167007.106619:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7465 00000004:00080000:3.0:1762167007.106991:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x820:0x0], index 1: 0 00000004:00080000:3.0:1762167007.107003:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81d:0x0], index 0: 0 00010000:00010000:3.0:1762167007.107163:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.107174:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.107181:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.107191:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167007.107195:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.107202:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.107212:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167007.107214:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167007.107218:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.107223:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a77f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.107284:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a778 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37d2 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.107294:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167007.107297:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762167007.107301:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a778 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37d2 expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.107309:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:3.0:1762167007.107346:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56203:x1847765451836416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3064us (3290us total) trans 8589952868 rc 301/301 00000100:00100000:3.0:1762167007.107354:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19769 00000100:00100000:1.0:1762167007.108669:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.108724:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451836800 00000100:00100000:0.0:1762167007.108733:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451836800 00000100:00100000:0.0:1762167007.108811:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7331 00000100:00100000:0.0:1762167007.108822:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56203:x1847765451836800:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167007.109132:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56203:x1847765451836800:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 312us (466us total) trans 8589952869 rc 0/0 00000100:00100000:0.0:1762167007.109141:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7331 00000100:00100000:2.0:1762167007.110692:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.110746:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451836928 00000100:00100000:3.0:1762167007.110754:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451836928 00000100:00100000:3.0:1762167007.110862:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19770 00000100:00100000:3.0:1762167007.110874:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56203:x1847765451836928:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.110894:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.110915:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a78d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37d9 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.110977:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a794 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.110992:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a794 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.111003:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a794 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167007.111031:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64c:0x0]: returning size 0 00000004:00200000:3.0:1762167007.111035:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167007.111050:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a794 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.111072:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a78d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37d9 expref: 904 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.111090:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a794 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37d9 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.111099:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167007.111103:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762167007.111106:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167007.111173:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56203:x1847765451836928:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 302us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.111183:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19770 00000100:00100000:2.0:1762167007.112533:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.112573:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.112658:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451837056 00000100:00100000:1.0:1762167007.112666:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451837056 00000100:00100000:1.0:1762167007.112726:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451837184 00000100:00100000:1.0:1762167007.112730:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451837184 00000100:00100000:1.0:1762167007.112784:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16777 00000100:00100000:1.0:1762167007.112796:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2358:x1847765451837056:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:3.0:1762167007.112809:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16778 00010000:00010000:1.0:1762167007.112810:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167007.112824:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451837184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167007.112828:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a79b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37e0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.112839:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1762167007.112855:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1762167007.112858:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a7a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37e7 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.112872:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.112876:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1762167007.112880:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167007.112886:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a79b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e0 expref: 34 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.112894:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.112897:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.112904:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e7 expref: 30 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.112906:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a79b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e0 expref: 34 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.112930:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ba00, rc 0) 00010000:00010000:3.0:1762167007.112933:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e7 expref: 30 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.112945:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:3.0:1762167007.112984:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2358:x1847765451837184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 166us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.112992:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16778 00000100:00100000:1.0:1762167007.113108:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451837056:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 314us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.113115:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16777 00000100:00100000:1.0:1762167007.114568:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.114614:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451837440 00000100:00100000:3.0:1762167007.114622:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451837440 00000100:00100000:3.0:1762167007.114666:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19771 00000100:00100000:3.0:1762167007.114677:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56203:x1847765451837440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.114693:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.114710:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a7a9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37ee expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.114838:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0a7b0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.114850:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0a7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.114858:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0a7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:3.0:1762167007.114869:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92573 00010000:00010000:3.0:1762167007.115004:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a7a9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37ee expref: 906 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.115022:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0a7b0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37ee expref: 905 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.115030:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:3.0:1762167007.115033:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167007.115036:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000100:00100000:3.0:1762167007.115082:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56203:x1847765451837440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 407us (516us total) trans 8589952870 rc 0/0 00000100:00100000:3.0:1762167007.115088:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19771 00000100:00100000:2.0:1762167007.117157:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.117203:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.117231:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451837568 00000100:00100000:3.0:1762167007.117240:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451837568 00000100:00100000:1.0:1762167007.117258:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451837824 00000100:00100000:1.0:1762167007.117265:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451837824 00000100:00100000:2.0:1762167007.117274:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.117300:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451837696 00000100:00100000:3.0:1762167007.117304:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451837696 00000100:00100000:1.0:1762167007.117325:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16779 00000100:00100000:0.0:1762167007.117335:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16780 00000100:00100000:1.0:1762167007.117340:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451837568:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:0.0:1762167007.117351:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451837824:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167007.117356:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16781 00000100:00100000:2.0:1762167007.117372:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451837696:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167007.117397:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.117400:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.117415:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.117433:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a6e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb379a expref: 31 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.117433:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.117434:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 34 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.117457:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167007.117460:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167007.117461:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.117462:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167007.117466:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167007.117466:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.117468:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.117473:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.117474:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.117511:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a6e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb379a expref: 31 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.117513:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.117518:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 34 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.117533:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a6e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb379a expref: 31 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167007.117540:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 31 pid: 33892 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167007.117551:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 34 pid: 33892 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167007.117569:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454443392:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167007.117574:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454443264:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.117575:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24785aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454443520:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.117662:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.117662:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.117663:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.118734:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454443264:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167007.118756:0:33892:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.118798:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454443392:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.118820:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.118876:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24785aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454443520:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.118889:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.119034:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.119095:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451837952 00000100:00100000:0.0:1762167007.119101:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451837952 00010000:00010000:0.0:1762167007.119126:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 32 pid: 33892 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1762167007.119165:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7466 00000100:00100000:0.0:1762167007.119173:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451837952:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.119187:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.119209:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 32 pid: 33892 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167007.119220:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 32 pid: 33892 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167007.119248:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0a613 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb373f expref: 32 pid: 33892 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167007.119263:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.119265:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.119270:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119285:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119315:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167007.119335:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.119359:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451837952:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 184us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.119369:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7466 00010000:00010000:2.0:1762167007.119372:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.119374:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451838080 00000100:00100000:3.0:1762167007.119394:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451838080 00010000:00010000:2.0:1762167007.119409:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.119432:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167007.119450:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.119453:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451838208 00000100:00100000:0.0:1762167007.119462:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451838208 00010000:00010000:2.0:1762167007.119481:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119486:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a6e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb379a expref: 31 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167007.119496:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.119499:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 35 pid: 33892 timeout: 727 lvb_type: 0 00000100:00100000:3.0:1762167007.119557:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7467 00000100:00100000:3.0:1762167007.119565:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451838208:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167007.119574:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762167007.119575:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7468 00000100:00100000:0.0:1762167007.119587:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765451838080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167007.119590:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a6e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb379a expref: 31 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167007.119599:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.119606:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a6e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb379a expref: 31 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167007.119616:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 35 pid: 33892 timeout: 727 lvb_type: 0 00010000:00010000:3.0:1762167007.119622:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a6e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb379a expref: 31 pid: 33894 timeout: 727 lvb_type: 0 00010000:00010000:2.0:1762167007.119636:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167007.119640:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.119642:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 35 pid: 33892 timeout: 727 lvb_type: 0 00010000:00010000:3.0:1762167007.119644:0:5740:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.119648:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.119657:0:5740:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119663:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0a60c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3738 expref: 35 pid: 33892 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1762167007.119673:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.119675:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.119678:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.119679:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.119688:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.119703:0:33892:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119709:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167007.119713:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.119716:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451838208:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 145us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.119733:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7467 00000100:00100000:0.0:1762167007.119742:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765451838080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 147us (397us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167007.119751:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.119755:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.119755:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7468 00010000:00010000:1.0:1762167007.119802:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.119812:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119817:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.119831:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.119832:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.119832:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.119841:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.119858:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119865:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119872:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.119879:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.119881:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119881:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119921:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.119924:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0a7c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.119925:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.119925:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.120006:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.120023:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.120024:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451837568:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2687us (2873us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167007.120031:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a7cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.120032:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16779 00000100:00100000:2.0:1762167007.120095:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451837824:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2744us (2885us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.120101:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451837696:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2730us (2824us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.120113:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16780 00000100:00100000:0.0:1762167007.120123:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16781 00000100:00100000:1.0:1762167007.121475:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.121503:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.121527:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.121539:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451838336 00000100:00100000:0.0:1762167007.121547:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451838336 00000100:00100000:2.0:1762167007.121557:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451838592 00000100:00100000:2.0:1762167007.121563:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451838592 00000100:00100000:3.0:1762167007.121566:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451838464 00000100:00100000:3.0:1762167007.121573:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451838464 00000100:00100000:0.0:1762167007.121594:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16782 00000100:00100000:2.0:1762167007.121605:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16783 00000100:00100000:0.0:1762167007.121608:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451838336:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:1.0:1762167007.121616:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16784 00000100:00100000:2.0:1762167007.121621:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451838592:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.121626:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.121631:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167007.121632:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451838464:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167007.121641:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.121646:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a7d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37f5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.121648:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a7da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3803 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.121653:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a7e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb37fc expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167007.121681:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x3 00002000:00010000:2.0:1762167007.121682:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x3 00002000:00010000:0.0:1762167007.121682:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 92573, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x2f 00010000:00010000:1.0:1762167007.121696:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.121699:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.121700:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.121700:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.121704:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.121705:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.121711:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37fc expref: 34 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.121712:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a7da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3803 expref: 31 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.121715:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a7d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37f5 expref: 31 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.121745:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a7da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3803 expref: 31 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.121746:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37fc expref: 34 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.121750:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a7d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37f5 expref: 31 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.121793:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00010000:00010000:1.0:1762167007.121794:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b000, rc 0) 00010000:00010000:0.0:1762167007.121811:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8e00, rc 0) 00000100:00100000:1.0:1762167007.121832:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451838464:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 206us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.121834:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451838592:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 218us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.121845:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16784 00000100:00100000:0.0:1762167007.121845:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451838336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 238us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.121863:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16783 00000100:00100000:0.0:1762167007.121872:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16782 00000100:00100000:3.0:1762167007.148067:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.148152:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451838720 00000100:00100000:1.0:1762167007.148164:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451838720 00000100:00100000:1.0:1762167007.148232:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2874 00000100:00100000:1.0:1762167007.148243:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451838720:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167007.148274:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.148288:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.148290:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.148294:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.148305:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.150217:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.150234:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.150244:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.150251:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.150255:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.150263:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.150280:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.150288:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.150352:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451838720:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2109us (2290us total) trans 0 rc 92573/92573 00000100:00100000:1.0:1762167007.150363:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2874 00000100:00100000:2.0:1762167007.152472:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.152551:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451838848 00000100:00100000:1.0:1762167007.152560:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451838848 00000100:00100000:1.0:1762167007.152624:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2875 00000100:00100000:1.0:1762167007.152633:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765451838848:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762167007.152664:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.152680:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a79b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e0 expref: 34 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.152687:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.152689:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.152692:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.152724:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a79b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e0 expref: 34 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.152736:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a79b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e0 expref: 34 pid: 33892 timeout: 727 lvb_type: 1 00000100:00100000:1.0:1762167007.152751:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454443648:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167007.152852:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.154232:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454443648:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167007.154257:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.154462:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.154589:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451838976 00000100:00100000:0.0:1762167007.154596:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451838976 00010000:00010000:0.0:1762167007.154627:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a79b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e0 expref: 35 pid: 33892 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1762167007.154661:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7469 00000100:00100000:0.0:1762167007.154670:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451838976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.154684:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.154706:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a79b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e0 expref: 35 pid: 33892 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167007.154719:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a79b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e0 expref: 35 pid: 33892 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167007.154742:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a79b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e0 expref: 35 pid: 33892 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1762167007.154758:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.154807:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.154812:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.154822:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.154847:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167007.154898:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451838976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 228us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.154906:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7469 00010000:00010000:1.0:1762167007.154930:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.154943:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167007.171082:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875748 is committed 00000001:00080000:1.0:1762167007.171105:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875745 is committed 00000001:00080000:1.0:1762167007.171132:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875750 is committed 00002000:00010000:2.0:1762167007.171163:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 0 -> 92573 00002000:00010000:2.0:1762167007.171168:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 0 -> 1762167007 00002000:00010000:2.0:1762167007.171171:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 0 -> 1762167007 00002000:00010000:2.0:1762167007.171173:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 1 -> 259 00010000:00010000:2.0:1762167007.171186:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.171197:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.171207:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.171214:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.171224:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.171232:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.171253:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.171259:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a7ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.171364:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765451838848:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 18726us (18893us total) trans 17179875750 rc 0/0 00000100:00100000:2.0:1762167007.171380:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2875 00000100:00100000:2.0:1762167007.173347:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.173447:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451839104 00000100:00100000:3.0:1762167007.173460:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451839104 00000100:00100000:3.0:1762167007.173534:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19772 00000100:00100000:3.0:1762167007.173546:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56203:x1847765451839104:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:2.0:1762167007.186328:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952869 is committed 00000020:00080000:2.0:1762167007.186377:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969183 batchid updated 00000001:00080000:2.0:1762167007.186408:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952870 is committed 00000020:00080000:1.0:1762167007.186429:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969183 00000100:00100000:3.0:1762167007.186439:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56203:x1847765451839104:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 12893us (13097us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.186450:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19772 00000020:00080000:1.0:1762167007.186605:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969183 cancel update log [0x200000bd0:0x1:0x0].51: rc = 0 00000020:00080000:1.0:1762167007.186613:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969183 00000100:00100000:3.0:1762167007.187743:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.187804:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451839232 00000100:00100000:0.0:1762167007.187814:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451839232 00000100:00100000:3.0:1762167007.187818:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.187858:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451839360 00000100:00100000:0.0:1762167007.187862:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451839360 00000100:00100000:0.0:1762167007.187897:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16785 00000100:00100000:0.0:1762167007.187906:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451839232:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762167007.187908:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16786 00000100:00100000:1.0:1762167007.187918:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451839360:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762167007.187992:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451839360:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 76us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.187992:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451839232:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.188000:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16785 00000100:00100000:1.0:1762167007.188004:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16786 00000100:00100000:0.0:1762167007.194639:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.194688:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.194718:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451839488 00000100:00100000:1.0:1762167007.194731:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451839488 00000100:00100000:2.0:1762167007.194753:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451839616 00000100:00100000:2.0:1762167007.194790:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451839616 00000100:00100000:0.0:1762167007.194821:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.194842:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451839744 00000100:00100000:2.0:1762167007.194847:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451839744 00000100:00100000:1.0:1762167007.194853:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16787 00000100:00100000:1.0:1762167007.194868:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765451839616:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167007.194878:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16788 00000100:00100000:2.0:1762167007.194890:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765451839488:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:0.0:1762167007.194903:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16789 00010000:00010000:1.0:1762167007.194916:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7f6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.194917:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a7fd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.194917:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451839744:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167007.194945:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.194945:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.194950:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.194950:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.194950:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a804 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.194961:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a7fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.194961:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.194975:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.194979:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.194984:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a804 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.194990:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a7fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.195009:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a804 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.195017:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.195035:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a804 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.195036:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a7fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.195042:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.195052:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a804 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.195062:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a7fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.195069:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.195076:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a804 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.195098:0:33894:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.195098:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.195100:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.195104:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a804 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.195125:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.195125:0:33894:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.195126:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a804 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.195133:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.195134:0:33894:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.195140:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a804 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.195150:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a7fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.195152:0:33894:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.195179:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a804 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.195181:0:33894:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.195182:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a7fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.195202:0:33894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a7f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.195205:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a7fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.195275:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765451839616:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 409us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.195276:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451839744:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 361us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.195277:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765451839488:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 387us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.195295:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16787 00000100:00100000:0.0:1762167007.195303:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16789 00000100:00100000:2.0:1762167007.195310:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16788 00000100:00100000:2.0:1762167007.196393:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.196441:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451840000 00000100:00100000:3.0:1762167007.196447:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451840000 00000100:00100000:3.0:1762167007.196481:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19773 00000100:00100000:3.0:1762167007.196489:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56203:x1847765451840000:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167007.196537:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.196568:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a794 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37d9 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.196585:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167007.196599:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167007.196647:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.196656:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167007.196662:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:3.0:1762167007.196876:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000644a8085 reply state 00000000a67fec0c transno 8589952871 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167007.196885:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167007.196959:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56203:x1847765451840000:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 470us (580us total) trans 8589952871 rc 0/0 00000100:00100000:3.0:1762167007.196966:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19773 00010000:00010000:1.0:1762167007.197842:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167007.197853:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167007.197860:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167007.197866:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167007.197873:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167007.197873:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167007.197884:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167007.197898:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167007.197902:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762167007.197904:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451840128 00010000:00010000:1.0:1762167007.197907:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167007.197911:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451840128 00010000:00010000:1.0:1762167007.197915:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0a80b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167007.197954:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19774 00000100:00100000:2.0:1762167007.197961:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56203:x1847765451840128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.197975:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.197988:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a812 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb380a expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.198024:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a812 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb380a expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.198037:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a812 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb380a expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.198054:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167007.198058:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167007.198061:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d400, rc 0) 00000100:00100000:2.0:1762167007.198100:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56203:x1847765451840128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 139us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.198104:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19774 00000100:00100000:0.0:1762167007.199260:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.199310:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451840256 00000100:00100000:2.0:1762167007.199316:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451840256 00000100:00100000:2.0:1762167007.199352:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16790 00000100:00100000:2.0:1762167007.199361:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56203:x1847765451840256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.199373:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.199399:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a819 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3811 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167007.199421:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 92573, mtime: 0x690888df, atime: 0x0, ctime: 0x690888df, blocks: 0x103 00010000:00010000:2.0:1762167007.199435:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.199438:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.199444:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3811 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.199462:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3811 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.199473:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:2.0:1762167007.199513:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56203:x1847765451840256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.199520:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16790 00000100:00100000:1.0:1762167007.200728:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.200811:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451840384 00000100:00100000:2.0:1762167007.200818:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451840384 00000100:00100000:2.0:1762167007.200858:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16791 00000100:00100000:2.0:1762167007.200868:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:56203:x1847765451840384:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.200880:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.200893:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3818 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.200914:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a7a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e7 expref: 31 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.200922:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.200924:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.200927:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 31 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.200960:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e7 expref: 31 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.200979:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e7 expref: 31 pid: 12402 timeout: 727 lvb_type: 1 00000100:00100000:2.0:1762167007.200993:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24785ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454443776:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.201066:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.202113:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24785ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454443776:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167007.202153:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 31 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.202167:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:2.0:1762167007.202220:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56203:x1847765451840384:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1354us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.202228:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16791 00000100:00100000:1.0:1762167007.202356:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.202423:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451840512 00000100:00100000:3.0:1762167007.202430:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451840512 00010000:00010000:3.0:1762167007.202458:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e7 expref: 31 pid: 12402 timeout: 727 lvb_type: 1 00000100:00100000:3.0:1762167007.202493:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7470 00000100:00100000:3.0:1762167007.202502:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451840512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167007.202513:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.202532:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e7 expref: 31 pid: 12402 timeout: 727 lvb_type: 1 00010000:00010000:3.0:1762167007.202544:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e7 expref: 31 pid: 12402 timeout: 727 lvb_type: 1 00010000:00010000:3.0:1762167007.202625:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a7a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37e7 expref: 31 pid: 12402 timeout: 727 lvb_type: 1 00010000:00010000:3.0:1762167007.202639:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.202641:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.202645:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 30 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.202651:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 30 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.202673:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 30 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.202681:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454443904:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167007.202720:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f840 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.203731:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454443904:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167007.203750:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167007.203890:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451840512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1388us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.203903:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7470 00000100:00100000:1.0:1762167007.203905:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.203972:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451840640 00000100:00100000:2.0:1762167007.203978:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451840640 00000100:00100000:1.0:1762167007.203979:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.204016:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451840768 00000100:00100000:2.0:1762167007.204020:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451840768 00000100:00100000:0.0:1762167007.204022:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16792 00000100:00100000:1.0:1762167007.204040:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16793 00000100:00100000:0.0:1762167007.204044:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451840640:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167007.204057:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451840768:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167007.204312:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.204316:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 0 -> 1762167007 00002000:00010000:1.0:1762167007.204319:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 0 -> 1762167006 00002000:00010000:1.0:1762167007.204322:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 0 -> 1762167007 00002000:00010000:0.0:1762167007.204323:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 92573 -> 92573 00002000:00010000:1.0:1762167007.204325:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1762167007.204328:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.204333:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 0 -> 1762167006 00002000:00010000:0.0:1762167007.204336:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.204338:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:1.0:1762167007.204374:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451840768:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 318us (390us total) trans 21474843291 rc 0/0 00000100:00100000:0.0:1762167007.204374:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451840640:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 336us (468us total) trans 17179875751 rc 0/0 00000100:00100000:1.0:1762167007.204397:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16793 00000100:00100000:0.0:1762167007.204408:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16792 00000100:00100000:0.0:1762167007.205481:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.205555:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451841024 00000100:00100000:2.0:1762167007.205562:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451841024 00000100:00100000:2.0:1762167007.205602:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19775 00000100:00100000:2.0:1762167007.205611:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56203:x1847765451841024:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:2.0:1762167007.205671:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a827 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.205687:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a827 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.205698:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a827 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.205719:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a827 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.205725:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a827 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.205731:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a827 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.205737:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.205741:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a827 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.205748:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a827 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.205758:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167007.205787:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1762167007.205791:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a827 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.205797:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a827 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167007.205854:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56203:x1847765451841024:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 244us (375us total) trans 0 rc -22/-22 00000100:00100000:2.0:1762167007.205861:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19775 00000100:00100000:3.0:1762167007.207657:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.207733:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451841280 00000100:00100000:2.0:1762167007.207741:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451841280 00000100:00100000:2.0:1762167007.207827:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19776 00000100:00100000:2.0:1762167007.207838:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56203:x1847765451841280:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167007.207887:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.207912:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0a739 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37bd expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.207931:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167007.207936:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.207977:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.207989:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.207998:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:2.0:1762167007.208129:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a9a7a9af reply state 00000000aa38f778 transno 8589952872 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167007.208138:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167007.208231:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56203:x1847765451841280:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 393us (580us total) trans 8589952872 rc 0/0 00000100:00100000:2.0:1762167007.208250:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19776 00010000:00010000:2.0:1762167007.209327:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.209340:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.209346:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.209353:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.209358:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.209366:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.209396:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167007.209400:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167007.209404:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167007.209410:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a82e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167007.209526:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.209593:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451841408 00000100:00100000:0.0:1762167007.209603:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451841408 00000100:00100000:0.0:1762167007.209668:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16794 00000100:00100000:0.0:1762167007.209678:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56203:x1847765451841408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.209694:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.209708:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb381f expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.209735:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a7d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37f5 expref: 32 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.209743:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.209745:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.209750:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.209809:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a7d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37f5 expref: 32 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.209822:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a7d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37f5 expref: 32 pid: 6532 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167007.209835:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454444032:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.209918:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.210998:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454444032:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.211028:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.211042:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:0.0:1762167007.211087:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56203:x1847765451841408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1410us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.211094:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16794 00000100:00100000:3.0:1762167007.211436:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.211558:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451841536 00000100:00100000:0.0:1762167007.211573:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451841536 00010000:00010000:0.0:1762167007.211615:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a7d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37f5 expref: 32 pid: 6532 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167007.211670:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7471 00000100:00100000:0.0:1762167007.211681:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451841536:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.211699:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.211730:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a7d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37f5 expref: 32 pid: 6532 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167007.211747:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a7d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37f5 expref: 32 pid: 6532 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167007.211826:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a7d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37f5 expref: 32 pid: 6532 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167007.211845:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.211848:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.211856:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.211868:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.211905:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.211920:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454444160:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167007.212026:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.213326:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454444160:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167007.213328:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167007.213345:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167007.213402:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451841536:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1721us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.213414:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451841664 00000100:00100000:0.0:1762167007.213416:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7471 00000100:00100000:1.0:1762167007.213423:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451841664 00000100:00100000:1.0:1762167007.213481:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16795 00000100:00100000:1.0:1762167007.213494:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56203:x1847765451841664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167007.213513:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167007.213530:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3826 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.213562:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a7e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37fc expref: 26 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.213570:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.213572:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.213576:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 26 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.213607:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37fc expref: 26 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.213621:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a7e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37fc expref: 26 pid: 33894 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1762167007.213631:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454444288:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167007.213685:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.214597:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454444288:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167007.214619:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 26 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.214632:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7aa00, rc 0) 00000100:00100000:1.0:1762167007.214668:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56203:x1847765451841664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1179us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.214673:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16795 00000100:00100000:3.0:1762167007.214799:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.214831:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451841792 00000100:00100000:0.0:1762167007.214836:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451841792 00010000:00010000:0.0:1762167007.214855:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a7e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37fc expref: 26 pid: 33894 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167007.214877:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7472 00000100:00100000:0.0:1762167007.214883:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451841792:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.214891:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.214913:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a7e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37fc expref: 26 pid: 33894 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167007.214928:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37fc expref: 26 pid: 33894 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167007.214952:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0a7e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37fc expref: 26 pid: 33894 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167007.214969:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.214971:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.214978:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 25 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.214988:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 25 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.215015:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 25 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.215028:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765454444416:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167007.215073:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.216135:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765454444416:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167007.216148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167007.216154:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167007.216196:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451841792:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1312us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.216206:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7472 00000100:00100000:1.0:1762167007.216227:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451841920 00000100:00100000:1.0:1762167007.216234:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451841920 00000100:00100000:1.0:1762167007.216287:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16796 00000100:00100000:1.0:1762167007.216295:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56203:x1847765451841920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167007.216307:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167007.216322:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb382d expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.216343:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a7da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3803 expref: 32 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.216357:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.216359:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.216364:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.216402:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a7da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3803 expref: 32 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.216414:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a7da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3803 expref: 32 pid: 7858 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1762167007.216434:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454444544:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167007.216496:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.217440:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454444544:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167007.217461:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.217474:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00000100:00100000:1.0:1762167007.217531:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56203:x1847765451841920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1235us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.217539:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16796 00000100:00100000:2.0:1762167007.217578:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.217608:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451842048 00000100:00100000:3.0:1762167007.217617:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451842048 00010000:00010000:3.0:1762167007.217641:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a7da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3803 expref: 32 pid: 7858 timeout: 728 lvb_type: 1 00000100:00100000:3.0:1762167007.217670:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7473 00000100:00100000:3.0:1762167007.217806:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451842048:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167007.217817:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.217847:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a7da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3803 expref: 32 pid: 7858 timeout: 728 lvb_type: 1 00010000:00010000:3.0:1762167007.217868:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a7da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3803 expref: 32 pid: 7858 timeout: 728 lvb_type: 1 00010000:00010000:3.0:1762167007.217890:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a7da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3803 expref: 32 pid: 7858 timeout: 728 lvb_type: 1 00010000:00010000:3.0:1762167007.217903:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.217905:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.217909:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.217923:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.217954:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.217967:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454444672:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167007.218025:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.219267:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.219285:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454444672:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167007.219308:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167007.219339:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167007.219398:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451842176 00000100:00100000:3.0:1762167007.219400:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451842048:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1597us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.219406:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451842176 00000100:00100000:2.0:1762167007.219408:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451842432 00000100:00100000:3.0:1762167007.219415:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7473 00000100:00100000:2.0:1762167007.219416:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451842432 00000100:00100000:1.0:1762167007.219460:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16797 00000100:00100000:2.0:1762167007.219472:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16798 00000100:00100000:1.0:1762167007.219473:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451842176:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:2.0:1762167007.219486:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451842432:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:0.0:1762167007.219687:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:1.0:1762167007.219692:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 92573 -> 92573 00002000:00010000:1.0:1762167007.219696:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.219700:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.219700:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.219707:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.219708:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.219712:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:3.0:1762167007.219714:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451842304 00002000:00010000:1.0:1762167007.219714:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 47 00002000:00010000:2.0:1762167007.219718:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:3.0:1762167007.219720:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451842304 00002000:00010000:2.0:1762167007.219722:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.219759:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451842176:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 290us (496us total) trans 21474843292 rc 0/0 00000100:00100000:3.0:1762167007.219793:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16799 00000100:00100000:2.0:1762167007.219800:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451842432:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 280us (453us total) trans 21474843293 rc 0/0 00000100:00100000:1.0:1762167007.219805:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16797 00000100:00100000:3.0:1762167007.219811:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451842304:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:2.0:1762167007.219819:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16798 00002000:00010000:3.0:1762167007.219981:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.219984:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.219987:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.219990:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.219992:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167007.220035:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451842304:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 230us (349us total) trans 17179875752 rc 0/0 00000100:00100000:3.0:1762167007.220043:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16799 00000100:00100000:0.0:1762167007.221428:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.221492:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451842688 00000100:00100000:2.0:1762167007.221498:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451842688 00000100:00100000:2.0:1762167007.221539:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7332 00000100:00100000:2.0:1762167007.221547:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242a6f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56203:x1847765451842688:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167007.221614:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0a7b0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37ee expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.221645:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.221656:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a701 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a8 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.221661:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.221691:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a701 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a8 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.221704:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a701 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a8 expref: 894 pid: 32138 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.221718:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24785aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454444800:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.221817:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.223217:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.223224:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24785aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454444800:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.223248:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167007.223305:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451842816 00000100:00100000:3.0:1762167007.223312:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451842816 00010000:00010000:3.0:1762167007.223340:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a701 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a8 expref: 895 pid: 32138 timeout: 728 lvb_type: 0 00000100:00100000:3.0:1762167007.223378:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7474 00000100:00100000:3.0:1762167007.223395:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765451842816:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167007.223406:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.223412:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a701 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a8 expref: 895 pid: 32138 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.223422:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a701 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a8 expref: 895 pid: 32138 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.223439:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0a701 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37a8 expref: 895 pid: 32138 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.223452:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:3.0:1762167007.223455:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167007.223464:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167007.223471:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167007.223495:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.223518:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.223529:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167007.223544:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765451842816:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 148us (336us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167007.223550:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167007.223556:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7474 00010000:00010000:0.0:1762167007.223566:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a812 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb380a expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.223574:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.223601:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a812 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb380a expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.223612:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a812 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb380a expref: 893 pid: 32138 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.223624:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2443c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454444928:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.223681:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.225181:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.225210:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2443c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454444928:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.225231:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167007.225415:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451842944 00000100:00100000:3.0:1762167007.225422:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451842944 00010000:00010000:3.0:1762167007.225449:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a812 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb380a expref: 894 pid: 32138 timeout: 728 lvb_type: 0 00000100:00100000:3.0:1762167007.225480:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7475 00000100:00100000:3.0:1762167007.225489:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451842944:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167007.225504:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.225510:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a812 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb380a expref: 894 pid: 32138 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.225526:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a812 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb380a expref: 894 pid: 32138 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.225545:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a812 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb380a expref: 894 pid: 32138 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.225558:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:3.0:1762167007.225562:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167007.225570:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167007.225577:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167007.225598:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.225614:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.225623:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167007.225639:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2360:x1847765451842944:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 151us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.225646:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7475 00000100:00100000:0.0:1762167007.226205:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2443c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.226248:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.226277:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.226295:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454445056 00000100:00100000:3.0:1762167007.226301:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454445056 00000100:00100000:3.0:1762167007.226336:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1762167007.226344:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454445056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.226431:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454445056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.226438:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1762167007.226472:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2443c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.226517:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2443c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.226543:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.226568:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3479d76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.226611:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454445184 00000100:00100000:3.0:1762167007.226615:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454445184 00000100:00100000:3.0:1762167007.226648:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1762167007.226655:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454445184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.226713:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454445184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.226720:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1762167007.226808:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875745 gen 2 00000004:00080000:0.0:1762167007.226813:0:30820:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875720 committed transno 17179875745 00000004:00080000:0.0:1762167007.226826:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825b480, transno 17179875721 00000004:00080000:0.0:1762167007.226845:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f402300, transno 17179875722 00000004:00080000:0.0:1762167007.226848:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258700, transno 17179875723 00000004:00080000:0.0:1762167007.226851:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259880, transno 17179875724 00000004:00080000:0.0:1762167007.226854:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825ad80, transno 17179875725 00000004:00080000:0.0:1762167007.226856:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258380, transno 17179875726 00000004:00080000:0.0:1762167007.226860:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825aa00, transno 17179875727 00000004:00080000:0.0:1762167007.226863:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825a300, transno 17179875728 00000004:00080000:0.0:1762167007.226867:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aa8a80, transno 17179875729 00000004:00080000:0.0:1762167007.226870:0:30820:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875732 committed transno 17179875745 00000004:00080000:0.0:1762167007.226882:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03800, transno 17179875733 00000004:00080000:0.0:1762167007.226885:0:30820:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875736 committed transno 17179875745 00000004:00080000:0.0:1762167007.226894:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346a2f100, transno 17179875737 00000004:00080000:0.0:1762167007.226897:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346a2ca80, transno 17179875738 00000004:00080000:0.0:1762167007.226899:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346a2c700, transno 17179875739 00000004:00080000:0.0:1762167007.226902:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc2b800, transno 17179875740 00000004:00080000:0.0:1762167007.226905:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346a2e680, transno 17179875741 00000004:00080000:0.0:1762167007.226907:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346a2f480, transno 17179875742 00000004:00080000:0.0:1762167007.226910:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc2ad80, transno 17179875743 00000004:00080000:0.0:1762167007.226912:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28e00, transno 17179875744 00000004:00080000:0.0:1762167007.226914:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d3100, transno 17179875745 00000100:00100000:0.0:1762167007.226920:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2443c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.226975:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2443c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.226999:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.227020:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.227081:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454445312 00000100:00100000:3.0:1762167007.227085:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454445312 00000004:00080000:1.0:1762167007.227100:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 10 in progress, 0 in flight, 9 done 00000100:00100000:3.0:1762167007.227124:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1762167007.227134:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454445312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.227200:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454445312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.227208:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000004:00080000:1.0:1762167007.227221:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 10 done 00000100:00100000:2.0:1762167007.227247:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2443c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.227285:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.227314:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.227356:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454445440 00000100:00100000:2.0:1762167007.227357:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.227361:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454445440 00000100:00100000:3.0:1762167007.227403:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1762167007.227410:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454445440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.227463:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454445440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.227470:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1762167007.227510:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.227549:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.227571:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.227590:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.227600:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454445568 00000100:00100000:3.0:1762167007.227604:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454445568 00000100:00100000:3.0:1762167007.227626:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1762167007.227633:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454445568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.227691:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454445568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 57us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.227697:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1762167007.227738:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.227792:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.227814:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.227833:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.227925:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454445696 00000100:00100000:3.0:1762167007.227929:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454445696 00000100:00100000:3.0:1762167007.227955:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1762167007.227963:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454445696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.228018:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454445696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.228024:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1762167007.228092:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.228136:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.228158:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.228181:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.228201:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454445824 00000100:00100000:3.0:1762167007.228206:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454445824 00000100:00100000:3.0:1762167007.228241:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1762167007.228249:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454445824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.228334:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454445824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.228345:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1762167007.228400:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.228436:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.228461:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.228483:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.228507:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454445952 00000100:00100000:3.0:1762167007.228513:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454445952 00000100:00100000:3.0:1762167007.228544:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1762167007.228553:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454445952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.228618:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454445952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 66us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.228624:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1762167007.228696:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454445952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.228735:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f401f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.228758:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.228803:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.228816:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454446080 00000100:00100000:3.0:1762167007.228822:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454446080 00000100:00100000:3.0:1762167007.228854:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1762167007.228862:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454446080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.228922:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454446080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 61us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.228933:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1762167007.228967:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f401f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.229000:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f401f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.229022:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.229040:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.229043:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454446208 00000100:00100000:3.0:1762167007.229049:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454446208 00000100:00100000:3.0:1762167007.229081:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1762167007.229088:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454446208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.229144:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454446208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.229151:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:2.0:1762167007.229182:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f401f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.229221:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.229245:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.229267:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454446336 00000100:00100000:2.0:1762167007.229267:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.229273:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454446336 00000100:00100000:3.0:1762167007.229309:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1762167007.229316:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454446336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.229396:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454446336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.229404:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1762167007.229428:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.229467:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.229501:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.229521:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.229533:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454446464 00000100:00100000:0.0:1762167007.229540:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454446464 00000100:00100000:0.0:1762167007.229574:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1762167007.229581:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454446464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.229632:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454446464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 50us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.229640:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1762167007.229656:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.229701:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.229729:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.229748:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.229858:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454446592 00000100:00100000:3.0:1762167007.229863:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454446592 00000100:00100000:3.0:1762167007.229894:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1762167007.229901:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454446592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167007.229960:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454446592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 59us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.229967:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1762167007.229996:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.230028:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.230050:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.230080:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.230129:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454446720 00000100:00100000:0.0:1762167007.230134:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454446720 00000100:00100000:0.0:1762167007.230166:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1762167007.230173:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454446720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.230228:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454446720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.230235:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1762167007.230268:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.230307:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.230331:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.230365:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.230370:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454446848 00000100:00100000:3.0:1762167007.230396:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454446848 00000100:00100000:0.0:1762167007.230531:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1762167007.230538:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454446848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.230587:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454446848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 50us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.230592:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1762167007.230615:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.230645:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.230665:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.230683:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.230694:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454446976 00000100:00100000:0.0:1762167007.230700:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454446976 00000100:00100000:0.0:1762167007.230733:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:0.0:1762167007.230740:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454446976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.230818:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454446976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.230824:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1762167007.230837:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454446976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.230861:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.230876:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.230889:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.230891:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454447104 00000100:00100000:0.0:1762167007.230895:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454447104 00000100:00100000:0.0:1762167007.230917:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1762167007.230923:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454447104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.230986:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454447104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 63us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.230992:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1762167007.231003:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.231032:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.231051:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.231065:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.231080:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454447232 00000100:00100000:0.0:1762167007.231084:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454447232 00000100:00100000:0.0:1762167007.231104:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1762167007.231110:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454447232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.231160:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454447232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 48us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.231168:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1762167007.231172:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.231205:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.231229:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.231249:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454447360 00000100:00100000:2.0:1762167007.231251:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.231254:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454447360 00000100:00100000:0.0:1762167007.231284:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:0.0:1762167007.231290:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454447360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.231337:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454447360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 47us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.231355:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1762167007.231356:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.231407:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.231429:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.231447:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.231450:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454447488 00000100:00100000:0.0:1762167007.231456:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454447488 00000100:00100000:0.0:1762167007.231484:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1762167007.231490:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454447488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.231540:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454447488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.231546:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1762167007.231554:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447488:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1762167007.231836:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].52, 1088 off65440 00000001:00080000:2.0:1762167007.231845:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952873 00000100:00100000:2.0:1762167007.231893:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e472d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.231919:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.231940:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.231952:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454447616 00000100:00100000:0.0:1762167007.231958:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454447616 00000100:00100000:0.0:1762167007.231991:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1762167007.231998:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:30820:x1847765454447616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.232218:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:30820:x1847765454447616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 221us (298us total) trans 21474843294 rc 0/0 00000100:00100000:0.0:1762167007.232223:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1762167007.232253:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e472d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.232277:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167007.232301:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.232322:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.232333:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454447744 00000100:00100000:0.0:1762167007.232339:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454447744 00000100:00100000:0.0:1762167007.232368:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1762167007.232374:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454447744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167007.232587:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454447744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 212us (283us total) trans 17179875753 rc 0/0 00000100:00100000:0.0:1762167007.232594:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1762167007.232618:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454447744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762167007.232695:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952874 00010000:00010000:2.0:1762167007.232723:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232733:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232741:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232748:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.232752:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232805:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232823:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:2.0:1762167007.232826:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167007.232831:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232842:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0a851 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232863:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232869:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232875:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232880:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.232883:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232889:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232897:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167007.232901:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167007.232904:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232910:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a84a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.232923:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167007.232925:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167007.232931:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0a7b0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb37ee expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.233019:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242a6f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56203:x1847765451842688:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 11472us (11594us total) trans 8589952875 rc 0/0 00000100:00100000:2.0:1762167007.233028:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7332 00000020:00080000:2.0:1762167007.233032:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762167007.234467:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.234528:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451843072 00000100:00100000:3.0:1762167007.234537:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451843072 00000100:00100000:3.0:1762167007.234590:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19777 00000100:00100000:3.0:1762167007.234600:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56203:x1847765451843072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.234622:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.234642:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a858 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3834 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.234697:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a858 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3834 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.234712:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a858 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3834 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.234729:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167007.234745:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167007.234748:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:3.0:1762167007.234827:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56203:x1847765451843072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 227us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.234835:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19777 00000100:00100000:1.0:1762167007.236727:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.236979:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451843328 00000100:00100000:2.0:1762167007.236987:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451843328 00000100:00100000:2.0:1762167007.237034:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7333 00000100:00100000:2.0:1762167007.237045:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56203:x1847765451843328:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167007.237280:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56203:x1847765451843328:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 237us (558us total) trans 8589952876 rc 0/0 00000100:00100000:2.0:1762167007.237289:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7333 00000100:00100000:2.0:1762167007.238426:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.238479:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451843584 00000100:00100000:0.0:1762167007.238485:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451843584 00000100:00100000:0.0:1762167007.238535:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7334 00000100:00100000:0.0:1762167007.238545:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56203:x1847765451843584:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:0.0:1762167007.238823:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x64c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762167007.238942:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.238958:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.238970:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.238978:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.238985:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.238991:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.239015:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762167007.239042:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167007.239051:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.239060:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.239064:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.239073:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.239087:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64c:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167007.239091:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762167007.239096:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 1/0,0 mode: --/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.239102:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0a85f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.239125:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167007.239125:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56203:x1847765451843584:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 580us (700us total) trans 8589952877 rc 0/0 00010000:00010000:2.0:1762167007.239128:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167007.239132:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167007.239139:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7334 00000100:00100000:3.0:1762167007.249933:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.250086:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451843712 00000100:00100000:1.0:1762167007.250096:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451843712 00000100:00100000:1.0:1762167007.250160:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19778 00000100:00100000:1.0:1762167007.250170:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56204:x1847765451843712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167007.250192:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167007.250211:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a866 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb383b expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.250290:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a86d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250303:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a86d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250314:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a86d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250331:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a874 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250337:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a874 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250344:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a874 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250457:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250466:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250473:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762167007.250508:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92573 00000004:00200000:1.0:1762167007.250512:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167007.250530:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250540:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250548:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a86d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250553:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a86d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250559:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a86d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250568:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167007.250571:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a86d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250577:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a86d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250587:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:1.0:1762167007.250590:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167007.250594:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a86d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250611:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0a86d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250623:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a874 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250629:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a874 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250634:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a874 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250639:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167007.250641:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a874 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250646:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a874 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250652:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee345a77300) 00010000:00010000:1.0:1762167007.250655:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167007.250658:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a874 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250662:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a874 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.250692:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a866 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb383b expref: 899 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.250703:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb383b expref: 898 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.250710:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167007.250712:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167007.250715:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ba00, rc 0) 00000100:00100000:1.0:1762167007.250810:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56204:x1847765451843712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 641us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.250818:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19778 00000100:00100000:1.0:1762167007.252468:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.252564:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451843968 00000100:00100000:3.0:1762167007.252573:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451843968 00000100:00100000:3.0:1762167007.252621:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19779 00000100:00100000:3.0:1762167007.252631:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56204:x1847765451843968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.252647:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.252661:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a882 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3842 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.252752:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a889 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.252799:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a889 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.252810:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a889 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167007.252824:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92573 00010000:00010000:2.0:1762167007.252995:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0a882 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3842 expref: 901 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.253016:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a889 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3842 expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.253024:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167007.253027:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762167007.253030:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:2.0:1762167007.253084:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56204:x1847765451843968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 455us (619us total) trans 8589952878 rc 0/0 00000100:00100000:2.0:1762167007.253092:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19779 00000100:00100000:2.0:1762167007.254610:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.254651:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451844224 00000100:00100000:1.0:1762167007.254659:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451844224 00000100:00100000:1.0:1762167007.254698:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19780 00000100:00100000:1.0:1762167007.254705:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56204:x1847765451844224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167007.254723:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167007.254735:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a897 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3849 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.254839:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a89e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.254853:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a89e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.254862:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a89e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:1.0:1762167007.254874:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92573 00010000:00010000:1.0:1762167007.254971:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a897 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3849 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.254985:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a89e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3849 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.254991:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167007.254993:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167007.254994:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a800, rc 0) 00000100:00100000:1.0:1762167007.255036:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56204:x1847765451844224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 332us (433us total) trans 8589952879 rc 0/0 00000100:00100000:1.0:1762167007.255040:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19780 00000100:00100000:3.0:1762167007.279530:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.279678:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451844352 00000100:00100000:2.0:1762167007.279690:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451844352 00000100:00100000:2.0:1762167007.279753:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2876 00000100:00100000:2.0:1762167007.279795:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451844352:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167007.279832:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.279851:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 33 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.279859:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167007.279861:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167007.279865:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.279897:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 33 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.279910:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 33 pid: 33892 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.279924:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454447872:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.280010:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855600 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.280904:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454447872:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167007.280923:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.281035:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.281084:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451844480 00000100:00100000:0.0:1762167007.281090:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451844480 00010000:00010000:0.0:1762167007.281115:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 34 pid: 33892 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.281153:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7476 00000100:00100000:0.0:1762167007.281164:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451844480:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.281175:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.281202:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 34 pid: 33892 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.281214:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 34 pid: 33892 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.281234:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a835 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb381f expref: 34 pid: 33892 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.281247:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.281249:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.281252:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.281260:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.281285:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.281316:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.281326:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.281328:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451844480:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 166us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.281350:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7476 00010000:00010000:2.0:1762167007.282582:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.282595:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.282603:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.282610:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.282614:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.282627:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.282641:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.282648:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.282698:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451844352:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2937us (3176us total) trans 0 rc 92573/92573 00000100:00100000:2.0:1762167007.282704:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2876 00000100:00100000:0.0:1762167007.284250:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.284289:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.284321:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451844608 00000100:00100000:3.0:1762167007.284330:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451844608 00000100:00100000:1.0:1762167007.284355:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451844736 00000100:00100000:1.0:1762167007.284361:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451844736 00000100:00100000:3.0:1762167007.284398:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16800 00000100:00100000:3.0:1762167007.284409:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451844608:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:2.0:1762167007.284417:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16801 00010000:00010000:3.0:1762167007.284424:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762167007.284425:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451844736:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.284432:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.284438:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a8b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3850 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.284440:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3857 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.284484:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454448000:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762167007.284484:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454448128:192.168.203.35@tcp:106: 00000100:00100000:3.0:1762167007.284561:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.284561:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855600 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.285620:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454448128:192.168.203.35@tcp:106: 00010000:00010000:2.0:1762167007.285650:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8ba lrc: 1/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3857 expref: 33 pid: 33894 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167007.285657:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454448000:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762167007.285680:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a8b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3850 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.285686:0:33894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3857 expref: 33 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.285701:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00010000:00010000:3.0:1762167007.285707:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a8b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3850 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.285722:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:2.0:1762167007.285745:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451844736:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1318us (1452us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167007.285751:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451844608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1342us (1504us total) trans 0 rc 301/301 00000100:00100000:2.0:1762167007.285758:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16801 00000100:00100000:3.0:1762167007.285802:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16800 00000100:00100000:0.0:1762167007.287010:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.287052:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451844864 00000100:00100000:2.0:1762167007.287058:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451844864 00000100:00100000:2.0:1762167007.287109:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2877 00000100:00100000:2.0:1762167007.287119:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451844864:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167007.287147:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.287162:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3811 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.287170:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167007.287172:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167007.287175:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.287201:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3811 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.287218:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a819 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3811 expref: 26 pid: 6532 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.287231:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454448256:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.287289:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855600 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.288156:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454448256:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167007.288178:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.288336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.288374:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451844992 00000100:00100000:3.0:1762167007.288390:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451844992 00010000:00010000:3.0:1762167007.288458:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a819 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3811 expref: 27 pid: 6532 timeout: 728 lvb_type: 0 00000100:00100000:3.0:1762167007.288490:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7477 00000100:00100000:3.0:1762167007.288498:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451844992:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167007.288510:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.288527:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a819 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3811 expref: 27 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.288538:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3811 expref: 27 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.288556:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0a819 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3811 expref: 27 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.288568:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.288570:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.288574:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.288584:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.288613:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.288637:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.288647:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451844992:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 148us (311us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167007.288651:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.288660:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7477 00010000:00010000:2.0:1762167007.290049:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.290068:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.290076:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.290082:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.290086:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.290094:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.290108:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.290115:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->94207] (req 0->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.290182:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451844864:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3064us (3173us total) trans 0 rc 92573/92573 00000100:00100000:2.0:1762167007.290191:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2877 00000100:00100000:0.0:1762167007.297177:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.297221:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451845120 00000100:00100000:3.0:1762167007.297231:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451845120 00000100:00100000:3.0:1762167007.297293:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 645 00000100:00100000:3.0:1762167007.297304:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56204:x1847765451845120:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:3.0:1762167007.297318:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.297340:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a89e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3849 expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.297357:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167007.297362:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167007.297425:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56204:x1847765451845120:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 123us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.297432:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 645 00000100:00100000:1.0:1762167007.298256:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.298304:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451845376 00000100:00100000:0.0:1762167007.298309:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451845376 00000100:00100000:0.0:1762167007.298341:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7335 00000100:00100000:0.0:1762167007.298349:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56204:x1847765451845376:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167007.298573:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56204:x1847765451845376:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 224us (319us total) trans 8589952880 rc 0/0 00000100:00100000:0.0:1762167007.298580:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7335 00000100:00100000:0.0:1762167007.300667:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.300792:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451845632 00000100:00100000:1.0:1762167007.300804:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451845632 00000100:00100000:1.0:1762167007.300854:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19781 00000100:00100000:1.0:1762167007.300862:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56065:x1847765451845632:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167007.300879:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167007.300899:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a8c8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb385e expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.300998:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.301013:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb383b expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.301021:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.301054:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb383b expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.301067:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb383b expref: 903 pid: 30818 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.301080:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454448384:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167007.301152:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f48e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.302045:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454448384:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167007.302065:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167007.302232:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.302330:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451845760 00000100:00100000:3.0:1762167007.302335:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451845760 00010000:00010000:3.0:1762167007.302358:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb383b expref: 904 pid: 30818 timeout: 728 lvb_type: 0 00000100:00100000:3.0:1762167007.302399:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7478 00000100:00100000:3.0:1762167007.302409:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2360:x1847765451845760:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167007.302420:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.302428:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb383b expref: 904 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.302440:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb383b expref: 904 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.302458:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0a87b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb383b expref: 904 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.302473:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167007.302477:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.302486:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.302493:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.302517:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.302549:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167007.302564:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2360:x1847765451845760:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 153us (328us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167007.302564:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167007.302582:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7478 00000004:00200000:2.0:1762167007.302586:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92573 00010000:00010000:2.0:1762167007.302706:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0a8c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb385e expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.302722:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb385e expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.302735:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167007.302738:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167007.302740:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a000, rc 0) 00000100:00100000:2.0:1762167007.302804:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451845632:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1942us (2144us total) trans 8589952881 rc 0/0 00000100:00100000:2.0:1762167007.302810:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19781 00000100:00100000:0.0:1762167007.303898:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.303937:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451845888 00000100:00100000:2.0:1762167007.303944:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451845888 00000100:00100000:2.0:1762167007.303982:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19782 00000100:00100000:2.0:1762167007.303990:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451845888:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167007.304006:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.304020:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8dd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3865 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.304092:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.304105:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb385e expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.304112:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.304137:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb385e expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.304148:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb385e expref: 904 pid: 30818 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.304161:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454448512:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.304206:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855600 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.305054:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454448512:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167007.305069:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167007.305208:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.305243:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451846016 00000100:00100000:3.0:1762167007.305249:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451846016 00010000:00010000:3.0:1762167007.305302:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb385e expref: 905 pid: 30818 timeout: 728 lvb_type: 0 00000100:00100000:3.0:1762167007.305328:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7479 00000100:00100000:3.0:1762167007.305335:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2361:x1847765451846016:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167007.305348:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.305353:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb385e expref: 905 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.305363:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb385e expref: 905 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.305378:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0a8cf lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb385e expref: 905 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.305403:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167007.305407:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.305414:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.305420:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.305442:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.305469:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167007.305478:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2361:x1847765451846016:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 140us (268us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167007.305483:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167007.305490:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7479 00000004:00200000:2.0:1762167007.305512:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 92573 00000004:00200000:2.0:1762167007.305516:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167007.305531:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.305556:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a8dd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3865 expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.305576:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3865 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.305584:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167007.305586:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167007.305589:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167007.305628:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451845888:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1635us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.305638:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19782 00000100:00100000:0.0:1762167007.306753:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.306831:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451846144 00000100:00100000:3.0:1762167007.306837:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451846144 00000100:00100000:0.0:1762167007.306840:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.306879:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451846272 00000100:00100000:3.0:1762167007.306883:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451846272 00000100:00100000:2.0:1762167007.306893:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16802 00000100:00100000:2.0:1762167007.306905:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451846144:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167007.306917:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.306932:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb386c expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167007.306957:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 92573, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x103 00010000:00010000:2.0:1762167007.306975:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762167007.306976:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16803 00010000:00010000:2.0:1762167007.306980:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.306990:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb386c expref: 26 pid: 33894 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167007.306996:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451846272:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167007.307012:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.307013:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb386c expref: 26 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.307024:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a8f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3873 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.307026:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:3.0:1762167007.307072:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454448640:192.168.203.35@tcp:106: 00000100:00100000:2.0:1762167007.307075:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451846144:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 170us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.307086:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16802 00000100:00100000:3.0:1762167007.307133:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.308102:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454448640:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762167007.308128:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a8f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3873 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.308144:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a8f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3873 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.308158:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:3.0:1762167007.308193:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451846272:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1206us (1352us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167007.308200:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16803 00000100:00100000:0.0:1762167007.309491:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.309538:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451846400 00000100:00100000:3.0:1762167007.309544:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451846400 00000100:00100000:3.0:1762167007.309583:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16804 00000100:00100000:3.0:1762167007.309588:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451846400:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167007.309600:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.309611:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a8f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb387a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.309648:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454448768:192.168.203.35@tcp:106: 00000100:00100000:3.0:1762167007.309714:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.310653:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454448768:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762167007.310678:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a8f9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb387a expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.310696:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a8f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb387a expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.310709:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167007.310745:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451846400:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1156us (1259us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167007.310750:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16804 00000100:00100000:1.0:1762167007.312070:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.312111:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451846528 00000100:00100000:3.0:1762167007.312119:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451846528 00000100:00100000:3.0:1762167007.312162:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16805 00000100:00100000:3.0:1762167007.312173:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451846528:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167007.312185:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.312196:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a900 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3881 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.312230:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454448896:192.168.203.35@tcp:106: 00000100:00100000:3.0:1762167007.312285:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.313158:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454448896:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762167007.313183:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a900 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3881 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.313205:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a900 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3881 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.313219:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167007.313257:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451846528:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1087us (1191us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167007.313265:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16805 00000100:00100000:0.0:1762167007.314317:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.314359:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451846656 00000100:00100000:3.0:1762167007.314364:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451846656 00000100:00100000:3.0:1762167007.314413:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16806 00000100:00100000:3.0:1762167007.314420:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2358:x1847765451846656:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167007.314430:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.314442:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a907 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3888 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.314482:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454449024:192.168.203.35@tcp:106: 00000100:00100000:3.0:1762167007.314539:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24451f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.315431:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454449024:192.168.203.35@tcp:106: 00010000:00010000:3.0:1762167007.315458:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a907 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3888 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.315475:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a907 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3888 expref: 33 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.315486:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:3.0:1762167007.315524:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2358:x1847765451846656:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1104us (1208us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167007.315531:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16806 00000100:00100000:0.0:1762167007.316701:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.316759:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451846912 00000100:00100000:2.0:1762167007.316795:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451846912 00000100:00100000:2.0:1762167007.316845:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19783 00000100:00100000:2.0:1762167007.316855:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451846912:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167007.316904:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.316927:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0a8e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3865 expref: 903 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.316942:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167007.316947:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.317156:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.317168:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.317178:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:2.0:1762167007.317244:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952882 00000004:00010000:2.0:1762167007.317266:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000026aa6c29 reply state 0000000062a73e73 transno 8589952883 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167007.317272:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167007.317330:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451846912:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 477us (633us total) trans 8589952883 rc 0/0 00000100:00100000:2.0:1762167007.317336:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19783 00000020:00080000:2.0:1762167007.317340:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167007.317969:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.317977:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.317989:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.317997:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167007.318002:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.318013:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.318024:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167007.318027:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167007.318031:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167007.318036:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0a90e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167007.318259:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.318333:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451847168 00000100:00100000:2.0:1762167007.318338:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451847168 00000100:00100000:2.0:1762167007.318370:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7336 00000100:00100000:2.0:1762167007.318377:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451847168:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167007.318541:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451847168:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 163us (283us total) trans 8589952884 rc 0/0 00000100:00100000:2.0:1762167007.318549:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7336 00000100:00100000:0.0:1762167007.319432:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.319466:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451847424 00000100:00100000:2.0:1762167007.319470:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451847424 00000100:00100000:2.0:1762167007.319499:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19784 00000100:00100000:2.0:1762167007.319507:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56065:x1847765451847424:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167007.319521:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.319524:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762167007.319541:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0a889 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3842 expref: 905 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.319558:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a858 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3834 expref: 904 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.319570:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167007.319578:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.319589:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a915 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb388f expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.319618:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a91c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.319625:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a91c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.319631:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a91c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000040:00080000:2.0:1762167007.320147:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5412, 88 off436616 00000004:00080000:2.0:1762167007.320155:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628112392328ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.320212:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5420, 88 off437672 00000004:00080000:2.0:1762167007.320218:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628112455079ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.320286:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5421, 88 off437760 00000004:00080000:2.0:1762167007.320291:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628112528680ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.320313:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5413, 88 off436704 00000004:00080000:2.0:1762167007.320316:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628112553501ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.320353:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5422, 88 off437848 00000004:00080000:2.0:1762167007.320358:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628112594881ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.320398:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5414, 88 off436792 00000004:00080000:2.0:1762167007.320403:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628112640195ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.320433:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5415, 88 off436880 00000004:00080000:2.0:1762167007.320438:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628112675181ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.320465:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5423, 88 off437936 00000004:00080000:2.0:1762167007.320470:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628112706899ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.320497:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5424, 88 off438024 00000004:00080000:2.0:1762167007.320501:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628112738789ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.320513:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5416, 88 off436968 00000004:00080000:2.0:1762167007.320516:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628112753238ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.320530:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5425, 88 off438112 00000004:00080000:2.0:1762167007.320533:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628112769971ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.320559:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5417, 88 off437056 00000004:00080000:2.0:1762167007.320563:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628112800620ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.320585:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5418, 88 off437144 00000004:00080000:2.0:1762167007.320589:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628112826309ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.320613:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5426, 88 off438200 00000004:00080000:2.0:1762167007.320617:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628112854650ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.320642:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5427, 88 off438288 00000004:00080000:2.0:1762167007.320646:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628112883513ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.320665:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5419, 88 off437232 00000004:00080000:2.0:1762167007.320669:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628112906106ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.320692:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5420, 88 off437320 00000004:00080000:2.0:1762167007.320696:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628112933406ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.320721:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5428, 88 off438376 00000004:00080000:2.0:1762167007.320725:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628112962316ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.320748:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5429, 88 off438464 00000004:00080000:2.0:1762167007.320752:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628112989071ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.320809:0:30818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5421, 88 off437408 00000004:00080000:2.0:1762167007.320813:0:30818:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628113050765ns, next at 628532618837ns, rc = 0 00000001:00080000:2.0:1762167007.331270:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952880 is committed 00010000:00010000:3.0:1762167007.331296:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a91c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb388f expref: 902 pid: 30818 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762167007.331300:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952885 is committed 00000004:00080000:2.0:1762167007.331306:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3529 committed 00010000:00010000:3.0:1762167007.331325:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0600) 00000004:00080000:2.0:1762167007.331326:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3542 committed 00010000:00010000:3.0:1762167007.331331:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:2.0:1762167007.331341:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3541 committed 00000004:00080000:2.0:1762167007.331346:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3528 committed 00000004:00080000:2.0:1762167007.331349:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3527 committed 00000004:00080000:2.0:1762167007.331352:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3540 committed 00010000:00010000:3.0:1762167007.331354:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a915 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb388f expref: 901 pid: 30818 timeout: 0 lvb_type: 3 00000004:00080000:2.0:1762167007.331356:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3539 committed 00000004:00080000:2.0:1762167007.331360:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3526 committed 00000004:00080000:2.0:1762167007.331365:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3525 committed 00000004:00080000:2.0:1762167007.331371:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3538 committed 00000004:00080000:2.0:1762167007.331373:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3524 committed 00000004:00080000:2.0:1762167007.331376:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3537 committed 00000004:00080000:2.0:1762167007.331378:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3536 committed 00010000:00010000:3.0:1762167007.331388:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a91c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb388f expref: 900 pid: 30818 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762167007.331394:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3523 committed 00000004:00080000:2.0:1762167007.331399:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3522 committed 00000004:00080000:2.0:1762167007.331402:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3535 committed 00000004:00080000:2.0:1762167007.331404:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3521 committed 00000004:00080000:2.0:1762167007.331406:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3534 committed 00000004:00080000:2.0:1762167007.331408:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3533 committed 00000004:00080000:2.0:1762167007.331410:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3520 committed 00010000:00010000:3.0:1762167007.331428:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0600) 00000020:00080000:2.0:1762167007.331432:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee3479d7b40 refcount 2 committed 0 result 0 batchid 4294969184 00010000:00010000:3.0:1762167007.331434:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762167007.331440:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00000020:00080000:2.0:1762167007.331440:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee381855b40 00000020:00080000:2.0:1762167007.331446:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f672f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee2424b9480 00000020:00080000:2.0:1762167007.331449:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee37f672400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee247797c00 00000020:00080000:2.0:1762167007.331452:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].52 00000100:00100000:3.0:1762167007.331520:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451847424:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 12011us (12088us total) trans 8589952885 rc 0/0 00000100:00100000:3.0:1762167007.331531:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19784 00000100:00100000:0.0:1762167007.331590:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454449280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.331618:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454449152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.331652:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1762167007.331659:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969184 committed batchid 4294969183 00000100:00100000:0.0:1762167007.331720:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454449792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.331731:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.331779:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.331789:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454449664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.331813:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454450304:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1762167007.331851:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969183 00000100:00100000:1.0:1762167007.331863:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454449408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.331907:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.331930:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454450176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.331951:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.331969:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454450688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.331994:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.332017:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762167007.332026:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454450816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.332028:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.332033:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454449536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.332077:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454449280 00000100:00100000:2.0:1762167007.332081:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.332084:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454449152 00000100:00100000:0.0:1762167007.332085:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454449280 00000100:00100000:3.0:1762167007.332091:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454449152 00000100:00100000:1.0:1762167007.332100:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454449792 00000100:00100000:1.0:1762167007.332105:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454449792 00000100:00100000:0.0:1762167007.332128:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454449664 00000100:00100000:0.0:1762167007.332131:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454449664 00000100:00100000:1.0:1762167007.332134:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454450176 00000100:00100000:3.0:1762167007.332136:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454450688 00000100:00100000:2.0:1762167007.332137:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454450304 00000100:00100000:1.0:1762167007.332137:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454450176 00000100:00100000:3.0:1762167007.332142:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454450688 00000100:00100000:2.0:1762167007.332144:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454450304 00000100:00100000:0.0:1762167007.332146:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454450816 00000100:00100000:0.0:1762167007.332151:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454450816 00000100:00100000:1.0:1762167007.332155:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16807 00000100:00100000:1.0:1762167007.332165:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3294:x1847765454449280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.332172:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16808 00000100:00100000:2.0:1762167007.332182:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16809 00000100:00100000:3.0:1762167007.332184:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454449152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.332191:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16810 00000100:00100000:2.0:1762167007.332197:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3294:x1847765454449792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.332206:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765454449664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167007.332348:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.332352:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.332355:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.332358:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.332361:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167007.332396:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.332399:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.332401:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.332404:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.332406:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.332421:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454449280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 259us (770us total) trans 21474843295 rc 0/0 00000100:00100000:2.0:1762167007.332428:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454449792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 234us (645us total) trans 21474843296 rc 0/0 00000100:00100000:1.0:1762167007.332434:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16807 00000100:00100000:0.0:1762167007.332443:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454449664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (536us total) trans 17179875754 rc 0/0 00000100:00100000:2.0:1762167007.332444:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16809 00000100:00100000:1.0:1762167007.332454:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16811 00000100:00100000:1.0:1762167007.332461:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454450176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.332463:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16810 00000100:00100000:2.0:1762167007.332470:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16812 00000100:00100000:0.0:1762167007.332484:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16813 00000100:00100000:2.0:1762167007.332485:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765454450688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.332495:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454450304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.332509:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454449152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 328us (780us total) trans 21474843297 rc 0/0 00000100:00100000:3.0:1762167007.332515:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16808 00000100:00100000:3.0:1762167007.332548:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16814 00000100:00100000:3.0:1762167007.332559:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765454450816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.332581:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454450176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (627us total) trans 21474843298 rc 0/0 00000100:00100000:1.0:1762167007.332588:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16811 00000100:00100000:1.0:1762167007.332611:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.332633:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454450048:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167007.332634:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.332637:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.332639:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.332642:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.332644:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1762167007.332656:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 154055 -> 154055 00000100:00100000:1.0:1762167007.332661:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167007.332662:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.332665:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167007.332669:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167007.332671:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454450304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (643us total) trans 21474843299 rc 0/0 00002000:00010000:2.0:1762167007.332672:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167007.332676:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454450560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.332682:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16813 00000100:00100000:0.0:1762167007.332696:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454449536 00000100:00100000:0.0:1762167007.332699:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454449536 00000100:00100000:1.0:1762167007.332710:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.332717:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454450048 00000100:00100000:0.0:1762167007.332720:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454450048 00000100:00100000:2.0:1762167007.332722:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454450688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (726us total) trans 17179875755 rc 0/0 00000100:00100000:1.0:1762167007.332730:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454451072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.332736:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16812 00000100:00100000:3.0:1762167007.332742:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454450816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (665us total) trans 17179875756 rc 0/0 00000100:00100000:0.0:1762167007.332746:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454450560 00000100:00100000:0.0:1762167007.332750:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454450560 00000100:00100000:3.0:1762167007.332753:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16814 00000100:00100000:1.0:1762167007.332760:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.332791:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454451072 00000100:00100000:0.0:1762167007.332795:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454451072 00000100:00100000:3.0:1762167007.332803:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16815 00000100:00100000:3.0:1762167007.332815:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454449536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.332820:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16816 00000100:00100000:1.0:1762167007.332821:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.332832:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454450048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.332839:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454449920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.332863:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.332881:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454450432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.332904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.332920:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454450944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.332940:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454449408 00000100:00100000:2.0:1762167007.332945:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454449408 00000100:00100000:1.0:1762167007.332949:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167007.332960:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.332965:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167007.332968:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.332969:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1762167007.332970:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454449920 00000100:00100000:2.0:1762167007.332976:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454449920 00002000:00010000:3.0:1762167007.332977:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167007.332977:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.332984:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167007.332984:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000004:00080000:1.0:1762167007.332991:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce4700/2, rc 0, transno 21474843295 00002000:00010000:0.0:1762167007.332991:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167007.332994:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454450432 00002000:00010000:0.0:1762167007.332995:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167007.332999:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454450432 00000100:00100000:1.0:1762167007.333004:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454449280:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167007.333022:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb7100/2, rc 0, transno 21474843296 00000100:00100000:2.0:1762167007.333023:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454450944 00000100:00100000:2.0:1762167007.333029:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454450944 00000100:00100000:1.0:1762167007.333029:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454449792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.333033:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454449536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (419us total) trans 17179875757 rc 0/0 00000100:00100000:0.0:1762167007.333038:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3296:x1847765454450048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (377us total) trans 21474843300 rc 0/0 00000004:00080000:1.0:1762167007.333043:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb5880/2, rc 0, transno 21474843299 00000100:00100000:3.0:1762167007.333047:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16815 00000100:00100000:1.0:1762167007.333051:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454450304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.333054:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16816 00000100:00100000:2.0:1762167007.333065:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16817 00000100:00100000:3.0:1762167007.333075:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16818 00000100:00100000:2.0:1762167007.333078:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454450560:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167007.333080:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc2b800/2, rc 0, transno 17179875757 00000100:00100000:0.0:1762167007.333083:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16819 00000100:00100000:3.0:1762167007.333089:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454451072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.333094:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454449536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.333097:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454449408:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167007.333105:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb6680/2, rc 0, transno 21474843300 00000100:00100000:1.0:1762167007.333109:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454450048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.333182:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762167007.333189:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454451456:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167007.333217:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167007.333217:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167007.333223:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.333226:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167007.333228:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.333231:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.333248:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454451328:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167007.333250:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.333253:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.333257:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167007.333260:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.333262:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167007.333274:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 205925 -> 205925 00000100:00100000:2.0:1762167007.333279:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454450560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (565us total) trans 17179875758 rc 0/0 00002000:00010000:3.0:1762167007.333282:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00000100:00100000:1.0:1762167007.333285:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167007.333290:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.333295:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167007.333297:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16817 00000100:00100000:0.0:1762167007.333297:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454449408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (477us total) trans 21474843301 rc 0/0 00002000:00010000:3.0:1762167007.333298:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167007.333301:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1762167007.333310:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16819 00000100:00100000:1.0:1762167007.333311:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454451200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.333322:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454451456 00000100:00100000:2.0:1762167007.333327:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454451456 00000100:00100000:0.0:1762167007.333328:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454451328 00000100:00100000:0.0:1762167007.333334:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454451328 00000100:00100000:3.0:1762167007.333343:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454451072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 257us (581us total) trans 17179875759 rc 0/0 00000100:00100000:1.0:1762167007.333345:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.333354:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16820 00000100:00100000:0.0:1762167007.333355:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454451200 00000100:00100000:0.0:1762167007.333359:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454451200 00000100:00100000:3.0:1762167007.333362:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16818 00000100:00100000:2.0:1762167007.333367:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3295:x1847765454449920:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167007.333378:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce6a00/2, rc 0, transno 21474843301 00000100:00100000:0.0:1762167007.333392:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16821 00000100:00100000:1.0:1762167007.333395:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454449408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.333403:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16822 00000100:00100000:0.0:1762167007.333404:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454450432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.333418:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454450944:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167007.333419:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2477d3100/2, rc 0, transno 17179875758 00000100:00100000:1.0:1762167007.333433:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454450560:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167007.333445:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825ad80/2, rc 0, transno 17179875759 00000100:00100000:1.0:1762167007.333448:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454451072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.333486:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762167007.333495:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454451584:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167007.333507:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.333511:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.333512:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167007.333515:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.333517:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.333525:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167007.333552:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb5180/2, rc 0, transno 21474843302 00000100:00100000:2.0:1762167007.333554:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3295:x1847765454449920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (690us total) trans 21474843302 rc 0/0 00000100:00100000:1.0:1762167007.333561:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454449920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.333567:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16820 00002000:00010000:3.0:1762167007.333574:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1762167007.333578:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28e00/2, rc 0, transno 17179875760 00002000:00010000:3.0:1762167007.333579:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00000100:00100000:0.0:1762167007.333580:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454450432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (674us total) trans 17179875760 rc 0/0 00000100:00100000:1.0:1762167007.333584:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454450432:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167007.333586:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167007.333586:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454451584 00000100:00100000:2.0:1762167007.333592:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454451584 00002000:00010000:3.0:1762167007.333593:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167007.333593:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16821 00002000:00010000:3.0:1762167007.333600:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167007.333608:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16823 00000100:00100000:0.0:1762167007.333615:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16824 00000100:00100000:1.0:1762167007.333617:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3296:x1847765454451456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.333622:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454451328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.333626:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16825 00000100:00100000:2.0:1762167007.333638:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454451200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.333645:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454450944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 230us (696us total) trans 17179875761 rc 0/0 00000100:00100000:3.0:1762167007.333655:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16822 00000100:00100000:3.0:1762167007.333675:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16826 00000100:00100000:3.0:1762167007.333685:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454451584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167007.333714:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.333716:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 26859 -> 26859 00002000:00010000:1.0:1762167007.333718:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.333719:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.333721:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.333722:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.333725:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.333725:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.333728:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1762167007.333728:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 67 -> 67 00000100:00100000:0.0:1762167007.333785:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3294:x1847765454451328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (482us total) trans 21474843304 rc 0/0 00002000:00010000:2.0:1762167007.333788:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167007.333790:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3296:x1847765454451456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (573us total) trans 21474843303 rc 0/0 00002000:00010000:2.0:1762167007.333792:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167007.333793:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16824 00002000:00010000:2.0:1762167007.333797:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.333803:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:1.0:1762167007.333803:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16823 00002000:00010000:2.0:1762167007.333808:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:1.0:1762167007.333835:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c3480/2, rc 0, transno 21474843303 00000004:00080000:0.0:1762167007.333840:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258700/2, rc 0, transno 17179875756 00000100:00100000:1.0:1762167007.333842:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454451456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.333848:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454451200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (502us total) trans 17179875762 rc 0/0 00000100:00100000:0.0:1762167007.333848:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454450816:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167007.333850:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 92573 -> 92573 00002000:00010000:3.0:1762167007.333858:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.333863:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167007.333863:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16825 00000004:00080000:1.0:1762167007.333864:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348259880/2, rc 0, transno 17179875761 00000004:00080000:0.0:1762167007.333865:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc30700/2, rc 0, transno 21474843297 00002000:00010000:3.0:1762167007.333871:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:1.0:1762167007.333872:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454450944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.333873:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454449152:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167007.333877:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 259 -> 259 00000004:00080000:0.0:1762167007.333888:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc2ad80/2, rc 0, transno 17179875754 00000100:00100000:0.0:1762167007.333893:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454449664:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167007.333895:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c0700/2, rc 0, transno 17179875762 00000100:00100000:1.0:1762167007.333898:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454451200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167007.333902:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb5500/2, rc 0, transno 21474843298 00000004:00080000:1.0:1762167007.333908:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c3100/2, rc 0, transno 21474843304 00000100:00100000:0.0:1762167007.333908:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454450176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.333912:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454451328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167007.333920:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825b480/2, rc 0, transno 17179875755 00000100:00100000:0.0:1762167007.333924:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454450688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.333928:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454451584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (400us total) trans 17179875763 rc 0/0 00000100:00100000:3.0:1762167007.333938:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16826 00000004:00080000:2.0:1762167007.333957:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c2a00/2, rc 0, transno 17179875763 00000100:00100000:2.0:1762167007.333963:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454451584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.334271:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.334342:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451847552 00000100:00100000:3.0:1762167007.334347:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451847552 00000100:00100000:3.0:1762167007.334397:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16827 00000100:00100000:3.0:1762167007.334405:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56065:x1847765451847552:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167007.334415:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.334431:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a923 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3896 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167007.334448:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 92573, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x2f 00010000:00010000:3.0:1762167007.334464:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.334466:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.334474:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a923 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3896 expref: 33 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.334488:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a923 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3896 expref: 33 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.334500:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:3.0:1762167007.334549:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:56065:x1847765451847552:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 143us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.334555:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16827 00000100:00100000:2.0:1762167007.336247:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.336284:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.336309:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451847680 00000100:00100000:2.0:1762167007.336314:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.336318:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451847680 00002000:00010000:1.0:1762167007.336349:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (122986->18446744073709551615) 00002000:00100000:1.0:1762167007.336354:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b2680 with x1847765451847680 ext(122986->18446744073709551615) 00002000:00010000:1.0:1762167007.336363:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b2680. 00000100:00100000:3.0:1762167007.336368:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451847808 00000100:00100000:3.0:1762167007.336374:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451847808 00000100:00100000:0.0:1762167007.336376:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451847936 00000100:00100000:0.0:1762167007.336397:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451847936 00002000:00010000:3.0:1762167007.336402:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:1.0:1762167007.336404:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2878 00002000:00100000:3.0:1762167007.336408:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247858a80 with x1847765451847808 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.336413:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:3.0:1762167007.336416:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee247858a80. 00002000:00100000:0.0:1762167007.336419:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24785a680 with x1847765451847936 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167007.336420:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451847680:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:0.0:1762167007.336426:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24785a680. 00000100:00100000:3.0:1762167007.336440:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2879 00000100:00100000:3.0:1762167007.336450:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451847808:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167007.336456:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2880 00000100:00100000:2.0:1762167007.336471:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451847936:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167007.336688:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.336692:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.336693:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.336697:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 92573 -> 122986 00002000:00010000:2.0:1762167007.336698:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.336700:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.336702:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.336706:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.336708:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.336709:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.336712:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.336716:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167007.336716:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.336718:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167007.336724:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 47 00000100:00100000:1.0:1762167007.336802:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765451847680:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 386us (559us total) trans 21474843305 rc 0/0 00000100:00100000:2.0:1762167007.336804:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451847936:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 336us (487us total) trans 21474843306 rc 0/0 00000100:00100000:3.0:1762167007.336806:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451847808:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 356us (520us total) trans 17179875764 rc 0/0 00000100:00100000:1.0:1762167007.336822:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2878 00002000:00010000:1.0:1762167007.336827:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (122986->18446744073709551615) 00000100:00100000:2.0:1762167007.336830:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2880 00002000:00100000:1.0:1762167007.336833:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b2680 with x1847765451847680 ext(122986->18446744073709551615) 00002000:00010000:2.0:1762167007.336836:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:3.0:1762167007.336840:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2879 00002000:00010000:1.0:1762167007.336841:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b2680. 00002000:00100000:2.0:1762167007.336842:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24785a680 with x1847765451847936 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167007.336848:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:2.0:1762167007.336852:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24785a680. 00002000:00100000:3.0:1762167007.336854:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247858a80 with x1847765451847808 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167007.336862:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee247858a80. 00000100:00100000:0.0:1762167007.338879:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.338937:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451848064 00000100:00100000:3.0:1762167007.338945:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451848064 00002000:00100000:3.0:1762167007.338984:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->114687) req@ffff9ee24354f800 x1847765451848064/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.338993:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354f800 with x1847765451848064 ext(110592->114687) 00002000:00010000:3.0:1762167007.338997:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354f800 00000100:00100000:3.0:1762167007.339023:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2881 00000100:00100000:3.0:1762167007.339031:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2358:x1847765451848064:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762167007.339226:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2358:x1847765451848064:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 195us (356us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762167007.339232:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2881 00002000:00100000:3.0:1762167007.339239:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->114687) req@ffff9ee24354f800 x1847765451848064/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/4536 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.339247:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354f800 with x1847765451848064 ext(110592->114687) 00002000:00010000:3.0:1762167007.339251:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354f800 00000100:00100000:0.0:1762167007.341461:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.341519:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451848192 00000100:00100000:3.0:1762167007.341528:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451848192 00002000:00100000:3.0:1762167007.341577:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (114688->118783) req@ffff9ee24354c000 x1847765451848192/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.341586:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354c000 with x1847765451848192 ext(114688->118783) 00002000:00010000:3.0:1762167007.341592:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354c000 00000100:00100000:3.0:1762167007.341617:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2882 00000100:00100000:3.0:1762167007.341625:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451848192:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762167007.341878:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451848192:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 252us (423us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762167007.341886:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2882 00002000:00100000:3.0:1762167007.341893:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (114688->118783) req@ffff9ee24354c000 x1847765451848192/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/4536 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.341901:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354c000 with x1847765451848192 ext(114688->118783) 00002000:00010000:3.0:1762167007.341904:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354c000 00000100:00100000:2.0:1762167007.343802:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.343866:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451848320 00000100:00100000:3.0:1762167007.343873:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451848320 00002000:00100000:3.0:1762167007.343909:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (90112->126975) req@ffff9ee247858380 x1847765451848320/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 504/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.343919:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247858380 with x1847765451848320 ext(90112->126975) 00002000:00010000:3.0:1762167007.343924:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee247858380 00000100:00100000:3.0:1762167007.343955:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2883 00000100:00100000:3.0:1762167007.343970:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451848320:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762167007.345458:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451848320:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1484us (1658us total) trans 0 rc 28672/28672 00000100:00100000:3.0:1762167007.345471:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2883 00002000:00100000:3.0:1762167007.345481:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (90112->126975) req@ffff9ee247858380 x1847765451848320/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 504/440 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 28672/28672 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.345491:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247858380 with x1847765451848320 ext(90112->126975) 00002000:00010000:3.0:1762167007.345496:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee247858380 00000100:00100000:0.0:1762167007.347580:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.347634:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451848448 00000100:00100000:3.0:1762167007.347643:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451848448 00002000:00100000:3.0:1762167007.347698:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->122985) req@ffff9ee24354e300 x1847765451848448/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 12888/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.347759:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354e300 with x1847765451848448 ext(110592->122985) 00002000:00010000:3.0:1762167007.347809:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354e300 00000100:00100000:3.0:1762167007.347836:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2884 00000100:00100000:3.0:1762167007.347847:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451848448:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:3.0:1762167007.348292:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2360:x1847765451848448:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 446us (719us total) trans 21474843307 rc 0/0 00000100:00100000:3.0:1762167007.348301:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2884 00002000:00100000:3.0:1762167007.348309:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->122985) req@ffff9ee24354e300 x1847765451848448/t21474843307(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 12888/448 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.348318:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354e300 with x1847765451848448 ext(110592->122985) 00002000:00010000:3.0:1762167007.348322:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354e300 00000100:00100000:2.0:1762167007.349578:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.349643:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451848576 00000100:00100000:3.0:1762167007.349648:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451848576 00000100:00100000:3.0:1762167007.349687:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16828 00000100:00100000:3.0:1762167007.349697:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2361:x1847765451848576:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167007.363806:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843304 is committed 00000001:00080000:1.0:1762167007.363841:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843289 is committed 00000001:00080000:1.0:1762167007.363859:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843305 is committed 00000001:00080000:1.0:1762167007.363885:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843306 is committed 00000001:00080000:1.0:1762167007.363907:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843307 is committed 00000100:00100000:2.0:1762167007.363915:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451848576:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 14211us (14333us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.363929:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16828 00000100:00100000:0.0:1762167007.365585:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.365644:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451848704 00000100:00100000:3.0:1762167007.365654:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451848704 00000100:00100000:3.0:1762167007.365714:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19785 00000100:00100000:3.0:1762167007.365724:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451848704:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167007.365748:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.365809:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a92a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb389d expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.365892:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a931 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.365906:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a931 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.365915:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a931 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167007.365936:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 122988 00000004:00200000:3.0:1762167007.365940:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167007.365957:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a931 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.365982:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a92a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb389d expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.366000:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a931 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb389d expref: 891 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.366008:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:3.0:1762167007.366011:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167007.366015:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167007.366063:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451848704:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 340us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.366070:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19785 00000100:00100000:0.0:1762167007.368348:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.368419:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451848960 00000100:00100000:3.0:1762167007.368430:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451848960 00000100:00100000:3.0:1762167007.368487:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19786 00000100:00100000:3.0:1762167007.368498:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451848960:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:3.0:1762167007.368609:0:30818:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762167007.368639:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a931 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb389d expref: 891 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.368664:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a91c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb388f expref: 890 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.368675:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:3.0:1762167007.368691:0:30818:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167007.369005:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.369020:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.369029:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000001:00080000:3.0:1762167007.369087:0:30818:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952886 00000004:00010000:3.0:1762167007.369114:0:30818:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a743816e reply state 00000000a7f3d0ac transno 8589952887 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167007.369123:0:30818:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167007.369211:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451848960:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 714us (870us total) trans 8589952887 rc 0/0 00000100:00100000:3.0:1762167007.369218:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19786 00000020:00080000:3.0:1762167007.369224:0:30818:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167007.370132:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.370143:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.370150:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.370156:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167007.370160:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.370166:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.370179:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:0.0:1762167007.370182:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167007.370186:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.370191:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0a938 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167007.370503:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.370576:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451849088 00000100:00100000:3.0:1762167007.370584:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451849088 00000100:00100000:3.0:1762167007.370670:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19787 00000100:00100000:3.0:1762167007.370679:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451849088:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167007.370696:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.370713:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0a93f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38a4 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.370753:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0a93f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38a4 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.370797:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0a93f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38a4 expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.370817:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:3.0:1762167007.370820:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167007.370824:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167007.370868:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451849088:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 190us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.370875:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19787 00000100:00100000:2.0:1762167007.373067:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.373107:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.373144:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451849216 00000100:00100000:2.0:1762167007.373146:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.373155:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451849216 00000100:00100000:1.0:1762167007.373176:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451849344 00000100:00100000:1.0:1762167007.373182:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451849344 00002000:00010000:3.0:1762167007.373193:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (44628->18446744073709551615) 00002000:00100000:3.0:1762167007.373199:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24785bb80 with x1847765451849216 ext(44628->18446744073709551615) 00002000:00010000:1.0:1762167007.373204:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167007.373210:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24785ad80 with x1847765451849344 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167007.373211:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24785bb80. 00002000:00010000:1.0:1762167007.373221:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24785ad80. 00000100:00100000:3.0:1762167007.373241:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451849472 00000100:00100000:3.0:1762167007.373245:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451849472 00002000:00010000:3.0:1762167007.373256:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167007.373259:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d2680 with x1847765451849472 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167007.373265:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d2680. 00000100:00100000:1.0:1762167007.373273:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2885 00000100:00100000:1.0:1762167007.373288:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451849216:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167007.373289:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2886 00000100:00100000:3.0:1762167007.373302:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2887 00000100:00100000:0.0:1762167007.373307:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451849344:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167007.373316:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451849472:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:0.0:1762167007.373570:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.373574:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.373577:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.373580:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.373583:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167007.373651:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451849344:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 349us (541us total) trans 17179875765 rc 0/0 00000100:00100000:0.0:1762167007.373661:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2886 00002000:00010000:3.0:1762167007.373662:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.373665:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:3.0:1762167007.373667:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00100000:0.0:1762167007.373670:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24785ad80 with x1847765451849344 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167007.373673:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.373678:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.373679:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24785ad80. 00002000:00010000:3.0:1762167007.373682:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167007.373694:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 122986 -> 44628 00002000:00010000:1.0:1762167007.373698:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.373700:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.373702:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.373704:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 79 00000100:00100000:3.0:1762167007.373715:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451849472:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 404us (568us total) trans 21474843308 rc 0/0 00000100:00100000:3.0:1762167007.373723:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2887 00002000:00010000:3.0:1762167007.373726:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:1.0:1762167007.373731:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451849216:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 448us (670us total) trans 21474843309 rc 0/0 00002000:00100000:3.0:1762167007.373732:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d2680 with x1847765451849472 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167007.373742:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d2680. 00000100:00100000:1.0:1762167007.373745:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2885 00002000:00010000:1.0:1762167007.373751:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (44628->18446744073709551615) 00002000:00100000:1.0:1762167007.373754:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24785bb80 with x1847765451849216 ext(44628->18446744073709551615) 00002000:00010000:1.0:1762167007.373788:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24785bb80. 00000100:00100000:0.0:1762167007.375535:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.375581:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451849600 00000100:00100000:3.0:1762167007.375589:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451849600 00000100:00100000:3.0:1762167007.375644:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19788 00000100:00100000:3.0:1762167007.375653:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451849600:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167007.375674:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.375693:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a946 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38ab expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.375814:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.375830:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.375841:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167007.375872:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:3.0:1762167007.375876:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167007.375895:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.375922:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a946 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ab expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.375941:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ab expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.375949:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:3.0:1762167007.375952:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167007.375955:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:3.0:1762167007.376016:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451849600:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 364us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.376024:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19788 00000100:00100000:2.0:1762167007.378088:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.378157:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451849856 00000100:00100000:0.0:1762167007.378169:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451849856 00000100:00100000:0.0:1762167007.378221:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7337 00000100:00100000:0.0:1762167007.378233:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451849856:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167007.378553:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451849856:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 322us (470us total) trans 8589952888 rc 0/0 00000100:00100000:0.0:1762167007.378562:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7337 00000100:00100000:2.0:1762167007.387952:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.388014:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451849984 00000100:00100000:3.0:1762167007.388026:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451849984 00000100:00100000:3.0:1762167007.388081:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19789 00000100:00100000:3.0:1762167007.388090:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56205:x1847765451849984:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.388112:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.388129:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a954 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38b2 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.388196:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a95b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388210:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a95b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388219:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a95b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388230:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a962 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388234:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a962 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388238:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a962 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388340:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a969 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388347:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a969 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388353:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a969 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:3.0:1762167007.388409:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:3.0:1762167007.388414:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167007.388432:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a969 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388444:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a969 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388452:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a95b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388463:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a95b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388470:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a95b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388475:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167007.388479:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a95b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388490:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a95b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388502:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167007.388506:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167007.388510:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a95b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388516:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0a95b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388530:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a962 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388537:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a962 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388542:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a962 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388546:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167007.388549:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a962 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388554:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a962 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388560:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23300) 00010000:00010000:3.0:1762167007.388563:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167007.388565:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a962 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388585:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0a962 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167007.388623:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0a954 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b2 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.388635:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a969 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b2 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.388642:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:3.0:1762167007.388644:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167007.388646:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922a00, rc 0) 00000100:00100000:3.0:1762167007.388709:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56205:x1847765451849984:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 620us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.388717:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19789 00000100:00100000:3.0:1762167007.390956:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.391131:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451850112 00000100:00100000:0.0:1762167007.391149:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451850112 00000100:00100000:3.0:1762167007.391180:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.391238:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451850368 00000100:00100000:2.0:1762167007.391248:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451850368 00000100:00100000:0.0:1762167007.391256:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 646 00000100:00100000:0.0:1762167007.391272:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2358:x1847765451850112:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.391295:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.391327:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0a969 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b2 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.391338:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19790 00010000:00010000:0.0:1762167007.391351:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00000100:00100000:2.0:1762167007.391353:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56205:x1847765451850368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.391360:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.391374:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.391407:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a970 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38b9 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.391458:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2358:x1847765451850112:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 188us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.391470:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 646 00010000:00010000:2.0:1762167007.391518:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.391535:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ab expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.391544:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.391577:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ab expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.391589:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ab expref: 895 pid: 30818 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.391602:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454451712:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.391678:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36dc36900 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.392971:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454451712:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167007.392996:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167007.393453:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.393537:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451850496 00000100:00100000:0.0:1762167007.393544:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451850496 00010000:00010000:0.0:1762167007.393581:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ab expref: 896 pid: 30818 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.393623:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7480 00000100:00100000:0.0:1762167007.393633:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451850496:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.393648:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.393654:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ab expref: 896 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.393666:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ab expref: 896 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.393689:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0a94d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ab expref: 896 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.393704:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:0.0:1762167007.393709:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.393719:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.393725:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.393754:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.393791:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.393800:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167007.393818:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000100:00100000:0.0:1762167007.393846:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451850496:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 211us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.393867:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7480 00010000:00010000:2.0:1762167007.393955:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a970 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b9 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.393970:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b9 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.393977:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.393981:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167007.393983:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167007.394031:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56205:x1847765451850368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2681us (2851us total) trans 8589952889 rc 0/0 00000100:00100000:2.0:1762167007.394039:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19790 00000100:00100000:3.0:1762167007.395490:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.395543:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451850624 00000100:00100000:2.0:1762167007.395551:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451850624 00000100:00100000:2.0:1762167007.395597:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19791 00000100:00100000:2.0:1762167007.395606:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56205:x1847765451850624:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.395626:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.395643:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a985 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38c0 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.395721:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.395734:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b9 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.395747:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.395807:0:30818:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b9 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.395821:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b9 expref: 896 pid: 30818 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.395834:0:30818:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454451840:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.395906:0:30818:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.397189:0:30818:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30818:1847765454451840:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167007.397196:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167007.397214:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167007.397246:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451850752 00000100:00100000:0.0:1762167007.397253:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451850752 00010000:00010000:0.0:1762167007.397287:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b9 expref: 897 pid: 30818 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.397320:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7481 00000100:00100000:0.0:1762167007.397329:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451850752:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.397342:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.397349:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b9 expref: 897 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.397364:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b9 expref: 897 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.397396:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0a977 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38b9 expref: 897 pid: 30818 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.397411:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:0.0:1762167007.397416:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.397425:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.397432:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167007.397457:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.397483:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.397493:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:0.0:1762167007.397502:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451850752:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.397511:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7481 00000004:00200000:2.0:1762167007.397528:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:2.0:1762167007.397534:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167007.397551:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167007.397578:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a985 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38c0 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.397596:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38c0 expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.397603:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.397606:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167007.397609:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167007.397647:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56205:x1847765451850624:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2042us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.397654:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19791 00000100:00100000:3.0:1762167007.399617:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.399700:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451851008 00000100:00100000:2.0:1762167007.399717:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451851008 00000100:00100000:0.0:1762167007.399916:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19792 00000100:00100000:0.0:1762167007.399935:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56205:x1847765451851008:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.399956:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.399976:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a993 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38c7 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.400031:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765454451968:0@lo:400:kworker.0 00000100:00100000:2.0:1762167007.400065:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765454452224:0@lo:400:kworker.0 00010000:00010000:0.0:1762167007.400072:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a99a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167007.400086:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167007.400092:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a99a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167007.400103:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167007.400106:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a99a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167007.400121:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000100:00100000:2.0:1762167007.400137:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762167007.400141:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454452480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762167007.400147:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765454452352:0@lo:400:kworker.0 00000100:00100000:1.0:1762167007.400181:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.400192:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.400208:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762167007.400217:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765454452096:0@lo:400:kworker.0 00000100:00100000:2.0:1762167007.400234:0:33893:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454452224 00000100:00100000:2.0:1762167007.400240:0:33893:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454452224 00000100:00100000:1.0:1762167007.400256:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167007.400275:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0a993 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38c7 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.400288:0:33893:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454452352 00000100:00100000:2.0:1762167007.400293:0:33893:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454452352 00000100:00100000:1.0:1762167007.400294:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454451968 00010000:00010000:0.0:1762167007.400299:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a99a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38c7 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.400300:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454451968 00000100:00100000:3.0:1762167007.400305:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454452096 00000100:00100000:3.0:1762167007.400310:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454452096 00010000:00010000:0.0:1762167007.400312:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00000100:00100000:2.0:1762167007.400314:0:33893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00010000:00010000:0.0:1762167007.400319:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167007.400324:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9000, rc 0) 00000100:00100000:2.0:1762167007.400327:0:33893:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765454452224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762167007.400339:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1762167007.400351:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765454452352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762167007.400352:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1762167007.400361:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3293:x1847765454451968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762167007.400377:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56205:x1847765451851008:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 447us (766us total) trans 8589952890 rc 0/0 00000100:00100000:2.0:1762167007.400392:0:33893:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765454452224:12345-0@lo:400:kworker.0 Request processed in 54us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.400401:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19792 00000100:00100000:2.0:1762167007.400409:0:33893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1762167007.400411:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765454452352:12345-0@lo:400:kworker.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.400411:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3293:x1847765454451968:12345-0@lo:400:kworker.0 Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.400422:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1762167007.400422:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1762167007.400429:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1762167007.400441:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765454452096:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1762167007.400449:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762167007.400458:0:34176:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454452480 00000100:00100000:1.0:1762167007.400462:0:34176:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454452480 00000100:00100000:3.0:1762167007.400483:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765454452352:0@lo:400:kworker.0 00000100:00100000:1.0:1762167007.400491:0:34176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1762167007.400494:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454452608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762167007.400502:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765454452224:0@lo:400:kworker.0 00000100:00100000:1.0:1762167007.400502:0:34176:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765454452480:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762167007.400508:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1847765454452096:12345-0@lo:400:kworker.0 Request processed in 68us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.400518:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00002000:00000024:1.0:1762167007.400519:0:34176:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 271253504 pending 0 free 3855613952 avail 3852468224 00000100:00100000:2.0:1762167007.400529:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.400570:0:34176:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1847765454452480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.400576:0:6536:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454452608 00000100:00100000:1.0:1762167007.400581:0:34176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1762167007.400583:0:6536:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454452608 00000100:00100000:0.0:1762167007.400588:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1847765454452096:0@lo:400:kworker.0 00000100:00100000:0.0:1762167007.400604:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843304 gen 2 00000004:00080000:0.0:1762167007.400610:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247858700, transno 21474843269 00000100:00100000:1.0:1762167007.400621:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000004:00080000:0.0:1762167007.400625:0:3293:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843273 committed transno 21474843304 00000100:00100000:1.0:1762167007.400632:0:6537:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454452608:12345-0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1762167007.400644:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243304000, transno 21474843274 00002000:00000024:1.0:1762167007.400646:0:6537:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 167182336 pending 0 free 3855613952 avail 3851419648 00000004:00080000:0.0:1762167007.400652:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243307b80, transno 21474843275 00000004:00080000:0.0:1762167007.400656:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243305500, transno 21474843276 00000004:00080000:0.0:1762167007.400659:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de00a80, transno 21474843277 00000004:00080000:0.0:1762167007.400663:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242520700, transno 21474843278 00000004:00080000:0.0:1762167007.400665:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243305180, transno 21474843279 00000004:00080000:0.0:1762167007.400668:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03480, transno 21474843280 00000004:00080000:0.0:1762167007.400672:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de01f80, transno 21474843281 00000004:00080000:0.0:1762167007.400676:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d2300, transno 21474843282 00000004:00080000:0.0:1762167007.400681:0:3293:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843294 committed transno 21474843304 00000004:00080000:0.0:1762167007.400697:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce4700, transno 21474843295 00000004:00080000:0.0:1762167007.400702:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb7100, transno 21474843296 00000004:00080000:0.0:1762167007.400705:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc30700, transno 21474843297 00000100:00100000:1.0:1762167007.400708:0:6537:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454452608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000004:00080000:0.0:1762167007.400710:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb5500, transno 21474843298 00000004:00080000:0.0:1762167007.400715:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb5880, transno 21474843299 00000100:00100000:1.0:1762167007.400721:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000004:00080000:0.0:1762167007.400721:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb6680, transno 21474843300 00000004:00080000:0.0:1762167007.400728:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce6a00, transno 21474843301 00000004:00080000:0.0:1762167007.400732:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb5180, transno 21474843302 00000004:00080000:0.0:1762167007.400742:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c3480, transno 21474843303 00000004:00080000:0.0:1762167007.400747:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c3100, transno 21474843304 00000100:00100000:2.0:1762167007.400752:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454452608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762167007.400782:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454452480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762167007.400801:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1807908-b95d-4027-b65a-753b7d69e554:3293:1847765454451968:0@lo:400:kworker.0 00000004:00080000:3.0:1762167007.401036:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 18 done 00000100:00100000:3.0:1762167007.403306:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.403349:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.403397:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451851136 00000100:00100000:2.0:1762167007.403408:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451851136 00000100:00100000:0.0:1762167007.403419:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451851264 00000100:00100000:0.0:1762167007.403425:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451851264 00000100:00100000:2.0:1762167007.403479:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16829 00000100:00100000:2.0:1762167007.403490:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451851136:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167007.403533:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.403534:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167007.403553:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a923 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3896 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.403562:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167007.403565:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1762167007.403568:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16830 00010000:00010000:2.0:1762167007.403570:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.403580:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451851264:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762167007.403605:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.403611:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a923 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3896 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.403623:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.403630:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a923 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3896 expref: 21 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.403633:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.403636:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.403640:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.403650:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454452736:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.403665:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.403675:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 28 pid: 33892 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.403686:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e472d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454452864:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.403746:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee381855180 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.403888:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451851392 00000100:00100000:0.0:1762167007.403893:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f4e73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.403894:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451851392 00000100:00100000:1.0:1762167007.403924:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16831 00000100:00100000:1.0:1762167007.403932:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451851392:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167007.403951:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.403974:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.403985:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167007.403988:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167007.403990:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.404012:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.404021:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 22 pid: 33892 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.404031:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454452992:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167007.404066:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e0d2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.405274:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454452736:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167007.405295:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e472d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454452864:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167007.405299:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.405314:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.405546:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454452992:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167007.405565:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.405587:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.405621:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.405651:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451851648 00000100:00100000:0.0:1762167007.405659:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451851648 00000100:00100000:3.0:1762167007.405672:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167007.405697:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 29 pid: 33892 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.405740:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451851776 00000100:00100000:1.0:1762167007.405751:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451851776 00000100:00100000:0.0:1762167007.405755:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451851520 00000100:00100000:3.0:1762167007.405814:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7482 00000100:00100000:0.0:1762167007.405815:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451851520 00000100:00100000:3.0:1762167007.405839:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451851648:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.405839:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 24 pid: 33892 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.405849:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a923 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3896 expref: 24 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.405869:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762167007.405885:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7483 00000100:00100000:1.0:1762167007.405895:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451851776:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.405907:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167007.405910:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 29 pid: 33892 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.405920:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7484 00010000:00010000:1.0:1762167007.405928:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 24 pid: 33892 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.405948:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451851520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.405970:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 24 pid: 33892 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.405977:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 29 pid: 33892 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.405982:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.406014:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a843 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb382d expref: 24 pid: 33892 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.406017:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0a83c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3826 expref: 29 pid: 33892 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.406018:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a923 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3896 expref: 24 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.406052:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.406057:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.406067:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.406075:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.406078:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.406080:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.406081:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a923 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3896 expref: 23 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:3.0:1762167007.406087:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.406131:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.406150:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.406156:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0a923 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3896 expref: 23 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.406168:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406175:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.406180:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.406181:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406186:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406199:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.406205:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.406215:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.406216:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451851776:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 320us (589us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167007.406234:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167007.406238:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451851648:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 404us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.406248:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7483 00010000:00010000:2.0:1762167007.406265:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.406268:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7482 00010000:00010000:2.0:1762167007.406283:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.406285:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451851520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 344us (608us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167007.406297:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.406305:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a800 already unused, calling callback (ffffffffc1709320) 00000100:00100000:0.0:1762167007.406310:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7484 00010000:00010000:2.0:1762167007.406320:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.406326:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406366:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.406398:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406401:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.406414:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.406429:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.406458:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.406479:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0a9b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.406486:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406496:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.406499:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.406507:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406516:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.406526:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406531:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.406552:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406558:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc1709320) 00000100:00100000:2.0:1762167007.406562:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451851392:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2625us (3024us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167007.406564:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.406592:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16831 00010000:00010000:0.0:1762167007.406602:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.406609:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0a9af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406638:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.406650:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0a9a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.406713:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451851264:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3130us (3356us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.406715:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451851136:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3220us (3410us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.406726:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16830 00000100:00100000:0.0:1762167007.406743:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16829 00000100:00100000:3.0:1762167007.408118:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.408183:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451852032 00000100:00100000:0.0:1762167007.408195:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451852032 00000100:00100000:0.0:1762167007.408257:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19793 00000100:00100000:0.0:1762167007.408267:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56205:x1847765451852032:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167007.408317:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167007.408340:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0a98c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38c0 expref: 897 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.408359:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0a93f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38a4 expref: 896 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.408370:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:0.0:1762167007.408375:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.408419:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167007.408432:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167007.408441:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000040:00080000:0.0:1762167007.409062:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5422, 88 off437496 00000004:00080000:0.0:1762167007.409070:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628201306877ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.409151:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5430, 88 off438552 00000004:00080000:0.0:1762167007.409156:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628201393466ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.409191:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5431, 88 off438640 00000004:00080000:0.0:1762167007.409197:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628201433937ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.409229:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5423, 88 off437584 00000004:00080000:0.0:1762167007.409235:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628201472316ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.409300:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5432, 88 off438728 00000004:00080000:0.0:1762167007.409307:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628201544090ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.409342:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5424, 88 off437672 00000004:00080000:0.0:1762167007.409346:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628201583696ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.409361:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5425, 88 off437760 00000004:00080000:0.0:1762167007.409365:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628201602268ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.409395:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5433, 88 off438816 00000004:00080000:0.0:1762167007.409399:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628201636506ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.409427:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5434, 88 off438904 00000004:00080000:0.0:1762167007.409433:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628201670407ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.409464:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5426, 88 off437848 00000004:00080000:0.0:1762167007.409468:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628201705495ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.409486:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5435, 88 off438992 00000004:00080000:0.0:1762167007.409490:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628201727157ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.409525:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5427, 88 off437936 00000004:00080000:0.0:1762167007.409530:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628201766790ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.409546:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5428, 88 off438024 00000004:00080000:0.0:1762167007.409550:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628201787006ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.409564:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5436, 88 off439080 00000004:00080000:0.0:1762167007.409567:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628201804356ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.409593:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5437, 88 off439168 00000004:00080000:0.0:1762167007.409598:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628201835436ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.409615:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5429, 88 off438112 00000004:00080000:0.0:1762167007.409618:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628201855765ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.409632:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5430, 88 off438200 00000004:00080000:0.0:1762167007.409636:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628201873320ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.409652:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5438, 88 off439256 00000004:00080000:0.0:1762167007.409656:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628201893698ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.409697:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5439, 88 off439344 00000004:00080000:0.0:1762167007.409703:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628201939652ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.409730:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5431, 88 off438288 00000004:00080000:0.0:1762167007.409735:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628201972163ns, next at 628532618837ns, rc = 0 00000001:00080000:2.0:1762167007.422665:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952891 is committed 00000004:00010000:3.0:1762167007.422666:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000776089f7 reply state 00000000cd5ccf6c transno 8589952891 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00080000:2.0:1762167007.422678:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3539 committed 00000100:00100000:3.0:1762167007.422682:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:2.0:1762167007.422696:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3552 committed 00000004:00080000:2.0:1762167007.422710:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3551 committed 00000004:00080000:2.0:1762167007.422714:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3538 committed 00000004:00080000:2.0:1762167007.422717:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3537 committed 00000004:00080000:2.0:1762167007.422724:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3550 committed 00000004:00080000:2.0:1762167007.422727:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3549 committed 00000004:00080000:2.0:1762167007.422737:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3536 committed 00000004:00080000:2.0:1762167007.422744:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3535 committed 00000004:00080000:2.0:1762167007.422747:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3548 committed 00000004:00080000:2.0:1762167007.422750:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3534 committed 00000004:00080000:2.0:1762167007.422754:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3547 committed 00000004:00080000:2.0:1762167007.422757:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3546 committed 00000004:00080000:2.0:1762167007.422787:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3533 committed 00000004:00080000:2.0:1762167007.422792:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3532 committed 00000004:00080000:2.0:1762167007.422796:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3545 committed 00000004:00080000:2.0:1762167007.422799:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3531 committed 00000004:00080000:2.0:1762167007.422802:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3544 committed 00000004:00080000:2.0:1762167007.422806:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3543 committed 00000004:00080000:2.0:1762167007.422811:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3530 committed 00010000:00080000:3.0:1762167007.422822:0:30817:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000020:00080000:2.0:1762167007.422840:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969184 batchid updated 00000100:00100000:3.0:1762167007.422843:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56205:x1847765451852032:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 14573us (14728us total) trans 8589952891 rc 0/0 00000100:00100000:3.0:1762167007.422854:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19793 00000100:00100000:1.0:1762167007.422913:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454453120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.422953:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454453248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.422971:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.423000:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454453504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.423024:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454453632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.423029:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.423058:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.423064:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454454016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.423082:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454454144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.423092:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.423113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.423117:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454454528:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762167007.423127:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167007.423138:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167007.423147:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454453760:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762167007.423147:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167007.423151:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762167007.423160:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc2129310) 00000100:00100000:2.0:1762167007.423162:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454453120 00010000:00010000:1.0:1762167007.423165:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167007.423169:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454455040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.423171:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454453120 00000100:00100000:3.0:1762167007.423173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762167007.423181:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167007.423196:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454454272:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762167007.423198:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:1.0:1762167007.423203:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1762167007.423204:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762167007.423211:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167007.423218:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0a9bd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167007.423232:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454453504 00000100:00100000:2.0:1762167007.423235:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454453632 00000100:00100000:3.0:1762167007.423238:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454453504 00000100:00100000:2.0:1762167007.423241:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454453632 00000020:00080000:1.0:1762167007.423246:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969184 00000100:00100000:0.0:1762167007.423246:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1762167007.423255:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454453376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.423267:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454454016 00000100:00100000:2.0:1762167007.423270:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454453248 00000100:00100000:3.0:1762167007.423271:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454454016 00000100:00100000:2.0:1762167007.423275:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454453248 00000100:00100000:0.0:1762167007.423284:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.423292:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454454528 00000100:00100000:3.0:1762167007.423295:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454454528 00000100:00100000:0.0:1762167007.423298:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454453888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.423301:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454453760 00000100:00100000:2.0:1762167007.423307:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454453760 00000100:00100000:3.0:1762167007.423315:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454455040 00000100:00100000:0.0:1762167007.423318:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.423319:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454455040 00000100:00100000:2.0:1762167007.423331:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454453376 00000100:00100000:0.0:1762167007.423335:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454454400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.423336:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454453376 00000100:00100000:3.0:1762167007.423341:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454453888 00000100:00100000:3.0:1762167007.423345:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454453888 00000100:00100000:0.0:1762167007.423363:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.423367:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454454400 00000100:00100000:2.0:1762167007.423371:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16832 00000100:00100000:3.0:1762167007.423372:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454454400 00000100:00100000:0.0:1762167007.423375:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454454912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.423398:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454453120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.423408:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16833 00000100:00100000:0.0:1762167007.423412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.423417:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454453504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.423436:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454454912 00000100:00100000:0.0:1762167007.423439:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454454912 00000100:00100000:0.0:1762167007.423463:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16834 00000100:00100000:0.0:1762167007.423471:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454453632:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1762167007.423547:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969184 cancel update log [0x200000bd0:0x1:0x0].52: rc = 0 00000020:00080000:1.0:1762167007.423560:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969184 00000100:00100000:1.0:1762167007.423576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.423604:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454454656:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167007.423628:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.423632:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.423636:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00000100:00100000:3.0:1762167007.423639:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454453504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (610us total) trans 17179875766 rc 0/0 00002000:00010000:0.0:1762167007.423639:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.423642:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167007.423648:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16833 00000100:00100000:2.0:1762167007.423649:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454453120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (676us total) trans 21474843310 rc 0/0 00000100:00100000:2.0:1762167007.423661:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16832 00000100:00100000:1.0:1762167007.423662:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.423664:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454454144 00000100:00100000:3.0:1762167007.423669:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454454144 00000100:00100000:0.0:1762167007.423676:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454453632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (618us total) trans 21474843311 rc 0/0 00000100:00100000:0.0:1762167007.423684:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16834 00000100:00100000:3.0:1762167007.423688:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454454656 00000100:00100000:3.0:1762167007.423691:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454454656 00000100:00100000:2.0:1762167007.423694:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16835 00000100:00100000:0.0:1762167007.423701:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16836 00000100:00100000:2.0:1762167007.423706:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454454016:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167007.423707:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2438b8e00/2, rc 0, transno 21474843310 00000100:00100000:0.0:1762167007.423714:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454453248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.423717:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16837 00000100:00100000:1.0:1762167007.423720:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454453120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.423728:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454454528:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167007.423733:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348254700/2, rc 0, transno 21474843311 00000100:00100000:1.0:1762167007.423739:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454453632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.423831:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454455168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.423857:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.423874:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762167007.423882:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454455296:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167007.423888:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.423892:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167007.423895:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762167007.423898:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167007.423900:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167007.423901:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.423906:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00000100:00100000:1.0:1762167007.423911:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167007.423912:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167007.423916:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.423919:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167007.423937:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454453248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (821us total) trans 17179875767 rc 0/0 00000100:00100000:1.0:1762167007.423941:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454455168 00000100:00100000:1.0:1762167007.423945:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454455168 00000100:00100000:0.0:1762167007.423946:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16836 00000100:00100000:0.0:1762167007.423966:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454455296 00000100:00100000:0.0:1762167007.423970:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454455296 00000100:00100000:1.0:1762167007.423974:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16838 00000100:00100000:2.0:1762167007.423975:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454454016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 270us (880us total) trans 21474843312 rc 0/0 00002000:00010000:3.0:1762167007.423983:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167007.423983:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454453760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.423986:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16835 00002000:00010000:3.0:1762167007.423990:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.423994:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167007.423997:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.423999:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167007.424004:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16839 00000100:00100000:2.0:1762167007.424012:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16840 00000100:00100000:0.0:1762167007.424017:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454455040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.424026:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454453376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.424034:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454454528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 307us (881us total) trans 17179875768 rc 0/0 00000100:00100000:3.0:1762167007.424040:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16837 00000100:00100000:3.0:1762167007.424056:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16841 00000100:00100000:3.0:1762167007.424064:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454453888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167007.424146:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 205925 -> 205925 00002000:00010000:0.0:1762167007.424149:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.424152:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.424155:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:1.0:1762167007.424158:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454453760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (985us total) trans 21474843313 rc 0/0 00002000:00010000:0.0:1762167007.424159:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167007.424170:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16838 00000100:00100000:1.0:1762167007.424188:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16842 00000100:00100000:1.0:1762167007.424197:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454454400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.424206:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454453376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (921us total) trans 21474843314 rc 0/0 00000100:00100000:0.0:1762167007.424212:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454455040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (1007us total) trans 17179875769 rc 0/0 00000100:00100000:2.0:1762167007.424225:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16840 00000100:00100000:0.0:1762167007.424233:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16839 00000100:00100000:2.0:1762167007.424252:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16843 00000100:00100000:0.0:1762167007.424259:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16844 00000100:00100000:2.0:1762167007.424264:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454454912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167007.424268:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167007.424270:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454454144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167007.424271:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.424274:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167007.424276:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.424279:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167007.424312:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454453888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (993us total) trans 21474843315 rc 0/0 00000100:00100000:3.0:1762167007.424319:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16841 00000100:00100000:3.0:1762167007.424335:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16845 00000100:00100000:3.0:1762167007.424344:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454454656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.424355:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454454400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (991us total) trans 17179875770 rc 0/0 00000100:00100000:1.0:1762167007.424363:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16842 00000100:00100000:1.0:1762167007.424398:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16846 00000100:00100000:1.0:1762167007.424409:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454455168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167007.424424:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.424429:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167007.424432:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167007.424434:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.424437:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167007.424466:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454454144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (888us total) trans 21474843316 rc 0/0 00002000:00010000:3.0:1762167007.424467:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 154055 -> 154055 00002000:00010000:3.0:1762167007.424470:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.424473:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167007.424474:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16844 00002000:00010000:3.0:1762167007.424476:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167007.424479:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454454912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (1063us total) trans 17179875771 rc 0/0 00002000:00010000:3.0:1762167007.424480:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167007.424489:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16847 00000100:00100000:0.0:1762167007.424497:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454455296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.424503:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16843 00000100:00100000:3.0:1762167007.424515:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454454656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (855us total) trans 17179875772 rc 0/0 00000100:00100000:3.0:1762167007.424522:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16845 00002000:00010000:1.0:1762167007.424552:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 26859 -> 26859 00002000:00010000:1.0:1762167007.424557:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.424560:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.424563:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.424565:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 67 -> 67 00000100:00100000:1.0:1762167007.424601:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454455168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (743us total) trans 21474843317 rc 0/0 00002000:00010000:0.0:1762167007.424603:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167007.424609:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16846 00002000:00010000:0.0:1762167007.424609:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.424615:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.424618:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.424621:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167007.424622:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000004:00080000:1.0:1762167007.424646:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc6300/2, rc 0, transno 21474843317 00000100:00100000:0.0:1762167007.424652:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454455296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (743us total) trans 21474843318 rc 0/0 00000100:00100000:1.0:1762167007.424653:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454455168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.424657:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.424666:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16847 00000004:00080000:1.0:1762167007.424677:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243181500/2, rc 0, transno 17179875772 00000100:00100000:0.0:1762167007.424684:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454454272 00000100:00100000:2.0:1762167007.424688:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451852160 00000100:00100000:0.0:1762167007.424689:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454454272 00000100:00100000:1.0:1762167007.424692:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454454656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.424696:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451852160 00000004:00080000:1.0:1762167007.424708:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348256680/2, rc 0, transno 21474843316 00000100:00100000:1.0:1762167007.424715:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454454144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.424723:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16848 00000100:00100000:3.0:1762167007.424729:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454454784:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167007.424732:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc5c00/2, rc 0, transno 21474843318 00000100:00100000:0.0:1762167007.424734:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454454272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.424739:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454455296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.424741:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19794 00000100:00100000:2.0:1762167007.424756:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56205:x1847765451852160:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:3.0:1762167007.424759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167007.424798:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1762167007.424817:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e472d80/2, rc 0, transno 17179875767 00000100:00100000:1.0:1762167007.424817:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454455424:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167007.424818:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a9c4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38ce expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.424833:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454453248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167007.424848:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348255f80/2, rc 0, transno 21474843313 00000100:00100000:1.0:1762167007.424853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.424857:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454453760:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167007.424858:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.424861:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.424864:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.424866:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167006 -> 1762167006 00010000:00010000:2.0:1762167007.424871:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ce expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167007.424871:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167007.424881:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454454784 00000100:00100000:3.0:1762167007.424886:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454454784 00010000:00010000:2.0:1762167007.424891:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ce expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.424904:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454455424 00000100:00100000:3.0:1762167007.424908:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454455424 00000100:00100000:0.0:1762167007.424910:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454454272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (254us total) trans 21474843319 rc 0/0 00010000:00010000:2.0:1762167007.424913:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.424920:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1762167007.424922:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16848 00010000:00010000:2.0:1762167007.424925:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:3.0:1762167007.424930:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16849 00000100:00100000:1.0:1762167007.424933:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762167007.424939:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454454784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.424949:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454455552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.424970:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56205:x1847765451852160:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 215us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.424978:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19794 00000100:00100000:1.0:1762167007.424992:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.425038:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454455552 00000100:00100000:1.0:1762167007.425042:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454455552 00000100:00100000:0.0:1762167007.425046:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16850 00000100:00100000:3.0:1762167007.425054:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3296:x1847765454454784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (297us total) trans 17179875773 rc 0/0 00000100:00100000:0.0:1762167007.425056:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454455424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.425061:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16849 00000100:00100000:1.0:1762167007.425069:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16851 00000100:00100000:1.0:1762167007.425079:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454455552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167007.425148:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:3.0:1762167007.425151:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348254e00/2, rc 0, transno 21474843319 00002000:00010000:0.0:1762167007.425151:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.425154:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:3.0:1762167007.425156:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454454272:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167007.425156:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.425159:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:3.0:1762167007.425166:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180380/2, rc 0, transno 17179875773 00000100:00100000:3.0:1762167007.425171:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454454784:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167007.425190:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 92573 -> 92573 00002000:00010000:1.0:1762167007.425194:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.425196:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.425198:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.425200:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:1.0:1762167007.425238:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3293:x1847765454455552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (249us total) trans 17179875775 rc 0/0 00000100:00100000:1.0:1762167007.425243:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16851 00000004:00080000:3.0:1762167007.425254:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348257100/2, rc 0, transno 21474843314 00000100:00100000:3.0:1762167007.425262:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454453376:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167007.425278:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348256d80/2, rc 0, transno 21474843315 00000100:00100000:3.0:1762167007.425283:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454453888:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167007.425286:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc6680/2, rc 0, transno 17179875775 00000100:00100000:2.0:1762167007.425294:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454455552:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167007.425302:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243181c00/2, rc 0, transno 17179875770 00000100:00100000:3.0:1762167007.425308:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454454400:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167007.425318:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243183480/2, rc 0, transno 17179875771 00000100:00100000:3.0:1762167007.425321:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454454912:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167007.425329:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24732ed80/2, rc 0, transno 17179875766 00000100:00100000:3.0:1762167007.425332:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454453504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167007.425341:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348254000/2, rc 0, transno 21474843312 00000100:00100000:3.0:1762167007.425344:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454454016:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167007.425352:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243183b80/2, rc 0, transno 17179875768 00000100:00100000:3.0:1762167007.425355:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454454528:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167007.425363:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243181880/2, rc 0, transno 17179875769 00000100:00100000:3.0:1762167007.425366:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454455040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.425483:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454455424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 429us (632us total) trans 17179875774 rc 0/0 00000100:00100000:0.0:1762167007.425491:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16850 00000004:00080000:2.0:1762167007.425533:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc6d80/2, rc 0, transno 17179875774 00000100:00100000:2.0:1762167007.425540:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454455424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.427236:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.427335:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451852288 00000100:00100000:2.0:1762167007.427346:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451852288 00000100:00100000:2.0:1762167007.427422:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19795 00000100:00100000:2.0:1762167007.427434:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56205:x1847765451852288:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.427452:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.427472:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9cb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38d5 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.427551:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a9d2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.427565:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.427576:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167007.427601:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:2.0:1762167007.427605:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167007.427620:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.427646:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9cb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38d5 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.427663:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38d5 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.427670:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.427674:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167007.427677:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167007.427738:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56205:x1847765451852288:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 306us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.427745:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19795 00000100:00100000:3.0:1762167007.429527:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.429555:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.429616:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451852416 00000100:00100000:0.0:1762167007.429624:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451852416 00000100:00100000:3.0:1762167007.429640:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.429658:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451852544 00000100:00100000:1.0:1762167007.429664:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451852544 00000100:00100000:0.0:1762167007.429675:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451852672 00000100:00100000:0.0:1762167007.429680:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451852672 00000100:00100000:3.0:1762167007.429690:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16852 00000100:00100000:2.0:1762167007.429701:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16853 00000100:00100000:3.0:1762167007.429706:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451852416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.429723:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167007.429730:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16854 00000100:00100000:2.0:1762167007.429737:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451852544:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.429741:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a9d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38dc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.429747:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451852672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.429753:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.429792:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a9e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38e3 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.429794:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1762167007.429807:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 44628, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x4f 00010000:00010000:1.0:1762167007.429811:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a9e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38ea expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167007.429815:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x3 00010000:00010000:3.0:1762167007.429825:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.429830:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.429834:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1762167007.429834:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x3 00010000:00010000:2.0:1762167007.429837:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.429848:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.429849:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38e3 expref: 28 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.429852:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38dc expref: 22 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.429852:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.429860:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a9e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ea expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.429880:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38e3 expref: 28 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.429884:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a9e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ea expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.429886:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38dc expref: 22 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.429920:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00010000:00010000:2.0:1762167007.429925:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00010000:00010000:1.0:1762167007.429925:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00000100:00100000:1.0:1762167007.429978:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451852672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 239us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.429981:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451852416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 279us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.429988:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451852544:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 268us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.429988:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16854 00000100:00100000:3.0:1762167007.429998:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16852 00000100:00100000:2.0:1762167007.430006:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16853 00000100:00100000:3.0:1762167007.457354:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.457422:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451852800 00000100:00100000:1.0:1762167007.457434:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451852800 00000100:00100000:1.0:1762167007.457513:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2888 00000100:00100000:1.0:1762167007.457525:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451852800:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167007.457565:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a9ee lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.457646:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.457649:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.457654:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a9ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.457669:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a9ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.459458:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a9ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.459475:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a9ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.459485:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a9ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.459496:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ae00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.459501:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a9ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.459510:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a9ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.459527:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a9ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.459534:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0a9ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.459598:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451852800:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2073us (2252us total) trans 0 rc 44628/44628 00000100:00100000:1.0:1762167007.459608:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2888 00000100:00100000:3.0:1762167007.461610:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.461662:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451852928 00000100:00100000:1.0:1762167007.461672:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451852928 00000100:00100000:1.0:1762167007.461733:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2889 00000100:00100000:1.0:1762167007.461742:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451852928:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167007.461811:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 154055, mtime: 0x690888de, atime: 0x690888d5, ctime: 0x690888de, blocks: 0x203 00010000:00010000:1.0:1762167007.461819:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a9f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.461832:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.461834:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.461840:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.461852:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167007.473003:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875774 is committed 00000001:00080000:1.0:1762167007.473024:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875765 is committed 00000001:00080000:1.0:1762167007.473037:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875776 is committed 00000001:00080000:1.0:1762167007.473044:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875775 is committed 00002000:00010000:2.0:1762167007.473201:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:2.0:1762167007.473213:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00010000:00010000:2.0:1762167007.473232:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.473245:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.473254:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a9f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.473262:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.473268:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a9f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.473277:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a9f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.473302:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a9f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.473309:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0a9f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.473472:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451852928:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 11724us (11860us total) trans 17179875776 rc 0/0 00000100:00100000:2.0:1762167007.473487:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2889 00000100:00100000:0.0:1762167007.475605:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.475683:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451853056 00000100:00100000:2.0:1762167007.475699:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451853056 00000100:00100000:2.0:1762167007.475828:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2890 00000100:00100000:2.0:1762167007.475846:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451853056:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167007.475922:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 154055, mtime: 0x690888de, atime: 0x690888db, ctime: 0x690888de, blocks: 0x203 00010000:00010000:2.0:1762167007.475944:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.475958:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.475960:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.475967:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.475981:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762167007.488442:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843319 is committed 00000001:00080000:2.0:1762167007.488477:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843309 is committed 00000001:00080000:2.0:1762167007.488484:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843320 is committed 00002000:00010000:1.0:1762167007.488508:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:1.0:1762167007.488513:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00010000:00010000:1.0:1762167007.488527:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.488539:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.488548:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.488556:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.488560:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.488568:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.488589:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.488601:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0a9fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.488693:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451853056:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 12850us (13095us total) trans 21474843320 rc 0/0 00000100:00100000:1.0:1762167007.488705:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2890 00000100:00100000:3.0:1762167007.491085:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.491133:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451853184 00000100:00100000:1.0:1762167007.491143:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451853184 00000100:00100000:1.0:1762167007.491214:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2891 00000100:00100000:1.0:1762167007.491226:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451853184:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762167007.491258:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.491275:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 24 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.491283:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167007.491285:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167007.491289:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.491322:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 24 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.491337:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 24 pid: 33894 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.491358:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454455680:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167007.491447:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.492506:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454455680:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167007.492521:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.492882:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.492945:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451853312 00000100:00100000:1.0:1762167007.492956:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451853312 00010000:00010000:1.0:1762167007.492990:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 25 pid: 33894 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.493028:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7485 00000100:00100000:1.0:1762167007.493039:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451853312:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.493056:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.493087:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 25 pid: 33894 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.493101:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 25 pid: 33894 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.493127:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0a197 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 65536->69631) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb358d expref: 25 pid: 33894 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.493144:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.493147:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.493152:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.493161:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.493200:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167007.493255:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451853312:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 216us (379us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167007.493256:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.493274:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7485 00010000:00010000:2.0:1762167007.493276:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167007.503578:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875777 is committed 00002000:00010000:2.0:1762167007.503613:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:2.0:1762167007.503618:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00010000:00010000:2.0:1762167007.503630:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.503638:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.503644:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.503649:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ae00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.503652:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.503658:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.503671:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.503675:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0aa03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.503804:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451853184:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 12575us (12722us total) trans 17179875777 rc 0/0 00000100:00100000:2.0:1762167007.503813:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2891 00000100:00100000:0.0:1762167007.505608:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.505659:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451853440 00000100:00100000:2.0:1762167007.505668:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451853440 00000100:00100000:2.0:1762167007.505728:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2892 00000100:00100000:2.0:1762167007.505738:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451853440:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167007.505798:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 154055, mtime: 0x690888de, atime: 0x690888dd, ctime: 0x690888de, blocks: 0x203 00010000:00010000:2.0:1762167007.505806:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.505819:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.505821:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.505827:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.505838:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167007.516315:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875778 is committed 00002000:00010000:1.0:1762167007.516353:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:1.0:1762167007.516359:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00010000:00010000:1.0:1762167007.516372:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.516398:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.516407:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.516414:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.516418:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.516426:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.516449:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa0a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.516457:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.516550:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451853440:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 10809us (10940us total) trans 17179875778 rc 0/0 00000100:00100000:1.0:1762167007.516560:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2892 00000100:00100000:3.0:1762167007.518724:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.518853:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451853568 00000100:00100000:1.0:1762167007.518864:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451853568 00000100:00100000:1.0:1762167007.518935:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2893 00000100:00100000:1.0:1762167007.518947:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451853568:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167007.518995:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 154055, mtime: 0x690888dd, atime: 0x690888dd, ctime: 0x690888de, blocks: 0x203 00010000:00010000:1.0:1762167007.519005:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.519018:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.519020:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.519026:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.519039:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762167007.529096:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843321 is committed 00002000:00010000:1.0:1762167007.529194:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167005 -> 1762167007 00002000:00010000:1.0:1762167007.529200:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00010000:00010000:1.0:1762167007.529214:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.529226:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.529234:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.529240:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.529245:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.529253:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.529271:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.529279:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.529369:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451853568:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 10418us (10646us total) trans 21474843321 rc 0/0 00000100:00100000:1.0:1762167007.529391:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2893 00000100:00100000:3.0:1762167007.531466:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.531523:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451853696 00000100:00100000:1.0:1762167007.531535:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451853696 00000100:00100000:1.0:1762167007.531617:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2894 00000100:00100000:1.0:1762167007.531628:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765451853696:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762167007.531665:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.531681:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a381 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb363c expref: 23 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.531689:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.531692:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.531695:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.531729:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a381 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb363c expref: 23 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.531742:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a381 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb363c expref: 23 pid: 12400 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1762167007.531755:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454455808:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167007.531853:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.533270:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454455808:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167007.533275:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167007.533295:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.533362:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451853824 00000100:00100000:2.0:1762167007.533368:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451853824 00010000:00010000:2.0:1762167007.533412:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a381 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb363c expref: 24 pid: 12400 timeout: 728 lvb_type: 1 00000100:00100000:2.0:1762167007.533447:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7486 00000100:00100000:2.0:1762167007.533456:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451853824:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.533469:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.533491:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a381 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb363c expref: 24 pid: 12400 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.533509:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a381 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb363c expref: 24 pid: 12400 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.533527:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0a381 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb363c expref: 24 pid: 12400 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.533538:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.533546:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.533549:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.533557:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.533587:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167007.533605:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.533613:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.533638:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451853824:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 181us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.533647:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7486 00000001:00080000:0.0:1762167007.545132:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875779 is committed 00002000:00010000:2.0:1762167007.545271:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:2.0:1762167007.545276:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00010000:00010000:2.0:1762167007.545287:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.545295:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.545301:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.545307:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.545310:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.545316:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.545329:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.545333:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0aa18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.545433:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451853696:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13802us (13969us total) trans 17179875779 rc 0/0 00000100:00100000:2.0:1762167007.545443:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2894 00000100:00100000:0.0:1762167007.548353:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.548457:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451853952 00000100:00100000:2.0:1762167007.548473:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451853952 00000100:00100000:2.0:1762167007.548557:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2895 00000100:00100000:2.0:1762167007.548568:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451853952:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:2.0:1762167007.548607:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.548623:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a6bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb377e expref: 19 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.548629:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.548631:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.548634:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.548664:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a6bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb377e expref: 19 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.548677:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a6bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb377e expref: 19 pid: 12400 timeout: 728 lvb_type: 1 00000100:00100000:2.0:1762167007.548691:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:14122:1847765454455936:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.548813:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347174a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.550513:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:14122:1847765454455936:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167007.550514:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167007.550548:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.550600:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451854080 00000100:00100000:1.0:1762167007.550610:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451854080 00010000:00010000:1.0:1762167007.550646:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a6bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb377e expref: 20 pid: 12400 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1762167007.550693:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7487 00000100:00100000:1.0:1762167007.550703:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451854080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.550720:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.550744:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a6bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb377e expref: 20 pid: 12400 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1762167007.550756:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a6bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb377e expref: 20 pid: 12400 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1762167007.550823:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0a6bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb377e expref: 20 pid: 12400 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1762167007.550838:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.550840:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.550845:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.550855:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.550889:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167007.550941:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451854080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 239us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.550960:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7487 00010000:00010000:2.0:1762167007.551042:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.551052:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762167007.564255:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843322 is committed 00002000:00010000:1.0:1762167007.564295:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 26859 -> 45056 00002000:00010000:1.0:1762167007.564301:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:1.0:1762167007.564304:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 67 -> 131 00010000:00010000:1.0:1762167007.564316:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.564327:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.564336:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.564343:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.564348:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.564356:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.564374:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.564394:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.564495:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451853952:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 15925us (16147us total) trans 21474843322 rc 0/0 00000100:00100000:1.0:1762167007.564507:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2895 00000100:00100000:3.0:1762167007.566679:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.566745:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451854208 00000100:00100000:1.0:1762167007.566755:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451854208 00000100:00100000:1.0:1762167007.566837:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2896 00000100:00100000:1.0:1762167007.566848:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451854208:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762167007.566883:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.566900:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb386c expref: 22 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.566908:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.566910:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.566913:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.566944:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb386c expref: 22 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.566957:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb386c expref: 22 pid: 33894 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1762167007.566971:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454456064:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167007.567034:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.567981:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454456064:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167007.568000:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.568484:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.568537:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451854336 00000100:00100000:0.0:1762167007.568542:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451854336 00010000:00010000:0.0:1762167007.568565:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb386c expref: 23 pid: 33894 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167007.568591:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7488 00000100:00100000:0.0:1762167007.568597:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451854336:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.568606:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.568624:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb386c expref: 23 pid: 33894 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167007.568632:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb386c expref: 23 pid: 33894 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167007.568648:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0a8eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb386c expref: 23 pid: 33894 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167007.568659:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.568660:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.568663:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.568670:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.568688:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167007.568718:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.568729:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.568736:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451854336:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 137us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.568749:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7488 00000001:00080000:3.0:1762167007.580240:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875780 is committed 00010000:00010000:2.0:1762167007.580319:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.580338:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.580352:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.580359:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.580364:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.580373:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.580400:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.580407:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0aa26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.580504:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451854208:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13653us (13827us total) trans 17179875780 rc 0/0 00000100:00100000:2.0:1762167007.580515:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2896 00000100:00100000:3.0:1762167007.588968:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.589039:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451854592 00000100:00100000:2.0:1762167007.589049:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451854592 00000100:00100000:2.0:1762167007.589113:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19796 00000100:00100000:2.0:1762167007.589124:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56205:x1847765451854592:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167007.589176:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.589205:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0a9d2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38d5 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.589228:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.589233:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.589593:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.589607:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.589620:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167007.589692:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952892 00000004:00010000:2.0:1762167007.589723:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ba8abece reply state 0000000011cc1b4a transno 8589952893 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.589733:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167007.589915:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56205:x1847765451854592:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 792us (956us total) trans 8589952893 rc 0/0 00000100:00100000:2.0:1762167007.589922:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19796 00000020:00080000:2.0:1762167007.589928:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167007.590979:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.590992:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.590999:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.591005:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.591010:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.591017:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.591030:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.591033:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167007.591037:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.591043:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa2d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167007.591129:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.591209:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451854720 00000100:00100000:2.0:1762167007.591216:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451854720 00000100:00100000:2.0:1762167007.591251:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16855 00000100:00100000:2.0:1762167007.591264:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56205:x1847765451854720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.591276:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.591293:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0aa34 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38f1 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167007.591316:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 154055, mtime: 0x690888df, atime: 0x690888d5, ctime: 0x690888df, blocks: 0x203 00010000:00010000:2.0:1762167007.591334:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.591336:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.591343:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0aa34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f1 expref: 22 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.591356:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0aa34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f1 expref: 22 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.591365:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167007.591421:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56205:x1847765451854720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 161us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.591430:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16855 00000100:00100000:0.0:1762167007.592322:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.592371:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451854848 00000100:00100000:2.0:1762167007.592377:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451854848 00002000:00010000:2.0:1762167007.592414:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (44628->18446744073709551615) 00002000:00100000:2.0:1762167007.592419:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348258380 with x1847765451854848 ext(44628->18446744073709551615) 00002000:00010000:2.0:1762167007.592427:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee348258380. 00000100:00100000:2.0:1762167007.592459:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2897 00000100:00100000:3.0:1762167007.592465:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.592473:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451854848:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167007.592489:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451854976 00000100:00100000:0.0:1762167007.592495:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451854976 00002000:00010000:0.0:1762167007.592514:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.592518:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc5bb80 with x1847765451854976 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.592526:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc5bb80. 00000100:00100000:0.0:1762167007.592550:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2898 00000100:00100000:0.0:1762167007.592560:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451854976:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167007.592872:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 154055 -> 44628 00002000:00010000:2.0:1762167007.592876:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.592879:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167007.592882:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.592884:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167007.592886:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.592891:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167007.592895:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167007.592897:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167007.592900:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167007.592928:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451854848:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 458us (606us total) trans 17179875781 rc 0/0 00000100:00100000:0.0:1762167007.592931:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451854976:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 371us (472us total) trans 21474843323 rc 0/0 00000100:00100000:2.0:1762167007.592942:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2897 00002000:00010000:2.0:1762167007.592946:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (44628->18446744073709551615) 00002000:00100000:2.0:1762167007.592949:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348258380 with x1847765451854848 ext(44628->18446744073709551615) 00000100:00100000:0.0:1762167007.592954:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2898 00002000:00010000:2.0:1762167007.592957:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee348258380. 00002000:00010000:0.0:1762167007.592960:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.592965:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc5bb80 with x1847765451854976 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.592972:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc5bb80. 00000100:00100000:0.0:1762167007.594122:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.594170:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451855104 00000100:00100000:2.0:1762167007.594176:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451855104 00000100:00100000:2.0:1762167007.594215:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19797 00000100:00100000:2.0:1762167007.594221:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56205:x1847765451855104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.594238:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.594250:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa3b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38f8 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.594308:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.594318:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.594325:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167007.594343:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:2.0:1762167007.594346:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167007.594357:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.594374:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa3b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f8 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.594398:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f8 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.594404:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.594406:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167007.594409:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167007.594441:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56205:x1847765451855104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 220us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.594445:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19797 00000100:00100000:3.0:1762167007.595976:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.596084:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451855360 00000100:00100000:2.0:1762167007.596092:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451855360 00000100:00100000:2.0:1762167007.596141:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19798 00000100:00100000:2.0:1762167007.596150:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56205:x1847765451855360:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167007.596196:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.596217:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aa42 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f8 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.596231:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.596235:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.596448:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.596465:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.596473:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167007.596529:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952894 00000004:00010000:2.0:1762167007.596556:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f779fe69 reply state 0000000003b3b7cc transno 8589952895 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.596565:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167007.596645:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56205:x1847765451855360:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 495us (673us total) trans 8589952895 rc 0/0 00000100:00100000:2.0:1762167007.596651:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19798 00000020:00080000:2.0:1762167007.596656:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167007.597669:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.597681:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.597688:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.597694:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167007.597698:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.597706:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.597718:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:1.0:1762167007.597721:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167007.597724:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.597730:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa49 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167007.597944:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.598012:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451855488 00000100:00100000:2.0:1762167007.598024:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451855488 00000100:00100000:2.0:1762167007.598064:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16856 00000100:00100000:2.0:1762167007.598073:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:56205:x1847765451855488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.598086:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.598102:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0aa50 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb38ff expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167007.598125:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 154055, mtime: 0x690888df, atime: 0x690888db, ctime: 0x690888df, blocks: 0x203 00010000:00010000:2.0:1762167007.598142:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.598145:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.598152:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0aa50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ff expref: 20 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.598166:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0aa50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ff expref: 20 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.598177:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00000100:00100000:2.0:1762167007.598221:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:56205:x1847765451855488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 148us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.598227:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16856 00000100:00100000:3.0:1762167007.599215:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.599265:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451855616 00000100:00100000:0.0:1762167007.599272:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451855616 00002000:00010000:0.0:1762167007.599299:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (44628->18446744073709551615) 00002000:00100000:0.0:1762167007.599304:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346a2ce00 with x1847765451855616 ext(44628->18446744073709551615) 00002000:00010000:0.0:1762167007.599324:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346a2ce00. 00000100:00100000:0.0:1762167007.599355:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2899 00000100:00100000:0.0:1762167007.599364:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451855616:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167007.599707:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 154055 -> 44628 00002000:00010000:0.0:1762167007.599712:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.599715:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167007.599718:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.599720:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167007.599731:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.599805:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451855744 00000100:00100000:0.0:1762167007.599806:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451855616:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 442us (591us total) trans 21474843324 rc 0/0 00000100:00100000:2.0:1762167007.599812:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451855744 00000100:00100000:0.0:1762167007.599818:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2899 00002000:00010000:0.0:1762167007.599823:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (44628->18446744073709551615) 00002000:00100000:0.0:1762167007.599826:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346a2ce00 with x1847765451855616 ext(44628->18446744073709551615) 00002000:00010000:2.0:1762167007.599830:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00010000:0.0:1762167007.599832:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346a2ce00. 00002000:00100000:2.0:1762167007.599837:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346a2f100 with x1847765451855744 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167007.599847:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee346a2f100. 00000100:00100000:2.0:1762167007.599869:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2900 00000100:00100000:2.0:1762167007.599878:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765451855744:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167007.600014:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.600018:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:2.0:1762167007.600022:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167007.600024:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00002000:00010000:2.0:1762167007.600026:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167007.600061:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451855744:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 183us (329us total) trans 17179875782 rc 0/0 00000100:00100000:2.0:1762167007.600068:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2900 00002000:00010000:2.0:1762167007.600072:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167007.600075:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346a2f100 with x1847765451855744 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167007.600080:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee346a2f100. 00000100:00100000:3.0:1762167007.601534:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.601605:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451855872 00000100:00100000:2.0:1762167007.601614:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451855872 00000100:00100000:2.0:1762167007.601657:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19799 00000100:00100000:2.0:1762167007.601663:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56205:x1847765451855872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.601678:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.601698:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0aa57 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3906 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.601815:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aa5e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.601827:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aa5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.601835:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aa5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167007.601856:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:2.0:1762167007.601859:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167007.601871:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aa5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.601894:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0aa57 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3906 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.601906:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aa5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3906 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.601914:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.601917:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167007.601920:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:2.0:1762167007.601978:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56205:x1847765451855872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 314us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.601986:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19799 00000100:00100000:3.0:1762167007.603873:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.603943:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451856128 00000100:00100000:2.0:1762167007.603954:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451856128 00000100:00100000:2.0:1762167007.604015:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19800 00000100:00100000:2.0:1762167007.604026:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56205:x1847765451856128:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167007.604067:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.604089:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aa5e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3906 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.604110:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.604114:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.604308:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.604320:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.604333:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167007.604393:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952896 00000004:00010000:2.0:1762167007.604418:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000527d3ec5 reply state 00000000e57c75fb transno 8589952897 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.604427:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167007.604516:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56205:x1847765451856128:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 492us (653us total) trans 8589952897 rc 0/0 00000100:00100000:2.0:1762167007.604524:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19800 00000020:00080000:2.0:1762167007.604530:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167007.605426:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.605438:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.605445:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.605450:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.605455:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.605461:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.605473:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.605477:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762167007.605484:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167007.605484:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.605497:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aa65 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167007.605556:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451856256 00000100:00100000:0.0:1762167007.605561:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451856256 00000100:00100000:0.0:1762167007.605592:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16857 00000100:00100000:0.0:1762167007.605598:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56205:x1847765451856256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.605607:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.605620:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0aa6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb390d expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167007.605636:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 154055, mtime: 0x690888df, atime: 0x690888db, ctime: 0x690888df, blocks: 0x203 00010000:00010000:0.0:1762167007.605648:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.605649:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.605654:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0aa6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb390d expref: 25 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.605663:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0aa6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb390d expref: 25 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.605676:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8c00, rc 0) 00000100:00100000:0.0:1762167007.605713:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56205:x1847765451856256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 113us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.605719:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16857 00000100:00100000:1.0:1762167007.606681:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.606722:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.606754:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451856384 00000100:00100000:2.0:1762167007.606786:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451856384 00000100:00100000:0.0:1762167007.606799:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451856512 00000100:00100000:0.0:1762167007.606805:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451856512 00002000:00010000:2.0:1762167007.606814:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (44628->18446744073709551615) 00002000:00100000:2.0:1762167007.606820:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc7800 with x1847765451856384 ext(44628->18446744073709551615) 00002000:00010000:0.0:1762167007.606825:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00010000:2.0:1762167007.606829:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fcc7800. 00002000:00100000:0.0:1762167007.606831:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc5180 with x1847765451856512 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.606840:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc5180. 00000100:00100000:2.0:1762167007.606856:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2901 00000100:00100000:2.0:1762167007.606865:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451856384:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167007.606881:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2902 00000100:00100000:0.0:1762167007.606892:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451856512:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167007.607111:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.607115:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167007.607118:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167007.607121:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167007.607124:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167007.607164:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 154055 -> 44628 00002000:00010000:2.0:1762167007.607169:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.607174:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167007.607174:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451856512:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 282us (449us total) trans 21474843325 rc 0/0 00002000:00010000:2.0:1762167007.607179:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.607185:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167007.607195:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2902 00002000:00010000:0.0:1762167007.607200:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.607203:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc5180 with x1847765451856512 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.607208:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc5180. 00000100:00100000:2.0:1762167007.607213:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451856384:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 348us (534us total) trans 17179875783 rc 0/0 00000100:00100000:2.0:1762167007.607220:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2901 00002000:00010000:2.0:1762167007.607223:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (44628->18446744073709551615) 00002000:00100000:2.0:1762167007.607226:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc7800 with x1847765451856384 ext(44628->18446744073709551615) 00002000:00010000:2.0:1762167007.607231:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fcc7800. 00000100:00100000:3.0:1762167007.608257:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.608297:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451856640 00000100:00100000:2.0:1762167007.608303:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451856640 00000100:00100000:2.0:1762167007.608354:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19801 00000100:00100000:2.0:1762167007.608363:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56205:x1847765451856640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.608396:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.608413:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0aa73 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3914 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.608486:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aa7a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.608498:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aa7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.608507:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aa7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167007.608529:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:2.0:1762167007.608533:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167007.608545:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aa7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.608567:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0aa73 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3914 expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.608582:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aa7a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3914 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.608589:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.608592:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167007.608595:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167007.608632:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56205:x1847765451856640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 271us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.608639:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19801 00000100:00100000:3.0:1762167007.610003:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.610054:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451856896 00000100:00100000:2.0:1762167007.610061:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451856896 00000100:00100000:2.0:1762167007.610101:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19802 00000100:00100000:2.0:1762167007.610111:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56205:x1847765451856896:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167007.610148:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.610165:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aa7a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3914 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.610177:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.610180:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.610324:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.610333:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.610345:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167007.610397:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952898 00000004:00010000:2.0:1762167007.610420:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000062c31d78 reply state 00000000bcd5541f transno 8589952899 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.610428:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167007.610493:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56205:x1847765451856896:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 383us (493us total) trans 8589952899 rc 0/0 00000100:00100000:2.0:1762167007.610500:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19802 00000020:00080000:2.0:1762167007.610505:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167007.611120:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.611130:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.611138:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.611144:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ee8c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.611148:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.611155:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.611166:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.611169:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167007.611173:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.611178:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0aa81 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167007.611401:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.611490:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451857024 00000100:00100000:0.0:1762167007.611496:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451857024 00000100:00100000:0.0:1762167007.611535:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16858 00000100:00100000:0.0:1762167007.611545:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56205:x1847765451857024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.611557:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.611571:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0aa88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb391b expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167007.611592:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 154055, mtime: 0x690888df, atime: 0x690888dd, ctime: 0x690888df, blocks: 0x203 00010000:00010000:0.0:1762167007.611606:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.611608:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.611615:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0aa88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb391b expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.611629:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0aa88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb391b expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.611639:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:0.0:1762167007.611682:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56205:x1847765451857024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 138us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.611689:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16858 00000100:00100000:1.0:1762167007.612714:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.612811:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451857152 00000100:00100000:2.0:1762167007.612818:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451857152 00000100:00100000:1.0:1762167007.612822:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:2.0:1762167007.612853:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (44628->18446744073709551615) 00002000:00100000:2.0:1762167007.612858:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc7100 with x1847765451857152 ext(44628->18446744073709551615) 00002000:00010000:2.0:1762167007.612867:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fcc7100. 00000100:00100000:2.0:1762167007.612889:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2903 00000100:00100000:0.0:1762167007.612890:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451857280 00000100:00100000:0.0:1762167007.612896:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451857280 00000100:00100000:2.0:1762167007.612901:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451857152:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167007.612917:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.612922:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc6a00 with x1847765451857280 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.612928:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc6a00. 00000100:00100000:0.0:1762167007.612955:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2904 00000100:00100000:0.0:1762167007.612964:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451857280:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167007.613188:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.613192:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167007.613195:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167007.613197:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 154055 -> 44628 00002000:00010000:0.0:1762167007.613199:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167007.613202:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167007.613208:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.613211:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167007.613214:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.613217:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167007.613249:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765451857280:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 285us (428us total) trans 21474843326 rc 0/0 00000100:00100000:0.0:1762167007.613258:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2904 00000100:00100000:2.0:1762167007.613264:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451857152:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 365us (551us total) trans 17179875784 rc 0/0 00002000:00010000:0.0:1762167007.613264:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.613271:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc6a00 with x1847765451857280 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.613277:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc6a00. 00000100:00100000:2.0:1762167007.613282:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2903 00002000:00010000:2.0:1762167007.613287:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (44628->18446744073709551615) 00002000:00100000:2.0:1762167007.613290:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc7100 with x1847765451857152 ext(44628->18446744073709551615) 00002000:00010000:2.0:1762167007.613296:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fcc7100. 00000100:00100000:3.0:1762167007.614896:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.614963:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451857408 00000100:00100000:2.0:1762167007.614970:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451857408 00000100:00100000:2.0:1762167007.615015:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19803 00000100:00100000:2.0:1762167007.615026:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56205:x1847765451857408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.615046:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.615065:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0aa8f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3922 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.615166:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa96 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.615180:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.615191:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167007.615217:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:2.0:1762167007.615222:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167007.615237:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.615260:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0aa8f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3922 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.615278:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa96 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3922 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.615286:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.615289:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167007.615292:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167007.615338:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56205:x1847765451857408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 314us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.615345:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19803 00000100:00100000:3.0:1762167007.617054:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.617103:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451857664 00000100:00100000:2.0:1762167007.617110:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451857664 00000100:00100000:2.0:1762167007.617153:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19804 00000100:00100000:2.0:1762167007.617163:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56205:x1847765451857664:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167007.617202:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.617224:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0aa96 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3922 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.617240:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.617244:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.617447:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.617459:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.617468:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167007.617524:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952900 00000004:00010000:2.0:1762167007.617550:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000005d49fa8 reply state 00000000d0925dcd transno 8589952901 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.617558:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167007.617630:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56205:x1847765451857664:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 467us (580us total) trans 8589952901 rc 0/0 00000100:00100000:2.0:1762167007.617636:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19804 00000020:00080000:2.0:1762167007.617641:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167007.618449:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.618458:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.618464:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.618469:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.618473:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.618479:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.618491:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.618500:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167007.618504:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.618510:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0aa9d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167007.618647:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.618701:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451857792 00000100:00100000:0.0:1762167007.618708:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451857792 00000100:00100000:0.0:1762167007.618739:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16859 00000100:00100000:0.0:1762167007.618746:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56205:x1847765451857792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.618757:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.618799:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0aaa4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3929 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167007.618816:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 154055, mtime: 0x690888df, atime: 0x690888dd, ctime: 0x690888df, blocks: 0x203 00010000:00010000:0.0:1762167007.618828:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.618830:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.618835:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0aaa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3929 expref: 24 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.618845:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0aaa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3929 expref: 24 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.618857:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9400, rc 0) 00000100:00100000:0.0:1762167007.618885:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56205:x1847765451857792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 141us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.618890:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16859 00000100:00100000:1.0:1762167007.619805:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.619847:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451857920 00000100:00100000:0.0:1762167007.619853:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451857920 00000100:00100000:0.0:1762167007.619887:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16860 00000100:00100000:0.0:1762167007.619897:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56205:x1847765451857920:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.619907:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.619919:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3930 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.619938:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 29 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.619946:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.619948:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.619952:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 29 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.619997:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 29 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.620011:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 29 pid: 6532 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.620031:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454456192:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.620089:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8300 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.620898:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454456192:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.620913:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 29 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.620922:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8600, rc 0) 00000100:00100000:0.0:1762167007.620957:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56205:x1847765451857920:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1062us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.620964:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16860 00000100:00100000:3.0:1762167007.621198:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.621256:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451858048 00000100:00100000:0.0:1762167007.621262:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451858048 00010000:00010000:0.0:1762167007.621283:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 29 pid: 6532 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.621319:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7489 00000100:00100000:0.0:1762167007.621327:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451858048:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.621337:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.621354:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 29 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.621364:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 29 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.621400:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0a0b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3540 expref: 29 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.621411:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.621413:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.621418:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.621427:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.621449:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.621460:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765454456320:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167007.621501:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fca8300 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.622533:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765454456320:192.168.203.35@tcp:105: 00010000:00010000:0.0:1762167007.622547:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167007.622587:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451858048:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1260us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.622596:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7489 00000100:00100000:3.0:1762167007.622608:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.622692:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.622724:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451858176 00000100:00100000:0.0:1762167007.622730:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451858304 00000100:00100000:2.0:1762167007.622731:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451858176 00000100:00100000:0.0:1762167007.622737:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451858304 00002000:00010000:2.0:1762167007.622781:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (44628->18446744073709551615) 00002000:00010000:0.0:1762167007.622787:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:2.0:1762167007.622788:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01f80 with x1847765451858176 ext(44628->18446744073709551615) 00002000:00100000:0.0:1762167007.622794:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de03800 with x1847765451858304 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167007.622801:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de01f80. 00002000:00010000:0.0:1762167007.622803:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36de03800. 00000100:00100000:2.0:1762167007.622823:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2905 00000100:00100000:2.0:1762167007.622834:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451858176:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167007.622839:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2906 00000100:00100000:0.0:1762167007.622849:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451858304:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167007.623108:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.623112:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167005 -> 1762167007 00002000:00010000:0.0:1762167007.623115:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167007.623117:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167007.623120:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1762167007.623149:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 154055 -> 44628 00002000:00010000:2.0:1762167007.623153:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.623155:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167007.623158:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:0.0:1762167007.623162:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451858304:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 312us (468us total) trans 17179875785 rc 0/0 00002000:00010000:2.0:1762167007.623163:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167007.623175:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2906 00002000:00010000:0.0:1762167007.623179:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.623182:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de03800 with x1847765451858304 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.623187:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36de03800. 00000100:00100000:2.0:1762167007.623196:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451858176:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 363us (621us total) trans 21474843327 rc 0/0 00000100:00100000:2.0:1762167007.623204:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2905 00002000:00010000:2.0:1762167007.623208:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (44628->18446744073709551615) 00002000:00100000:2.0:1762167007.623211:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01f80 with x1847765451858176 ext(44628->18446744073709551615) 00002000:00010000:2.0:1762167007.623222:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de01f80. 00000100:00100000:1.0:1762167007.624321:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.624394:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451858432 00000100:00100000:2.0:1762167007.624401:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451858432 00000100:00100000:2.0:1762167007.624442:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19805 00000100:00100000:2.0:1762167007.624449:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56205:x1847765451858432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.624464:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.624479:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0aab2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3937 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.624554:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aab9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.624567:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aab9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.624576:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aab9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167007.624599:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:2.0:1762167007.624603:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167007.624616:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aab9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.624638:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0aab2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3937 expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.624653:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aab9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3937 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.624660:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.624663:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167007.624667:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167007.624713:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56205:x1847765451858432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 263us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.624720:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19805 00000100:00100000:3.0:1762167007.626186:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.626232:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451858688 00000100:00100000:2.0:1762167007.626238:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451858688 00000100:00100000:2.0:1762167007.626284:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19806 00000100:00100000:2.0:1762167007.626293:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56205:x1847765451858688:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167007.626329:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.626348:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aab9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3937 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.626362:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.626366:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.626536:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.626548:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.626556:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167007.626602:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952902 00000004:00010000:2.0:1762167007.626628:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000632fbd04 reply state 0000000092c6ab55 transno 8589952903 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.626637:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167007.626715:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56205:x1847765451858688:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 423us (532us total) trans 8589952903 rc 0/0 00000100:00100000:2.0:1762167007.626722:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19806 00000020:00080000:2.0:1762167007.626726:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167007.627808:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.627816:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.627821:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.627829:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.627832:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.627837:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.627845:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.627847:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167007.627850:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.627854:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0aac0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167007.627925:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.627972:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451858816 00000100:00100000:0.0:1762167007.627979:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451858816 00000100:00100000:0.0:1762167007.628025:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16861 00000100:00100000:0.0:1762167007.628036:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56205:x1847765451858816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.628048:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.628064:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0aac7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb393e expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167007.628087:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81e:0x0] initial LVB size: 205925, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x203 00010000:00010000:0.0:1762167007.628103:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.628105:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.628112:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0aac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb393e expref: 30 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.628127:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0aac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb393e expref: 30 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.628138:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:0.0:1762167007.628178:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:56205:x1847765451858816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 145us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.628185:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16861 00000100:00100000:3.0:1762167007.629082:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.629244:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451858944 00000100:00100000:0.0:1762167007.629251:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451858944 00000100:00100000:0.0:1762167007.629291:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16862 00000100:00100000:0.0:1762167007.629298:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56205:x1847765451858944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.629309:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.629321:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3945 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.629340:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a269 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e8 expref: 26 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.629350:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a388 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3643 expref: 26 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.629356:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.629358:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.629362:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 5/0,0 mode: --/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 26 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.629407:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3643 expref: 26 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.629421:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a388 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3643 expref: 26 pid: 33892 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167007.629434:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454456448:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.629491:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a269 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e8 expref: 26 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.629497:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a269 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e8 expref: 26 pid: 6533 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167007.629504:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454456576:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.629519:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e0d2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.630630:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454456448:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.630649:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454456576:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.630672:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 3/0,0 mode: --/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 26 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.630686:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8e00, rc 0) 00000100:00100000:0.0:1762167007.630724:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56205:x1847765451858944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1425us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.630734:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16862 00000100:00100000:3.0:1762167007.630829:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.630870:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451859072 00000100:00100000:0.0:1762167007.630876:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451859072 00010000:00010000:0.0:1762167007.630899:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a388 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3643 expref: 26 pid: 33892 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167007.630936:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7490 00000100:00100000:0.0:1762167007.630946:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451859072:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.630958:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762167007.630966:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167007.630977:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a388 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3643 expref: 26 pid: 33892 timeout: 728 lvb_type: 1 00000100:00100000:2.0:1762167007.630989:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451859200 00010000:00010000:0.0:1762167007.630991:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3643 expref: 26 pid: 33892 timeout: 728 lvb_type: 1 00000100:00100000:2.0:1762167007.630994:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451859200 00010000:00010000:0.0:1762167007.631016:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0a388 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3643 expref: 27 pid: 33892 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.631020:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a269 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e8 expref: 27 pid: 6533 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167007.631029:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.631058:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7491 00000100:00100000:0.0:1762167007.631066:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451859072:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 120us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.631071:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451859200:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762167007.631079:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7490 00010000:00010000:2.0:1762167007.631083:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.631097:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a269 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e8 expref: 25 pid: 6533 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.631110:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a269 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e8 expref: 25 pid: 6533 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.631127:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0a269 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb35e8 expref: 25 pid: 6533 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.631137:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.631139:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.631144:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 24 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.631153:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 24 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.631186:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 24 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.631198:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454456704:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167007.631268:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.631976:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454456704:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167007.631988:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.632017:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451859200:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 952us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.632026:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7491 00000100:00100000:1.0:1762167007.632241:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.632270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.632291:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451859456 00000100:00100000:0.0:1762167007.632297:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451859456 00000100:00100000:2.0:1762167007.632325:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451859328 00002000:00010000:0.0:1762167007.632325:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2075 (0->18446744073709551615) 00000100:00100000:2.0:1762167007.632331:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451859328 00002000:00100000:0.0:1762167007.632332:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc4000 with x1847765451859456 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.632341:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc4000. 00002000:00010000:2.0:1762167007.632350:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2078 (44628->18446744073709551615) 00002000:00100000:2.0:1762167007.632354:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc4380 with x1847765451859328 ext(44628->18446744073709551615) 00002000:00010000:2.0:1762167007.632363:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fcc4380. 00000100:00100000:0.0:1762167007.632370:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2907 00000100:00100000:0.0:1762167007.632394:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451859456:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167007.632419:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2908 00000100:00100000:3.0:1762167007.632433:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451859328:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167007.632659:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.632663:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167007.632666:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.632668:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167007.632671:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1762167007.632710:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 205925 -> 44628 00000100:00100000:0.0:1762167007.632710:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451859456:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 328us (470us total) trans 21474843328 rc 0/0 00002000:00010000:3.0:1762167007.632716:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.632722:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167007.632726:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2907 00002000:00010000:3.0:1762167007.632728:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.632732:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2075 (0->18446744073709551615) 00002000:00010000:3.0:1762167007.632733:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00100000:0.0:1762167007.632739:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc4000 with x1847765451859456 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.632746:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc4000. 00000100:00100000:3.0:1762167007.632792:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451859328:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 362us (519us total) trans 17179875786 rc 0/0 00000100:00100000:3.0:1762167007.632801:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2908 00002000:00010000:3.0:1762167007.632805:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2078 (44628->18446744073709551615) 00002000:00100000:3.0:1762167007.632808:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc4380 with x1847765451859328 ext(44628->18446744073709551615) 00002000:00010000:3.0:1762167007.632867:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fcc4380. 00000100:00100000:1.0:1762167007.633876:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.633917:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451859584 00000100:00100000:2.0:1762167007.633923:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451859584 00000100:00100000:2.0:1762167007.633965:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19807 00000100:00100000:2.0:1762167007.633974:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56205:x1847765451859584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167007.633990:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.634006:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aad5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb394c expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.634075:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0aadc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.634085:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0aadc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.634093:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0aadc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167007.634110:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:2.0:1762167007.634114:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167007.634137:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0aadc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.634160:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0aad5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb394c expref: 905 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.634180:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0aadc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb394c expref: 904 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.634188:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.634191:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167007.634195:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167007.634231:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56205:x1847765451859584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 259us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.634235:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19807 00000100:00100000:2.0:1762167007.635561:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.635606:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451859840 00000100:00100000:0.0:1762167007.635613:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451859840 00000100:00100000:0.0:1762167007.635651:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19808 00000100:00100000:0.0:1762167007.635669:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56205:x1847765451859840:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167007.635710:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.635729:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0aadc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb394c expref: 904 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.635743:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:0.0:1762167007.635747:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.635949:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.635964:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.635972:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167007.636021:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952904 00000004:00010000:0.0:1762167007.636046:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e60709e0 reply state 00000000048704ae transno 8589952905 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167007.636054:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167007.636123:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56205:x1847765451859840:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 463us (565us total) trans 8589952905 rc 0/0 00000100:00100000:0.0:1762167007.636130:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19808 00000020:00080000:0.0:1762167007.636135:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167007.636812:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.636823:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.636829:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.636834:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.636839:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.636846:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.636860:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.636863:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167007.636866:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.636872:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0aae3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.637192:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.637246:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451859968 00000100:00100000:0.0:1762167007.637253:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451859968 00000100:00100000:0.0:1762167007.637290:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16863 00000100:00100000:0.0:1762167007.637298:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56205:x1847765451859968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.637308:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.637323:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0aaea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3953 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167007.637342:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 45056, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x83 00010000:00010000:0.0:1762167007.637356:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.637359:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.637365:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0aaea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3953 expref: 26 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.637395:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0aaea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3953 expref: 26 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.637405:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9e00, rc 0) 00000100:00100000:0.0:1762167007.637444:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56205:x1847765451859968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 146us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.637450:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16863 00000100:00100000:1.0:1762167007.638302:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.638334:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451860096 00000100:00100000:0.0:1762167007.638338:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451860096 00000100:00100000:0.0:1762167007.638372:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16864 00000100:00100000:0.0:1762167007.638393:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56205:x1847765451860096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.638403:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.638417:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb395a expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.638439:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 32 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.638446:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.638447:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.638450:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 32 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.638482:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 32 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.638501:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 32 pid: 26444 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.638527:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454456832:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.638593:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.639421:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454456832:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.639442:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 32 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.639452:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9a00, rc 0) 00000100:00100000:0.0:1762167007.639507:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56205:x1847765451860096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1126us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.639515:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16864 00000100:00100000:2.0:1762167007.639849:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.640491:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451860224 00000100:00100000:1.0:1762167007.640498:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451860224 00010000:00010000:1.0:1762167007.640524:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 32 pid: 26444 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.640554:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7492 00000100:00100000:1.0:1762167007.640560:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451860224:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.640569:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.640585:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 32 pid: 26444 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.640593:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 32 pid: 26444 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.640606:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0a5f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb372a expref: 32 pid: 26444 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.640616:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.640617:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.640621:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 31 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.640627:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 31 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.640646:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 31 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.640654:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765454456960:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167007.640702:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.641848:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765454456960:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167007.641869:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.641914:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451860224:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1352us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.641924:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.641929:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7492 00000100:00100000:0.0:1762167007.641970:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451860352 00000100:00100000:0.0:1762167007.641976:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451860352 00002000:00010000:0.0:1762167007.642005:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (44628->18446744073709551615) 00002000:00100000:0.0:1762167007.642010:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f332a00 with x1847765451860352 ext(44628->18446744073709551615) 00000100:00100000:3.0:1762167007.642018:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:0.0:1762167007.642019:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f332a00. 00000100:00100000:0.0:1762167007.642062:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451860480 00000100:00100000:0.0:1762167007.642066:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451860480 00000100:00100000:1.0:1762167007.642076:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2909 00002000:00010000:0.0:1762167007.642080:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.642085:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f330a80 with x1847765451860480 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167007.642090:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451860352:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167007.642091:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36f330a80. 00000100:00100000:0.0:1762167007.642114:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2910 00000100:00100000:0.0:1762167007.642126:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451860480:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167007.642396:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 45056 -> 44628 00002000:00010000:1.0:1762167007.642400:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.642403:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.642405:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.642408:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 131 -> 131 00002000:00010000:0.0:1762167007.642431:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.642436:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167006 -> 1762167007 00002000:00010000:0.0:1762167007.642438:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:1.0:1762167007.642442:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451860352:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 356us (520us total) trans 21474843329 rc 0/0 00002000:00010000:0.0:1762167007.642443:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.642450:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167007.642454:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2909 00002000:00010000:1.0:1762167007.642458:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (44628->18446744073709551615) 00002000:00100000:1.0:1762167007.642460:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f332a00 with x1847765451860352 ext(44628->18446744073709551615) 00002000:00010000:1.0:1762167007.642464:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f332a00. 00000100:00100000:0.0:1762167007.642483:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451860480:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 359us (463us total) trans 17179875787 rc 0/0 00000100:00100000:0.0:1762167007.642492:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2910 00002000:00010000:0.0:1762167007.642496:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.642499:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f330a80 with x1847765451860480 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.642504:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36f330a80. 00000100:00100000:1.0:1762167007.643581:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.643639:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451860608 00000100:00100000:0.0:1762167007.643646:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451860608 00000100:00100000:0.0:1762167007.643689:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19809 00000100:00100000:0.0:1762167007.643698:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56205:x1847765451860608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.643716:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.643734:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0aaf8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3961 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.643856:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0aaff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.643871:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0aaff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.643882:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0aaff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167007.643912:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:0.0:1762167007.643916:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.643931:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0aaff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.643956:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0aaf8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3961 expref: 907 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.643973:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0aaff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3961 expref: 906 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.643982:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:0.0:1762167007.643984:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.643987:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:0.0:1762167007.644029:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56205:x1847765451860608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 332us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.644036:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19809 00000100:00100000:3.0:1762167007.645354:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.645414:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451860864 00000100:00100000:0.0:1762167007.645420:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451860864 00000100:00100000:0.0:1762167007.645469:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19810 00000100:00100000:0.0:1762167007.645477:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56205:x1847765451860864:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167007.645511:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.645530:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0aaff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3961 expref: 906 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.645545:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:0.0:1762167007.645549:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.645739:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.645751:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.645759:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167007.645841:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952906 00000004:00010000:0.0:1762167007.645867:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000075f08d95 reply state 000000002f2d5692 transno 8589952907 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167007.645875:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167007.645942:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56205:x1847765451860864:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 465us (590us total) trans 8589952907 rc 0/0 00000100:00100000:0.0:1762167007.645950:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19810 00000020:00080000:0.0:1762167007.645954:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167007.646544:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.646554:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.646561:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.646567:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.646571:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.646577:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.646587:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.646591:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167007.646594:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.646600:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0ab06 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167007.646743:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.646816:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451860992 00000100:00100000:0.0:1762167007.646823:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451860992 00000100:00100000:0.0:1762167007.646861:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16865 00000100:00100000:0.0:1762167007.646871:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56205:x1847765451860992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.646882:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.646900:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0ab0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3968 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167007.646920:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 92573, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x103 00010000:00010000:0.0:1762167007.646935:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.646937:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.646943:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0ab0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3968 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.646962:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0ab0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3968 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.646972:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9800, rc 0) 00000100:00100000:0.0:1762167007.647011:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:56205:x1847765451860992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 142us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.647019:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16865 00000100:00100000:3.0:1762167007.647829:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.647864:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451861120 00000100:00100000:0.0:1762167007.647870:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451861120 00000100:00100000:0.0:1762167007.647903:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16866 00000100:00100000:0.0:1762167007.647911:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56205:x1847765451861120:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.647922:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.647936:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb396f expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.647958:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 28 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.647963:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.647965:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.647967:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.647992:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 28 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.648005:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 28 pid: 6532 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.648015:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454457088:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.648068:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.648823:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454457088:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.648842:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.648855:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8a00, rc 0) 00000100:00100000:0.0:1762167007.648890:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56205:x1847765451861120:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 979us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.648897:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16866 00000100:00100000:3.0:1762167007.649054:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.649088:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451861248 00000100:00100000:2.0:1762167007.649093:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451861248 00010000:00010000:2.0:1762167007.649114:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 28 pid: 6532 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.649141:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7493 00000100:00100000:2.0:1762167007.649147:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451861248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.649154:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.649168:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 28 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.649176:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 28 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.649193:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0a820 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3818 expref: 28 pid: 6532 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.649203:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.649205:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.649210:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.649219:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.649243:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.649254:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454457216:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167007.649301:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.650097:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454457216:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167007.650131:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.650202:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451861248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1052us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.650213:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7493 00000100:00100000:3.0:1762167007.650421:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.650460:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.650491:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451861376 00000100:00100000:0.0:1762167007.650497:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451861376 00000100:00100000:1.0:1762167007.650505:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451861504 00000100:00100000:1.0:1762167007.650512:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451861504 00002000:00010000:0.0:1762167007.650525:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (44628->18446744073709551615) 00002000:00100000:0.0:1762167007.650530:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242520700 with x1847765451861376 ext(44628->18446744073709551615) 00002000:00010000:1.0:1762167007.650537:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00010000:0.0:1762167007.650539:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242520700. 00002000:00100000:1.0:1762167007.650549:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcce300 with x1847765451861504 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167007.650556:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcce300. 00000100:00100000:0.0:1762167007.650571:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2911 00000100:00100000:0.0:1762167007.650583:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451861376:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167007.650586:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2912 00000100:00100000:1.0:1762167007.650597:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451861504:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167007.650902:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.650902:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 92573 -> 44628 00002000:00010000:1.0:1762167007.650908:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.650909:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.650912:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.650915:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.650916:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.650920:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1762167007.650923:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.650927:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:1.0:1762167007.650963:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451861504:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 367us (501us total) trans 21474843330 rc 0/0 00000100:00100000:0.0:1762167007.650971:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451861376:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 389us (593us total) trans 17179875788 rc 0/0 00000100:00100000:1.0:1762167007.650973:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2912 00002000:00010000:1.0:1762167007.650979:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00100000:1.0:1762167007.650985:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcce300 with x1847765451861504 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167007.650986:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2911 00002000:00010000:0.0:1762167007.650993:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (44628->18446744073709551615) 00002000:00010000:1.0:1762167007.650995:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcce300. 00002000:00100000:0.0:1762167007.650998:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242520700 with x1847765451861376 ext(44628->18446744073709551615) 00002000:00010000:0.0:1762167007.651006:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242520700. 00000100:00100000:1.0:1762167007.651934:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.651969:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451861760 00000100:00100000:0.0:1762167007.651974:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451861760 00000100:00100000:0.0:1762167007.652006:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19811 00000100:00100000:0.0:1762167007.652014:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56205:x1847765451861760:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167007.652087:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.652099:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.652107:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00010000:0.0:1762167007.652186:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a098b275 reply state 000000003664ca2f transno 8589952908 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167007.652192:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167007.652245:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56205:x1847765451861760:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 231us (312us total) trans 8589952908 rc 0/0 00000100:00100000:0.0:1762167007.652252:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19811 00010000:00010000:2.0:1762167007.652922:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.652933:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.652940:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.652946:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2431a1000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.652950:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.652957:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.652969:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.652971:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167007.652974:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.652978:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2431a1000/0xf915a5bdf3d0ab1b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167007.653195:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.653238:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451861888 00000100:00100000:0.0:1762167007.653244:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451861888 00000100:00100000:0.0:1762167007.653279:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16867 00000100:00100000:0.0:1762167007.653288:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56205:x1847765451861888:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.653300:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.653312:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3976 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.653334:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a9d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38dc expref: 29 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.653340:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.653341:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.653344:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 29 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.653367:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38dc expref: 29 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.653376:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a9d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38dc expref: 29 pid: 6532 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167007.653399:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454457344:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.653447:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.654203:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454457344:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.654224:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 29 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.654255:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2431a1e00, rc 0) 00000100:00100000:0.0:1762167007.654293:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56205:x1847765451861888:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1006us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.654300:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16867 00000100:00100000:3.0:1762167007.654420:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.654454:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451862016 00000100:00100000:2.0:1762167007.654460:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451862016 00010000:00010000:2.0:1762167007.654488:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a9d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38dc expref: 29 pid: 6532 timeout: 728 lvb_type: 1 00000100:00100000:2.0:1762167007.654516:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7494 00000100:00100000:2.0:1762167007.654526:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451862016:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.654534:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.654547:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a9d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38dc expref: 29 pid: 6532 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.654555:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38dc expref: 29 pid: 6532 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.654572:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0a9d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38dc expref: 29 pid: 6532 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.654583:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.654585:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.654591:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.654600:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.654626:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.654637:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454457472:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167007.654688:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.655742:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454457472:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167007.655755:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.655811:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451862016:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1286us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.655822:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7494 00000100:00100000:1.0:1762167007.655917:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167007.655936:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167007.655939:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451862144 00000100:00100000:3.0:1762167007.655945:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451862144 00000100:00100000:3.0:1762167007.656046:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16868 00000100:00100000:3.0:1762167007.656055:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:56205:x1847765451862144:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.656067:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.656079:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb397d expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.656100:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a9e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38e3 expref: 35 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.656107:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.656109:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.656112:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 35 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.656128:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38e3 expref: 35 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.656137:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a9e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38e3 expref: 35 pid: 7858 timeout: 728 lvb_type: 1 00000100:00100000:3.0:1762167007.656144:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454457600:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167007.656180:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.656895:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454457600:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.656914:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 35 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.656927:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:0.0:1762167007.656961:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:56205:x1847765451862144:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 908us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.656966:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16868 00000100:00100000:3.0:1762167007.657136:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.657169:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451862272 00000100:00100000:2.0:1762167007.657174:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451862272 00010000:00010000:2.0:1762167007.657193:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a9e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38e3 expref: 35 pid: 7858 timeout: 728 lvb_type: 1 00000100:00100000:2.0:1762167007.657221:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7495 00000100:00100000:2.0:1762167007.657229:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451862272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.657239:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.657263:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a9e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38e3 expref: 35 pid: 7858 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.657274:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38e3 expref: 35 pid: 7858 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.657290:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0a9e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38e3 expref: 35 pid: 7858 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.657302:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.657304:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.657309:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 34 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.657318:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 34 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.657345:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 34 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.657356:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765454457728:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167007.657423:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.658244:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:29775:1847765454457728:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167007.658262:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.658293:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451862272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1064us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.658301:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7495 00000100:00100000:3.0:1762167007.658547:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.658596:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451862400 00000100:00100000:0.0:1762167007.658601:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451862400 00000100:00100000:0.0:1762167007.658635:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16869 00000100:00100000:0.0:1762167007.658641:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56205:x1847765451862400:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.658650:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.658660:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3984 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.658676:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a9e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ea expref: 29 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.658681:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.658684:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.658687:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 29 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.658709:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a9e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ea expref: 29 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.658720:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a9e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ea expref: 29 pid: 6533 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167007.658731:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454457856:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.658813:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.659633:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454457856:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.659650:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 29 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.659663:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372975000, rc 0) 00000100:00100000:0.0:1762167007.659698:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56205:x1847765451862400:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1055us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.659705:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16869 00000100:00100000:3.0:1762167007.659942:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.659976:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451862528 00000100:00100000:2.0:1762167007.659980:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451862528 00010000:00010000:2.0:1762167007.659997:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a9e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ea expref: 29 pid: 6533 timeout: 728 lvb_type: 1 00000100:00100000:2.0:1762167007.660021:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7496 00000100:00100000:2.0:1762167007.660029:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451862528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.660039:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.660054:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a9e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ea expref: 29 pid: 6533 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.660069:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a9e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ea expref: 29 pid: 6533 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.660084:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0a9e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ea expref: 29 pid: 6533 timeout: 728 lvb_type: 1 00010000:00010000:2.0:1762167007.660096:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.660098:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.660102:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.660110:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.660134:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.660145:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454457984:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167007.660190:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee341377d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.661227:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454457984:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167007.661251:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.661311:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451862528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1281us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.661324:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7496 00000100:00100000:3.0:1762167007.661530:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.661566:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.661592:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451862656 00000100:00100000:0.0:1762167007.661598:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451862656 00000100:00100000:3.0:1762167007.661607:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.661649:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451862784 00000100:00100000:0.0:1762167007.661651:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451862784 00000100:00100000:1.0:1762167007.661653:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451862912 00000100:00100000:1.0:1762167007.661662:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451862912 00000100:00100000:0.0:1762167007.661680:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16870 00000100:00100000:2.0:1762167007.661690:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16871 00000100:00100000:0.0:1762167007.661691:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451862656:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:2.0:1762167007.661710:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451862784:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167007.661717:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16872 00000100:00100000:3.0:1762167007.661733:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451862912:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762167007.661922:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.661926:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.661929:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.661932:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.661935:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167007.661945:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 44628 -> 44628 00002000:00010000:3.0:1762167007.661951:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.661951:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.661958:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.661959:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.661965:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.661966:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.661971:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.661972:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 79 -> 47 00002000:00010000:3.0:1762167007.661974:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167007.661985:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451862784:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 282us (418us total) trans 17179875789 rc 0/0 00000100:00100000:2.0:1762167007.661996:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16871 00000100:00100000:3.0:1762167007.662009:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451862912:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 280us (400us total) trans 21474843332 rc 0/0 00000100:00100000:3.0:1762167007.662024:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16872 00000100:00100000:0.0:1762167007.662025:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451862656:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 330us (492us total) trans 21474843331 rc 0/0 00000100:00100000:0.0:1762167007.662039:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16870 00000100:00100000:1.0:1762167007.663005:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.663057:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451863168 00000100:00100000:0.0:1762167007.663063:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451863168 00000100:00100000:0.0:1762167007.663101:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7338 00000100:00100000:0.0:1762167007.663111:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242a6d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56205:x1847765451863168:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762167007.663150:0:30820:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a99a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38c7 expref: 908 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.663182:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.663190:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a9c4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ce expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.663196:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.663214:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ce expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.663221:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a9c4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ce expref: 908 pid: 30817 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.663234:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454458112:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.663288:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.664071:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454458112:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.664088:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167007.664339:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.664389:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451863296 00000100:00100000:2.0:1762167007.664395:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451863296 00010000:00010000:2.0:1762167007.664419:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a9c4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ce expref: 909 pid: 30817 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.664450:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7497 00000100:00100000:2.0:1762167007.664459:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:2361:x1847765451863296:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.664470:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.664476:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a9c4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ce expref: 909 pid: 30817 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.664487:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ce expref: 909 pid: 30817 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.664502:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0a9c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ce expref: 909 pid: 30817 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.664515:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.664519:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.664527:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.664533:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.664554:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.664578:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167007.664587:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167007.664594:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2361:x1847765451863296:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 134us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.664602:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7497 00000040:00080000:0.0:1762167007.665162:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5432, 88 off438376 00000004:00080000:0.0:1762167007.665170:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628457406639ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.665243:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5440, 88 off439432 00000004:00080000:0.0:1762167007.665249:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628457485981ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.665286:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5441, 88 off439520 00000004:00080000:0.0:1762167007.665291:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628457528204ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.665318:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5433, 88 off438464 00000004:00080000:0.0:1762167007.665322:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628457559649ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.665351:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5442, 88 off439608 00000004:00080000:0.0:1762167007.665356:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628457592804ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.665395:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5434, 88 off438552 00000004:00080000:0.0:1762167007.665401:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628457638529ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.665427:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5435, 88 off438640 00000004:00080000:0.0:1762167007.665431:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628457668505ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.665452:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5443, 88 off439696 00000004:00080000:0.0:1762167007.665456:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628457693426ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.665479:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5444, 88 off439784 00000004:00080000:0.0:1762167007.665483:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628457720621ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.665507:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5436, 88 off438728 00000004:00080000:0.0:1762167007.665511:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628457748171ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.665536:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5445, 88 off439872 00000004:00080000:0.0:1762167007.665540:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628457777502ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.665564:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5437, 88 off438816 00000004:00080000:0.0:1762167007.665568:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628457805655ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.665593:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5438, 88 off438904 00000004:00080000:0.0:1762167007.665596:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628457833347ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.665612:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5446, 88 off439960 00000004:00080000:0.0:1762167007.665615:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628457852309ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.665630:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5447, 88 off440048 00000004:00080000:0.0:1762167007.665632:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628457869384ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.665646:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5439, 88 off438992 00000004:00080000:0.0:1762167007.665648:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628457886024ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.665665:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5440, 88 off439080 00000004:00080000:0.0:1762167007.665669:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628457905872ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.665693:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5448, 88 off440136 00000004:00080000:0.0:1762167007.665697:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628457933900ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.665720:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5449, 88 off440224 00000004:00080000:0.0:1762167007.665724:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628457961305ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.665750:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5441, 88 off439168 00000004:00080000:0.0:1762167007.665755:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628457992697ns, next at 628532618837ns, rc = 0 00000004:00010000:2.0:1762167007.676118:0:30820:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005abe689e reply state 000000002a8a253c transno 8589952909 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167007.676139:0:30820:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1762167007.676148:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952909 is committed 00010000:00010000:2.0:1762167007.676151:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.676156:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:3.0:1762167007.676159:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3549 committed 00010000:00010000:2.0:1762167007.676167:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0a99a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38c7 expref: 907 pid: 32138 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762167007.676178:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3562 committed 00000004:00080000:3.0:1762167007.676193:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3561 committed 00000004:00080000:3.0:1762167007.676195:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3548 committed 00000004:00080000:3.0:1762167007.676198:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3547 committed 00000004:00080000:3.0:1762167007.676202:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3560 committed 00000004:00080000:3.0:1762167007.676206:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3559 committed 00000004:00080000:3.0:1762167007.676210:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3546 committed 00000004:00080000:3.0:1762167007.676214:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3545 committed 00000004:00080000:3.0:1762167007.676217:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3558 committed 00000004:00080000:3.0:1762167007.676220:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3544 committed 00000004:00080000:3.0:1762167007.676222:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3557 committed 00000004:00080000:3.0:1762167007.676223:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3556 committed 00000004:00080000:3.0:1762167007.676225:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3543 committed 00000004:00080000:3.0:1762167007.676227:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3542 committed 00000004:00080000:3.0:1762167007.676228:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3555 committed 00000004:00080000:3.0:1762167007.676230:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3541 committed 00000004:00080000:3.0:1762167007.676231:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3554 committed 00000004:00080000:3.0:1762167007.676232:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3553 committed 00000004:00080000:3.0:1762167007.676233:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3540 committed 00000100:00100000:3.0:1762167007.676321:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454458240:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1762167007.676321:0:30820:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762167007.676340:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242a6d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56205:x1847765451863168:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 13230us (13334us total) trans 8589952909 rc 0/0 00000100:00100000:2.0:1762167007.676354:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7338 00000100:00100000:3.0:1762167007.676413:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167007.676447:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.676458:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167007.676461:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454458496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.676469:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454458368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.676472:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454458880:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762167007.676485:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.676493:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fc43a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167007.676498:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.676506:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167007.676521:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167007.676522:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23800) 00010000:00010000:2.0:1762167007.676527:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167007.676531:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167007.676538:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc43a00/0xf915a5bdf3d0ab37 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167007.676555:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454458240 00000100:00100000:3.0:1762167007.676559:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454459392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.676563:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454458240 00000100:00100000:3.0:1762167007.676589:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.676613:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454458880 00000100:00100000:0.0:1762167007.676618:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454458880 00000100:00100000:3.0:1762167007.676626:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454459776:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.676630:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454459392 00000100:00100000:2.0:1762167007.676636:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454459392 00000100:00100000:0.0:1762167007.676658:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16873 00000100:00100000:3.0:1762167007.676660:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.676673:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765454458240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.676685:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454459776 00000100:00100000:2.0:1762167007.676688:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454459776 00000100:00100000:1.0:1762167007.676710:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16874 00000100:00100000:2.0:1762167007.676718:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16875 00000100:00100000:1.0:1762167007.676723:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1847765454458880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.676730:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765454459392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.676796:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454458624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.676823:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.676842:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454459136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.676863:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.676872:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454459648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.676900:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.676914:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454460160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.676934:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167007.676954:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 44628 -> 44628 00002000:00010000:1.0:1762167007.676955:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 44628 -> 44628 00002000:00010000:0.0:1762167007.676960:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.676961:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.676962:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00000100:00100000:3.0:1762167007.676964:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454458624 00002000:00010000:0.0:1762167007.676968:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167007.676969:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167007.676970:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000100:00100000:3.0:1762167007.676971:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454458624 00002000:00010000:1.0:1762167007.676976:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.676979:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.676979:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167007.676980:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167007.676987:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167007.676987:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167007.676993:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167007.676996:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454459136 00000100:00100000:3.0:1762167007.677000:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454459136 00000100:00100000:3.0:1762167007.677021:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454459648 00000100:00100000:3.0:1762167007.677025:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454459648 00000100:00100000:1.0:1762167007.677036:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765454458880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 316us (513us total) trans 21474843333 rc 0/0 00000100:00100000:2.0:1762167007.677040:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454459392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 312us (449us total) trans 17179875791 rc 0/0 00000100:00100000:3.0:1762167007.677046:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454460160 00000100:00100000:0.0:1762167007.677047:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454458240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 376us (632us total) trans 17179875790 rc 0/0 00000100:00100000:1.0:1762167007.677049:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16874 00000100:00100000:3.0:1762167007.677052:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454460160 00000100:00100000:2.0:1762167007.677060:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16875 00000100:00100000:0.0:1762167007.677067:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16873 00000100:00100000:1.0:1762167007.677080:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16876 00000100:00100000:3.0:1762167007.677087:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16877 00000100:00100000:1.0:1762167007.677093:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454459776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.677094:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16878 00000100:00100000:3.0:1762167007.677097:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765454458624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.677105:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16879 00000100:00100000:2.0:1762167007.677114:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454459136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.677118:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454459648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167007.677261:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 44628 -> 44628 00002000:00010000:1.0:1762167007.677266:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.677269:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.677272:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.677275:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167007.677290:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.677295:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.677298:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167007.677300:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.677301:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.677305:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.677307:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167007.677310:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454459776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (650us total) trans 17179875792 rc 0/0 00002000:00010000:2.0:1762167007.677312:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167007.677318:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.677323:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.677323:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16876 00000100:00100000:1.0:1762167007.677342:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16880 00000100:00100000:1.0:1762167007.677350:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765454460160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.677356:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454459648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 240us (452us total) trans 17179875793 rc 0/0 00000100:00100000:2.0:1762167007.677364:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454459136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 259us (499us total) trans 17179875794 rc 0/0 00000100:00100000:0.0:1762167007.677366:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16879 00000100:00100000:2.0:1762167007.677390:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16878 00002000:00010000:1.0:1762167007.677452:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.677456:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.677457:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.677458:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.677464:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.677465:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.677471:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.677472:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1762167007.677477:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.677481:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.677515:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454460160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (579us total) trans 21474843335 rc 0/0 00000100:00100000:3.0:1762167007.677523:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454458624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 426us (695us total) trans 21474843334 rc 0/0 00000100:00100000:1.0:1762167007.677527:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16880 00000100:00100000:3.0:1762167007.677539:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16877 00000100:00100000:3.0:1762167007.677589:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.677620:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454458752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.677632:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454458368 00000100:00100000:0.0:1762167007.677638:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454458368 00000100:00100000:3.0:1762167007.677647:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.677676:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454459264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.677677:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454458752 00000100:00100000:0.0:1762167007.677681:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454458752 00000100:00100000:1.0:1762167007.677700:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16881 00000100:00100000:0.0:1762167007.677708:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16882 00000100:00100000:3.0:1762167007.677715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.677715:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454458368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.677721:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454458752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.677740:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454459264 00000100:00100000:3.0:1762167007.677747:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454459904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.677747:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454459264 00000100:00100000:2.0:1762167007.677802:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16883 00000100:00100000:2.0:1762167007.677811:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454459264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167007.677884:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.677887:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.677891:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00000100:00100000:3.0:1762167007.677893:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167007.677894:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.677897:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167007.677927:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 44628 -> 44628 00002000:00010000:1.0:1762167007.677933:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00000100:00100000:0.0:1762167007.677933:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454458752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (286us total) trans 21474843336 rc 0/0 00002000:00010000:1.0:1762167007.677939:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167007.677944:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16882 00002000:00010000:1.0:1762167007.677946:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.677948:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 44628 -> 44628 00000100:00100000:3.0:1762167007.677950:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843319 gen 2 00002000:00010000:1.0:1762167007.677950:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 47 00002000:00010000:2.0:1762167007.677954:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00000100:00100000:0.0:1762167007.677956:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454459904 00000004:00080000:3.0:1762167007.677960:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2438b8e00, transno 21474843310 00002000:00010000:2.0:1762167007.677960:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167007.677961:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454459904 00002000:00010000:2.0:1762167007.677968:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.677971:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000004:00080000:3.0:1762167007.677976:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348254700, transno 21474843311 00000004:00080000:3.0:1762167007.677983:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348254000, transno 21474843312 00000100:00100000:0.0:1762167007.677985:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16884 00000004:00080000:3.0:1762167007.677990:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348255f80, transno 21474843313 00000004:00080000:3.0:1762167007.677996:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348257100, transno 21474843314 00000100:00100000:0.0:1762167007.677998:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454459904:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167007.678003:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348256d80, transno 21474843315 00000100:00100000:1.0:1762167007.678009:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454458368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 299us (417us total) trans 21474843337 rc 0/0 00000004:00080000:3.0:1762167007.678011:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348256680, transno 21474843316 00000100:00100000:2.0:1762167007.678016:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454459264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (305us total) trans 17179875795 rc 0/0 00000004:00080000:3.0:1762167007.678019:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc6300, transno 21474843317 00000100:00100000:1.0:1762167007.678022:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16881 00000004:00080000:3.0:1762167007.678029:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc5c00, transno 21474843318 00000100:00100000:2.0:1762167007.678032:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16883 00000004:00080000:3.0:1762167007.678036:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348254e00, transno 21474843319 00000100:00100000:3.0:1762167007.678048:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee243180a80 x1847765454458752/t21474843336(21474843336) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167023 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762167007.678059:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180a80/2, rc 0, transno 21474843336 00000100:00100000:3.0:1762167007.678065:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454458752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.678080:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875775 gen 2 00000004:00080000:3.0:1762167007.678086:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875753 committed transno 17179875775 00002000:00010000:0.0:1762167007.678089:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.678092:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.678093:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167007.678095:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.678096:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:3.0:1762167007.678108:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc2ad80, transno 17179875754 00000100:00100000:0.0:1762167007.678119:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454459904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (231us total) trans 21474843338 rc 0/0 00000100:00100000:0.0:1762167007.678123:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16884 00000004:00080000:3.0:1762167007.678129:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825b480, transno 17179875755 00000004:00080000:3.0:1762167007.678135:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258700, transno 17179875756 00000004:00080000:3.0:1762167007.678139:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc2b800, transno 17179875757 00000004:00080000:3.0:1762167007.678143:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d3100, transno 17179875758 00000004:00080000:3.0:1762167007.678148:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825ad80, transno 17179875759 00000004:00080000:3.0:1762167007.678153:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28e00, transno 17179875760 00000004:00080000:3.0:1762167007.678156:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348259880, transno 17179875761 00000004:00080000:3.0:1762167007.678159:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c0700, transno 17179875762 00000004:00080000:3.0:1762167007.678162:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c2a00, transno 17179875763 00000004:00080000:3.0:1762167007.678164:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24732ed80, transno 17179875766 00000004:00080000:3.0:1762167007.678167:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e472d80, transno 17179875767 00000004:00080000:3.0:1762167007.678169:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243183b80, transno 17179875768 00000004:00080000:3.0:1762167007.678172:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243181880, transno 17179875769 00000004:00080000:3.0:1762167007.678174:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243181c00, transno 17179875770 00000004:00080000:3.0:1762167007.678176:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243183480, transno 17179875771 00000004:00080000:3.0:1762167007.678179:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243181500, transno 17179875772 00000004:00080000:3.0:1762167007.678181:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180380, transno 17179875773 00000004:00080000:3.0:1762167007.678184:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc6d80, transno 17179875774 00000004:00080000:3.0:1762167007.678186:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc6680, transno 17179875775 00000100:00100000:3.0:1762167007.678192:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee243304000 x1847765454459264/t17179875795(17179875795) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167023 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762167007.678200:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243304000/2, rc 0, transno 17179875795 00000100:00100000:3.0:1762167007.678205:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454459264:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167007.678224:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b02a00/2, rc 0, transno 21474843338 00000100:00100000:3.0:1762167007.678229:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454459904:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167007.678243:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243181180/2, rc 0, transno 21474843337 00000100:00100000:3.0:1762167007.678247:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454458368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.678269:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.678300:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454459008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.678310:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454458496 00000100:00100000:0.0:1762167007.678315:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454458496 00000100:00100000:3.0:1762167007.678339:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.678353:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454459008 00000100:00100000:0.0:1762167007.678359:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454459008 00000004:00080000:1.0:1762167007.678365:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 22 in progress, 7 in flight, 6 done 00000100:00100000:3.0:1762167007.678369:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454459520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.678376:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16885 00000100:00100000:2.0:1762167007.678400:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454458496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.678405:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16886 00000100:00100000:3.0:1762167007.678415:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.678420:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454459008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.678444:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454460032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.678479:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167007.678534:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180e00/2, rc 0, transno 21474843334 00000100:00100000:3.0:1762167007.678540:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454458624:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167007.678558:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243307b80/2, rc 0, transno 17179875794 00002000:00010000:2.0:1762167007.678558:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.678563:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00000100:00100000:3.0:1762167007.678565:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454459136:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167007.678568:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.678573:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000004:00080000:1.0:1762167007.678573:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 8 in progress, 6 in flight, 14 done 00002000:00010000:0.0:1762167007.678575:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 44628 -> 44628 00000004:00080000:3.0:1762167007.678579:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc59500/2, rc 0, transno 17179875793 00002000:00010000:2.0:1762167007.678580:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167007.678581:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.678588:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00000100:00100000:3.0:1762167007.678591:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454459648:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167007.678592:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.678596:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000004:00080000:3.0:1762167007.678614:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b00a80/2, rc 0, transno 21474843335 00000100:00100000:3.0:1762167007.678622:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454460160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.678630:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454458496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 233us (359us total) trans 17179875796 rc 0/0 00000100:00100000:0.0:1762167007.678638:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454459008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 222us (298us total) trans 17179875797 rc 0/0 00000100:00100000:2.0:1762167007.678644:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16885 00000100:00100000:0.0:1762167007.678650:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16886 00000100:00100000:2.0:1762167007.678664:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454459520 00000100:00100000:0.0:1762167007.678668:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454460032 00000100:00100000:2.0:1762167007.678669:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454459520 00000100:00100000:0.0:1762167007.678672:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454460032 00000100:00100000:2.0:1762167007.678705:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16887 00000100:00100000:0.0:1762167007.678712:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16888 00000100:00100000:2.0:1762167007.678717:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454459520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.678724:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454460032:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167007.678855:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 3 in flight, 10 done 00002000:00010000:2.0:1762167007.678898:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167007.678898:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00010000:2.0:1762167007.678904:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.678905:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 44628 -> 44628 00002000:00010000:2.0:1762167007.678910:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167007.678910:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00000100:00100000:1.0:1762167007.678911:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454460672:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167007.678916:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167007.678918:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.678920:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.678923:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167007.678923:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000004:00080000:3.0:1762167007.678925:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce6a00/2, rc 0, transno 17179875796 00000100:00100000:3.0:1762167007.678933:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454458496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.678946:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167007.678950:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825a300/2, rc 0, transno 17179875797 00000100:00100000:3.0:1762167007.678956:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454459008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.678973:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454460544:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167007.678975:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b03100/2, rc 0, transno 21474843339 00000100:00100000:0.0:1762167007.678980:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454460032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 256us (498us total) trans 21474843340 rc 0/0 00000100:00100000:2.0:1762167007.678982:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454459520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 267us (567us total) trans 21474843339 rc 0/0 00000100:00100000:3.0:1762167007.678985:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454459520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.678997:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16888 00000100:00100000:1.0:1762167007.678998:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167007.679007:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b00e00/2, rc 0, transno 21474843340 00000100:00100000:2.0:1762167007.679009:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16887 00000100:00100000:3.0:1762167007.679016:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454460032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.679020:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454460672 00000100:00100000:0.0:1762167007.679025:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454460672 00000100:00100000:1.0:1762167007.679033:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454460544 00000100:00100000:1.0:1762167007.679038:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454460544 00000100:00100000:3.0:1762167007.679053:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454460416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.679061:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16889 00000100:00100000:1.0:1762167007.679073:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16890 00000100:00100000:0.0:1762167007.679074:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454460672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.679086:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454460544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.679095:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167007.679128:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180700/2, rc 0, transno 21474843333 00000100:00100000:3.0:1762167007.679133:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454458880:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167007.679149:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc5b800/2, rc 0, transno 17179875791 00000100:00100000:3.0:1762167007.679154:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454459392:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167007.679171:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317dc00/2, rc 0, transno 17179875792 00000100:00100000:2.0:1762167007.679174:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454460416 00000100:00100000:3.0:1762167007.679176:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454459776:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.679179:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454460416 00002000:00010000:0.0:1762167007.679184:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.679188:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.679191:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000004:00080000:3.0:1762167007.679192:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce4700/2, rc 0, transno 17179875790 00002000:00010000:0.0:1762167007.679194:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:3.0:1762167007.679200:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454458240:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167007.679200:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167007.679205:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16891 00000100:00100000:2.0:1762167007.679218:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454460416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.679219:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762167007.679229:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454460288:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167007.679232:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 44628 -> 44628 00002000:00010000:1.0:1762167007.679237:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.679240:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.679244:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:0.0:1762167007.679245:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454460672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (298us total) trans 21474843341 rc 0/0 00002000:00010000:1.0:1762167007.679248:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 131 -> 131 00000100:00100000:0.0:1762167007.679259:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16889 00000100:00100000:3.0:1762167007.679264:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.679279:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454460288 00000100:00100000:0.0:1762167007.679284:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454460288 00000100:00100000:1.0:1762167007.679293:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454460544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (296us total) trans 21474843342 rc 0/0 00000100:00100000:1.0:1762167007.679303:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16890 00000100:00100000:3.0:1762167007.679311:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16892 00000100:00100000:3.0:1762167007.679324:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454460288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167007.679328:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 44628 -> 44628 00002000:00010000:2.0:1762167007.679333:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.679337:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.679340:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000004:00080000:0.0:1762167007.679340:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b04e00/2, rc 0, transno 21474843341 00002000:00010000:2.0:1762167007.679347:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:0.0:1762167007.679350:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454460672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167007.679367:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b06a00/2, rc 0, transno 21474843342 00000100:00100000:0.0:1762167007.679372:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454460544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.679407:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454460416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (317us total) trans 17179875798 rc 0/0 00000100:00100000:2.0:1762167007.679415:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16891 00000004:00080000:1.0:1762167007.679435:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b00380/2, rc 0, transno 17179875798 00000100:00100000:1.0:1762167007.679443:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454460416:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167007.679454:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.679459:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.679462:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167007.679464:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.679467:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1762167007.679501:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454460288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (238us total) trans 17179875799 rc 0/0 00000100:00100000:3.0:1762167007.679509:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16892 00000004:00080000:1.0:1762167007.679520:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b00000/2, rc 0, transno 17179875799 00000100:00100000:1.0:1762167007.679526:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454460288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.679619:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.679657:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451863424 00000100:00100000:0.0:1762167007.679660:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451863424 00000100:00100000:0.0:1762167007.679686:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19812 00000100:00100000:0.0:1762167007.679693:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56205:x1847765451863424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.679706:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.679727:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0ab3e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb398b expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.679808:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0ab3e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb398b expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.679820:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0ab3e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb398b expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.679834:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.679837:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167007.679840:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f4d9c00, rc 0) 00000100:00100000:0.0:1762167007.679871:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56205:x1847765451863424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 180us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.679876:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19812 00000100:00100000:0.0:1762167007.681549:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.681617:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451863680 00000100:00100000:2.0:1762167007.681626:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451863680 00000100:00100000:2.0:1762167007.681670:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7339 00000100:00100000:2.0:1762167007.681679:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56205:x1847765451863680:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167007.681902:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56205:x1847765451863680:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 223us (357us total) trans 8589952910 rc 0/0 00000100:00100000:2.0:1762167007.681910:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7339 00000100:00100000:1.0:1762167007.691605:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.691701:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451863808 00000100:00100000:0.0:1762167007.691712:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451863808 00000100:00100000:0.0:1762167007.691801:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19813 00000100:00100000:0.0:1762167007.691814:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56206:x1847765451863808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.691839:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.691860:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab45 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3992 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.691957:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ab4c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.691971:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ab4c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.691984:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ab4c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.691997:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ab53 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692004:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692011:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692104:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692109:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692114:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167007.692159:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:0.0:1762167007.692163:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.692180:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692190:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692199:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ab4c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692205:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ab4c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692211:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ab4c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692217:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167007.692221:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ab4c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692228:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ab4c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692239:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167007.692241:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167007.692245:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ab4c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692249:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0ab4c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692257:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692261:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ab53 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692265:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ab53 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692267:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef2800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167007.692269:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ab53 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692272:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ab53 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692275:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee242bba100) 00010000:00010000:0.0:1762167007.692276:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167007.692278:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ab53 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692280:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0ab53 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.692301:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab45 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3992 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.692310:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3992 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.692314:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.692316:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.692317:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ef3600, rc 0) 00000100:00100000:0.0:1762167007.692387:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56206:x1847765451863808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 569us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.692394:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19813 00000100:00100000:3.0:1762167007.694010:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.694054:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451864064 00000100:00100000:0.0:1762167007.694063:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451864064 00000100:00100000:0.0:1762167007.694112:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19814 00000100:00100000:0.0:1762167007.694123:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56206:x1847765451864064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.694138:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.694154:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab61 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3999 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.694256:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ab68 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.694266:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ab68 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.694272:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ab68 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167007.694280:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00010000:00010000:0.0:1762167007.694370:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab61 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3999 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.694398:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ab68 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3999 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.694406:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.694408:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762167007.694411:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37299e400, rc 0) 00000100:00100000:0.0:1762167007.694460:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56206:x1847765451864064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 339us (452us total) trans 8589952911 rc 0/0 00000100:00100000:0.0:1762167007.694467:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19814 00000100:00100000:1.0:1762167007.695882:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.695926:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451864320 00000100:00100000:0.0:1762167007.695932:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451864320 00000100:00100000:0.0:1762167007.695974:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19815 00000100:00100000:0.0:1762167007.695984:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56206:x1847765451864320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.696002:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.696018:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab76 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39a0 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.696082:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0ab7d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.696092:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0ab7d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.696098:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0ab7d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167007.696106:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00010000:00010000:0.0:1762167007.696175:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab76 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a0 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.696194:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0ab7d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a0 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.696199:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.696201:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167007.696203:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c200, rc 0) 00000100:00100000:0.0:1762167007.696240:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56206:x1847765451864320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 259us (361us total) trans 8589952912 rc 0/0 00000100:00100000:0.0:1762167007.696247:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19815 00000100:00100000:1.0:1762167007.723206:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.723444:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451864448 00000100:00100000:0.0:1762167007.723456:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451864448 00000100:00100000:0.0:1762167007.723532:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2913 00000100:00100000:0.0:1762167007.723543:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451864448:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167007.723578:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.723598:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 30 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.723607:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.723609:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.723613:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.723649:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 30 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.723669:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 30 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.723684:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454460800:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.723793:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.724978:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454460800:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.725006:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.725212:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.725306:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451864576 00000100:00100000:2.0:1762167007.725312:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451864576 00010000:00010000:2.0:1762167007.725347:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 31 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.725389:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7498 00000100:00100000:2.0:1762167007.725399:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451864576:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.725416:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.725441:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 31 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.725453:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 31 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.725479:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2431a1e00/0xf915a5bdf3d0ab22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3976 expref: 31 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.725493:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.725495:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.725499:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.725507:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.725530:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.725558:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.725567:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451864576:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 169us (354us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167007.725576:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.725577:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7498 00010000:00010000:0.0:1762167007.726662:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.726677:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.726684:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.726691:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.726695:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.726704:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.726717:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.726724:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0ab8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.726815:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451864448:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3272us (3620us total) trans 0 rc 44628/44628 00000100:00100000:0.0:1762167007.726825:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2913 00000100:00100000:3.0:1762167007.728830:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.728876:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451864704 00000100:00100000:0.0:1762167007.728886:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451864704 00000100:00100000:0.0:1762167007.728949:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2914 00000100:00100000:0.0:1762167007.728960:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765451864704:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167007.728996:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.729013:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0aa34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f1 expref: 35 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.729021:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.729023:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.729026:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.729064:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0aa34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f1 expref: 35 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.729077:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0aa34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f1 expref: 35 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.729090:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454460928:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.729163:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.730196:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454460928:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.730223:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.730418:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.730618:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451864832 00000100:00100000:2.0:1762167007.730625:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451864832 00010000:00010000:2.0:1762167007.730655:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0aa34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f1 expref: 36 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.730690:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7499 00000100:00100000:2.0:1762167007.730695:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765451864832:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.730706:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.730724:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0aa34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f1 expref: 36 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.730736:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0aa34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f1 expref: 36 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.730754:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0aa34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38f1 expref: 36 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.730801:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.730803:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.730809:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.730819:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.730853:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167007.730881:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.730891:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.730900:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451864832:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 199us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.730911:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7499 00010000:00010000:0.0:1762167007.732141:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.732154:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.732163:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.732170:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2446c8000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.732174:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.732182:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.732196:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.732203:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0ab92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.732273:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765451864704:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3313us (3448us total) trans 0 rc 44628/44628 00000100:00100000:0.0:1762167007.732283:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2914 00000100:00100000:1.0:1762167007.734017:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.734075:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451864960 00000100:00100000:0.0:1762167007.734087:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451864960 00000100:00100000:0.0:1762167007.734148:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2915 00000100:00100000:0.0:1762167007.734158:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451864960:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167007.734194:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.734214:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0aa50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ff expref: 29 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.734222:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.734224:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.734227:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.734256:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0aa50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ff expref: 29 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.734274:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0aa50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ff expref: 29 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.734288:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454461056:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.734355:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.735614:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454461056:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.735636:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.735652:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.735745:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451865088 00000100:00100000:2.0:1762167007.735751:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451865088 00010000:00010000:2.0:1762167007.735810:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0aa50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ff expref: 30 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.735844:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7500 00000100:00100000:2.0:1762167007.735856:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451865088:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.735868:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.735890:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0aa50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ff expref: 30 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.735903:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0aa50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ff expref: 30 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.735922:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0aa50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb38ff expref: 30 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.735945:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.735947:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.735952:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.735961:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.735990:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.736031:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451865088:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 178us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.736039:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7500 00010000:00010000:0.0:1762167007.736054:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.736063:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.737523:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.737539:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.737547:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.737554:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480ed600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.737559:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.737568:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.737582:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.737589:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ab99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.738158:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451864960:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3997us (4143us total) trans 0 rc 44628/44628 00000100:00100000:0.0:1762167007.738173:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2915 00000100:00100000:1.0:1762167007.740373:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.740438:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451865216 00000100:00100000:0.0:1762167007.740448:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451865216 00000100:00100000:0.0:1762167007.740517:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2916 00000100:00100000:0.0:1762167007.740527:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451865216:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167007.740563:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.740581:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0aa6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb390d expref: 34 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.740590:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.740592:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.740595:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.740633:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0aa6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb390d expref: 34 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.740647:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0aa6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb390d expref: 34 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.740661:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454461184:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.740726:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.741745:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454461184:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.741800:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.742167:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.742212:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451865344 00000100:00100000:2.0:1762167007.742218:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451865344 00010000:00010000:2.0:1762167007.742247:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0aa6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb390d expref: 35 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.742282:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7501 00000100:00100000:2.0:1762167007.742291:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451865344:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.742306:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.742328:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0aa6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb390d expref: 35 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.742340:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0aa6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb390d expref: 35 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.742360:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0aa6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb390d expref: 35 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.742375:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.742386:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.742391:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.742400:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.742430:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.742476:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451865344:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 186us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.742484:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7501 00010000:00010000:0.0:1762167007.742548:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.742554:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.743973:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.743988:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.743996:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.744007:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.744011:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.744017:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.744028:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.744032:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0aba0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.744099:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451865216:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3571us (3729us total) trans 0 rc 44628/44628 00000100:00100000:0.0:1762167007.744109:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2916 00000100:00100000:3.0:1762167007.746978:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.747054:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451865472 00000100:00100000:0.0:1762167007.747065:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451865472 00000100:00100000:0.0:1762167007.747147:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2917 00000100:00100000:0.0:1762167007.747157:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451865472:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167007.747191:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.747210:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0aa88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb391b expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.747219:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.747222:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.747226:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.747263:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0aa88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb391b expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.747276:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0aa88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb391b expref: 33 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.747294:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454461312:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.747404:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.748817:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454461312:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.748844:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.749120:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.749163:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451865600 00000100:00100000:2.0:1762167007.749170:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451865600 00010000:00010000:2.0:1762167007.749198:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0aa88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb391b expref: 34 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.749236:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7502 00000100:00100000:2.0:1762167007.749246:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451865600:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.749259:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.749280:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0aa88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb391b expref: 34 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.749292:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0aa88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb391b expref: 34 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.749319:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0aa88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb391b expref: 34 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.749333:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.749335:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.749345:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.749357:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.749392:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.749434:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451865600:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 190us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.749441:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7502 00010000:00010000:0.0:1762167007.749491:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.749503:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.750719:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.750732:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.750739:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.750747:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef2800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.750751:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.750759:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.750805:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.750813:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0aba7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.750872:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451865472:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3715us (3903us total) trans 0 rc 44628/44628 00000100:00100000:0.0:1762167007.750882:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2917 00000100:00100000:1.0:1762167007.753247:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.753320:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451865728 00000100:00100000:0.0:1762167007.753336:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451865728 00000100:00100000:0.0:1762167007.753443:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2918 00000100:00100000:0.0:1762167007.753456:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451865728:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167007.753507:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.753532:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0aaa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3929 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.753541:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.753545:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.753548:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.753594:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0aaa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3929 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.753609:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0aaa4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3929 expref: 28 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.753626:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454461440:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.753726:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.755428:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454461440:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.755464:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.755581:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.755631:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451865856 00000100:00100000:2.0:1762167007.755639:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451865856 00010000:00010000:2.0:1762167007.755684:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0aaa4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3929 expref: 29 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.755733:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7503 00000100:00100000:2.0:1762167007.755743:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451865856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.755784:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.755804:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0aaa4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3929 expref: 29 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.755816:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0aaa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3929 expref: 29 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.755838:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0aaa4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3929 expref: 29 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.755852:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.755866:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.755871:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.755879:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.755909:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167007.755959:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451865856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 217us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.755970:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7503 00010000:00010000:0.0:1762167007.755996:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.756014:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.757391:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.757408:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.757416:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.757422:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.757427:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.757436:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.757447:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.757452:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.757526:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451865728:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4070us (4299us total) trans 0 rc 44628/44628 00000100:00100000:0.0:1762167007.757536:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2918 00000100:00100000:1.0:1762167007.759669:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.759750:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451865984 00000100:00100000:0.0:1762167007.759796:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451865984 00000100:00100000:0.0:1762167007.759866:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2919 00000100:00100000:0.0:1762167007.759875:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451865984:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167007.759917:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.759938:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0aac7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb393e expref: 32 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.759947:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.759949:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.759953:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.759991:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0aac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb393e expref: 32 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.760006:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0aac7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb393e expref: 32 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.760022:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454461568:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.760105:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167007.761684:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.761711:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454461568:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.761737:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451866112 00010000:00010000:0.0:1762167007.761740:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.761746:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451866112 00010000:00010000:2.0:1762167007.761815:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0aac7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb393e expref: 33 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.761861:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7504 00000100:00100000:2.0:1762167007.761870:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451866112:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.761884:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.761910:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0aac7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb393e expref: 33 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.761922:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0aac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb393e expref: 33 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.761942:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0aac7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb393e expref: 33 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.761956:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.761959:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.761963:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.761971:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.761999:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.762030:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.762040:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.762053:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451866112:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 182us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.762062:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7504 00010000:00010000:0.0:1762167007.763037:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.763051:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.763059:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.763067:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480ed600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.763072:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.763080:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.763094:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.763101:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.763166:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451865984:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3290us (3505us total) trans 0 rc 44628/44628 00000100:00100000:0.0:1762167007.763176:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2919 00000100:00100000:1.0:1762167007.765223:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.765310:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451866240 00000100:00100000:0.0:1762167007.765321:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451866240 00000100:00100000:0.0:1762167007.765419:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2920 00000100:00100000:0.0:1762167007.765431:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451866240:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167007.765475:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.765496:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0aaea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3953 expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.765506:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.765509:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.765512:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.765553:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0aaea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3953 expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.765570:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0aaea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3953 expref: 27 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.765587:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454461696:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.765678:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.766914:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454461696:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.766938:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.767082:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.767131:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451866368 00000100:00100000:2.0:1762167007.767137:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451866368 00010000:00010000:2.0:1762167007.767168:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0aaea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3953 expref: 28 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:2.0:1762167007.767206:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7505 00000100:00100000:2.0:1762167007.767228:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451866368:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167007.767243:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167007.767266:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0aaea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3953 expref: 28 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.767279:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0aaea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3953 expref: 28 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.767306:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0aaea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3953 expref: 28 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.767320:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.767322:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.767327:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.767336:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.767361:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.767391:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.767403:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.767419:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451866368:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 204us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.767428:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7505 00010000:00010000:0.0:1762167007.768411:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.768424:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.768432:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.768440:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.768444:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.768453:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.768466:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.768474:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.768558:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451866240:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3123us (3336us total) trans 0 rc 44628/44628 00000100:00100000:0.0:1762167007.768567:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2920 00000100:00100000:2.0:1762167007.770526:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.770573:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451866496 00000100:00100000:0.0:1762167007.770584:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451866496 00000100:00100000:0.0:1762167007.770645:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2921 00000100:00100000:0.0:1762167007.770652:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451866496:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167007.770697:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.770726:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0ab0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3968 expref: 31 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.770734:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.770737:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167007.770756:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.770830:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0ab0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3968 expref: 31 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.770845:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0ab0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3968 expref: 31 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.770859:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454461824:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.770941:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.771872:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454461824:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.771894:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.772150:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.772208:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451866624 00000100:00100000:1.0:1762167007.772214:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451866624 00010000:00010000:1.0:1762167007.772243:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0ab0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3968 expref: 32 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.772272:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7506 00000100:00100000:1.0:1762167007.772281:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451866624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.772292:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.772313:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0ab0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3968 expref: 32 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.772323:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0ab0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3968 expref: 32 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.772343:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0ab0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3968 expref: 32 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.772357:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.772360:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.772364:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.772373:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.772418:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167007.772463:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451866624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 183us (313us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167007.772465:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.772471:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7506 00010000:00010000:0.0:1762167007.772473:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.773433:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.773442:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.773450:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.773456:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167007.773461:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.773469:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.773483:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.773489:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.773555:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451866496:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2901us (3033us total) trans 0 rc 44628/44628 00000100:00100000:0.0:1762167007.773564:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2921 00000100:00100000:3.0:1762167007.780129:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.780219:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451866752 00000100:00100000:1.0:1762167007.780228:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451866752 00000100:00100000:1.0:1762167007.780276:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 647 00000100:00100000:1.0:1762167007.780283:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56206:x1847765451866752:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167007.780296:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.780319:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0ab7d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a0 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.780337:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167007.780341:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167007.780405:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56206:x1847765451866752:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 121us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.780410:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 647 00000100:00100000:2.0:1762167007.781435:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.781481:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451867008 00000100:00100000:0.0:1762167007.781486:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451867008 00000100:00100000:0.0:1762167007.781523:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7340 00000100:00100000:0.0:1762167007.781531:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56206:x1847765451867008:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167007.781756:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56206:x1847765451867008:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 225us (324us total) trans 8589952913 rc 0/0 00000100:00100000:0.0:1762167007.781787:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7340 00000100:00100000:2.0:1762167007.783920:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.783963:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451867264 00000100:00100000:0.0:1762167007.783971:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451867264 00000100:00100000:0.0:1762167007.784020:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19816 00000100:00100000:0.0:1762167007.784032:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451867264:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.784053:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.784072:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0abca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39a7 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.784158:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.784173:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3992 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.784180:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.784210:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3992 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.784223:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3992 expref: 897 pid: 30819 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.784236:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454461952:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.784308:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.785157:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454461952:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.785176:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.785373:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.785419:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451867392 00000100:00100000:1.0:1762167007.785424:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451867392 00010000:00010000:1.0:1762167007.785456:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3992 expref: 898 pid: 30819 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.785493:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7507 00000100:00100000:1.0:1762167007.785509:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451867392:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.785520:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.785526:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3992 expref: 898 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.785544:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3992 expref: 898 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.785562:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0ab5a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3992 expref: 898 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.785589:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167007.785593:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.785598:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.785602:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.785624:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.785649:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.785658:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167007.785660:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451867392:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 153us (286us total) trans 0 rc 0/0 00000004:00200000:0.0:1762167007.785682:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000100:00100000:1.0:1762167007.785691:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7507 00010000:00010000:0.0:1762167007.785827:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0abca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a7 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.785843:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a7 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.785851:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.785854:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167007.785858:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f5c00, rc 0) 00000100:00100000:0.0:1762167007.785891:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451867264:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1862us (1981us total) trans 8589952914 rc 0/0 00000100:00100000:0.0:1762167007.785898:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19816 00000100:00100000:2.0:1762167007.787416:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.787456:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451867520 00000100:00100000:0.0:1762167007.787462:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451867520 00000100:00100000:0.0:1762167007.787492:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19817 00000100:00100000:0.0:1762167007.787498:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451867520:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.787512:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.787523:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abdf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39ae expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.787570:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.787579:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a7 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.787584:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.787611:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a7 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.787623:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a7 expref: 898 pid: 30819 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.787635:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454462080:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.787696:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.788571:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454462080:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.788585:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.789029:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.789070:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451867648 00000100:00100000:1.0:1762167007.789074:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451867648 00010000:00010000:1.0:1762167007.789099:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a7 expref: 899 pid: 30819 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.789143:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7508 00000100:00100000:1.0:1762167007.789154:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2361:x1847765451867648:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.789165:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.789171:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a7 expref: 899 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.789182:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a7 expref: 899 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.789204:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0abd1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39a7 expref: 899 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.789215:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167007.789217:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.789223:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.789227:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.789244:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.789269:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.789277:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167007.789282:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451867648:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 128us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.789291:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7508 00000004:00200000:0.0:1762167007.789310:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 44628 00000004:00200000:0.0:1762167007.789315:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.789330:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.789355:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0abdf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39ae expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.789368:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39ae expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.789393:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.789396:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.789398:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3480ed600, rc 0) 00000100:00100000:0.0:1762167007.789431:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451867520:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1932us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.789439:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19817 00000100:00100000:2.0:1762167007.790622:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.790668:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451867776 00000100:00100000:3.0:1762167007.790673:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451867776 00000100:00100000:3.0:1762167007.790722:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16893 00000100:00100000:3.0:1762167007.790729:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2358:x1847765451867776:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167007.790741:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.790759:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0abed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39b5 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167007.790817:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81e:0x0] initial LVB size: 44628, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x203 00010000:00010000:3.0:1762167007.790835:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.790838:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167007.790845:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0abed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39b5 expref: 31 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.790862:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0abed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39b5 expref: 31 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167007.790874:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167007.790911:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765451867776:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 182us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.790917:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16893 00000100:00100000:3.0:1762167007.792403:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.792457:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451868032 00000100:00100000:0.0:1762167007.792464:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451868032 00000100:00100000:0.0:1762167007.792510:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7341 00000100:00100000:0.0:1762167007.792520:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451868032:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167007.792720:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451868032:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 201us (345us total) trans 8589952915 rc 0/0 00000100:00100000:0.0:1762167007.792728:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7341 00000100:00100000:2.0:1762167007.793726:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.793788:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451868288 00000100:00100000:0.0:1762167007.793793:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451868288 00000100:00100000:0.0:1762167007.793824:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19818 00000100:00100000:0.0:1762167007.793829:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451868288:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.793844:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.793847:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762167007.793873:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0abe6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39ae expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.793894:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ab68 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3999 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.793906:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0ab3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb398b expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.793915:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.793923:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.793934:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0abf4 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39bc expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.793966:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0abfb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.793979:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0abfb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.793987:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0abfb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:0.0:1762167007.794564:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5442, 88 off439256 00000004:00080000:0.0:1762167007.794572:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628586808580ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.794631:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5450, 88 off440312 00000004:00080000:0.0:1762167007.794639:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628586875686ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.794679:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5451, 88 off440400 00000004:00080000:0.0:1762167007.794685:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628586921879ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.794721:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5443, 88 off439344 00000004:00080000:0.0:1762167007.794726:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628586963544ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.794757:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5452, 88 off440488 00000004:00080000:0.0:1762167007.794783:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628587019758ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.794815:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5444, 88 off439432 00000004:00080000:0.0:1762167007.794820:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628587057044ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.794878:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5445, 88 off439520 00000004:00080000:0.0:1762167007.794883:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628587120273ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.794899:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5453, 88 off440576 00000004:00080000:0.0:1762167007.794903:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628587140696ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.794931:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5454, 88 off440664 00000004:00080000:0.0:1762167007.794933:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628587170690ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.794944:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5446, 88 off439608 00000004:00080000:0.0:1762167007.794948:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628587185095ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.794972:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5455, 88 off440752 00000004:00080000:0.0:1762167007.794976:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628587213756ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.795004:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5447, 88 off439696 00000004:00080000:0.0:1762167007.795008:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628587245570ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.795040:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5448, 88 off439784 00000004:00080000:0.0:1762167007.795045:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628587282286ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.795073:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5456, 88 off440840 00000004:00080000:0.0:1762167007.795077:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628587314774ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.795107:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5457, 88 off440928 00000004:00080000:0.0:1762167007.795111:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628587348214ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.795131:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5449, 88 off439872 00000004:00080000:0.0:1762167007.795135:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628587372836ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.795168:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5450, 88 off439960 00000004:00080000:0.0:1762167007.795172:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628587409714ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167007.795188:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5458, 88 off441016 00000004:00080000:0.0:1762167007.795193:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628587429758ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.795219:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5459, 88 off441104 00000004:00080000:0.0:1762167007.795225:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628587461759ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167007.795251:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5451, 88 off440048 00000004:00080000:0.0:1762167007.795254:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628587491599ns, next at 628532618837ns, rc = 0 00000001:00080000:3.0:1762167007.805555:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952916 is committed 00000004:00080000:3.0:1762167007.805571:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3559 committed 00000004:00080000:3.0:1762167007.805589:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3572 committed 00010000:00010000:2.0:1762167007.805591:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0abfb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39bc expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762167007.805611:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3571 committed 00010000:00010000:2.0:1762167007.805612:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba100) 00000004:00080000:3.0:1762167007.805618:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3558 committed 00010000:00010000:2.0:1762167007.805622:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:3.0:1762167007.805625:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3557 committed 00000004:00080000:3.0:1762167007.805633:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3570 committed 00000004:00080000:3.0:1762167007.805635:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3569 committed 00000004:00080000:3.0:1762167007.805638:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3556 committed 00000004:00080000:3.0:1762167007.805640:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3555 committed 00000004:00080000:3.0:1762167007.805646:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3568 committed 00000004:00080000:3.0:1762167007.805650:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3554 committed 00000004:00080000:3.0:1762167007.805656:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3567 committed 00010000:00010000:2.0:1762167007.805657:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2446c8000/0xf915a5bdf3d0abf4 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39bc expref: 897 pid: 30819 timeout: 0 lvb_type: 3 00000004:00080000:3.0:1762167007.805668:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3566 committed 00000004:00080000:3.0:1762167007.805680:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3553 committed 00000004:00080000:3.0:1762167007.805683:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3552 committed 00000004:00080000:3.0:1762167007.805691:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3565 committed 00000004:00080000:3.0:1762167007.805693:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3551 committed 00000004:00080000:3.0:1762167007.805695:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3564 committed 00000004:00080000:3.0:1762167007.805696:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3563 committed 00000004:00080000:3.0:1762167007.805698:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3550 committed 00010000:00010000:2.0:1762167007.805706:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0abfb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39bc expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.805793:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba100) 00010000:00010000:2.0:1762167007.805798:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762167007.805803:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2ca00, rc 0) 00000100:00100000:3.0:1762167007.805828:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454462208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.805934:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.805934:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451868288:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 12092us (12199us total) trans 8589952916 rc 0/0 00000100:00100000:2.0:1762167007.805957:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19818 00000100:00100000:3.0:1762167007.806011:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454462720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.806041:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454462592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.806055:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454462336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.806066:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.806104:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454463232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.806118:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.806167:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454462208 00000100:00100000:3.0:1762167007.806177:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454462208 00000100:00100000:1.0:1762167007.806185:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454462720 00000100:00100000:1.0:1762167007.806192:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454462720 00000100:00100000:0.0:1762167007.806200:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454463104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.806246:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.806276:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454462592 00000100:00100000:1.0:1762167007.806285:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454462592 00000100:00100000:0.0:1762167007.806294:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454463616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.806316:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454463104 00000100:00100000:2.0:1762167007.806326:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454463104 00000100:00100000:0.0:1762167007.806342:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.806344:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16894 00000100:00100000:3.0:1762167007.806357:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16895 00000100:00100000:1.0:1762167007.806363:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454462208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.806375:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454462720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.806397:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454463616 00000100:00100000:0.0:1762167007.806400:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454464128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.806405:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454463616 00000100:00100000:2.0:1762167007.806440:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16896 00000100:00100000:0.0:1762167007.806455:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.806460:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454462592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.806492:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1762167007.806506:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454462464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.806543:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.806570:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454462976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.806606:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.806630:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454463488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.806670:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.806699:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454464000:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167007.806718:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.806724:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.806729:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167007.806733:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.806736:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167007.806742:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167007.806751:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.806757:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.806800:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.806805:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.806809:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167007.806848:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454464128 00000100:00100000:0.0:1762167007.806855:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454464128 00000100:00100000:1.0:1762167007.806863:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454462208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 503us (937us total) trans 21474843344 rc 0/0 00000100:00100000:1.0:1762167007.806879:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16894 00000100:00100000:3.0:1762167007.806891:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454462720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 511us (816us total) trans 21474843343 rc 0/0 00000100:00100000:2.0:1762167007.806894:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3294:x1847765454462592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 442us (776us total) trans 21474843345 rc 0/0 00000100:00100000:0.0:1762167007.806898:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454462464 00000100:00100000:0.0:1762167007.806908:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454462464 00000100:00100000:1.0:1762167007.806912:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454462976 00000100:00100000:1.0:1762167007.806930:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454462976 00000100:00100000:2.0:1762167007.806932:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16896 00000100:00100000:0.0:1762167007.806934:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454463488 00000100:00100000:0.0:1762167007.806942:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454463488 00000100:00100000:3.0:1762167007.806951:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16895 00000100:00100000:0.0:1762167007.806975:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454464000 00000100:00100000:0.0:1762167007.806980:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454464000 00000100:00100000:2.0:1762167007.806986:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16897 00000100:00100000:2.0:1762167007.807004:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454463104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.807009:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16898 00000100:00100000:1.0:1762167007.807115:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16899 00000100:00100000:3.0:1762167007.807116:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454463616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.807133:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454464128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167007.807142:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167007.807143:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16900 00002000:00010000:2.0:1762167007.807150:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.807154:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167007.807157:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:0.0:1762167007.807161:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454462464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167007.807162:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167007.807211:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454463104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (966us total) trans 17179875800 rc 0/0 00000100:00100000:2.0:1762167007.807223:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16897 00000100:00100000:2.0:1762167007.807264:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16901 00000100:00100000:2.0:1762167007.807279:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454463488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167007.807433:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.807438:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.807439:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.807454:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.807455:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.807470:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.807470:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.807472:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.807490:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.807492:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.807493:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167007.807494:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454463616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 377us (1154us total) trans 17179875802 rc 0/0 00002000:00010000:2.0:1762167007.807502:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167007.807507:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1762167007.807519:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.807524:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167007.807525:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16898 00000100:00100000:0.0:1762167007.807563:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454462464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 406us (1016us total) trans 17179875801 rc 0/0 00000100:00100000:1.0:1762167007.807571:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454464128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 445us (1121us total) trans 21474843346 rc 0/0 00000100:00100000:3.0:1762167007.807575:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16902 00000100:00100000:0.0:1762167007.807587:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16900 00000100:00100000:3.0:1762167007.807595:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454462976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.807597:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454463488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 321us (924us total) trans 21474843347 rc 0/0 00000100:00100000:1.0:1762167007.807600:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16899 00000100:00100000:0.0:1762167007.807626:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16903 00000100:00100000:2.0:1762167007.807637:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16901 00000100:00100000:0.0:1762167007.807643:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454464000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.807853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167007.807864:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 44628 -> 44628 00000100:00100000:3.0:1762167007.807865:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3294:x1847765454462976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 277us (1259us total) trans 21474843348 rc 0/0 00002000:00010000:0.0:1762167007.807872:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.807883:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.807889:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:3.0:1762167007.807890:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16902 00000100:00100000:1.0:1762167007.807900:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454462848:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167007.807903:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167007.807916:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454462336 00000100:00100000:2.0:1762167007.807924:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454462336 00000100:00100000:0.0:1762167007.807979:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454464000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 334us (1232us total) trans 17179875803 rc 0/0 00000100:00100000:1.0:1762167007.807982:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.807994:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16904 00000100:00100000:0.0:1762167007.808009:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16903 00000100:00100000:2.0:1762167007.808014:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454462336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.808038:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454462848 00000100:00100000:3.0:1762167007.808049:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454462848 00000100:00100000:1.0:1762167007.808052:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454463360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.808103:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.808125:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454463360 00000100:00100000:3.0:1762167007.808130:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454463360 00000100:00100000:1.0:1762167007.808149:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454463872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.808160:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16905 00000100:00100000:0.0:1762167007.808176:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454462848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.808200:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16906 00000100:00100000:1.0:1762167007.808201:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.808216:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454463360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167007.808222:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.808230:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167007.808234:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167007.808237:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167007.808241:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.808277:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454463872 00000100:00100000:1.0:1762167007.808286:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454463872 00000100:00100000:2.0:1762167007.808313:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454462336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 302us (462us total) trans 17179875804 rc 0/0 00000100:00100000:1.0:1762167007.808325:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16907 00000100:00100000:2.0:1762167007.808336:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16904 00000100:00100000:1.0:1762167007.808345:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454463872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.808439:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454462848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 265us (466us total) trans 17179875805 rc 0/0 00000004:00080000:2.0:1762167007.808442:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317d180/2, rc 0, transno 17179875804 00000100:00100000:0.0:1762167007.808454:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16905 00000100:00100000:2.0:1762167007.808465:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454462336:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167007.808484:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317d500/2, rc 0, transno 17179875805 00000100:00100000:2.0:1762167007.808496:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454462848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.808572:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1762167007.808598:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454464384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.808614:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454463872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 271us (413us total) trans 21474843349 rc 0/0 00000100:00100000:3.0:1762167007.808621:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454463360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 404us (520us total) trans 17179875806 rc 0/0 00000100:00100000:1.0:1762167007.808625:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16907 00000100:00100000:3.0:1762167007.808635:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16906 00000004:00080000:0.0:1762167007.808640:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317ce00/2, rc 0, transno 17179875801 00000100:00100000:0.0:1762167007.808651:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454462464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.808675:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167007.808687:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c1f80/2, rc 0, transno 21474843348 00000100:00100000:0.0:1762167007.808717:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454462976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.808722:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454464384 00000100:00100000:2.0:1762167007.808729:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454464256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.808730:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454464384 00000004:00080000:0.0:1762167007.808741:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c0700/2, rc 0, transno 21474843347 00000100:00100000:0.0:1762167007.808748:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454463488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.808816:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16908 00000100:00100000:1.0:1762167007.808830:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454464384:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167007.808833:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f797b80/2, rc 0, transno 17179875803 00000100:00100000:3.0:1762167007.808845:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.808849:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454464000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167007.808870:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24732ed80/2, rc 0, transno 21474843346 00000100:00100000:0.0:1762167007.808877:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454464128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.808897:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451868416 00000100:00100000:2.0:1762167007.808904:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451868416 00000004:00080000:0.0:1762167007.808952:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c3480/2, rc 0, transno 21474843345 00000100:00100000:2.0:1762167007.808958:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16909 00000100:00100000:0.0:1762167007.808961:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454462592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.808978:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56065:x1847765451868416:12345-192.168.203.35@tcp:101:fsx.0 00000004:00080000:0.0:1762167007.808986:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03480/2, rc 0, transno 17179875800 00000100:00100000:0.0:1762167007.808992:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454463104:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167007.808997:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:0.0:1762167007.809012:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de01c00/2, rc 0, transno 17179875802 00000100:00100000:0.0:1762167007.809017:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454463616:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167007.809029:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ac02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39c3 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.809037:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454464384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (361us total) trans 17179875807 rc 0/0 00000100:00100000:1.0:1762167007.809056:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16908 00002000:00010000:2.0:1762167007.809063:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 44628, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x2f 00010000:00010000:2.0:1762167007.809092:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.809096:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.809107:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ac02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 114688->172031) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39c3 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.809122:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454464512:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762167007.809130:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ac02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 114688->172031) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39c3 expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.809149:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:1.0:1762167007.809166:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.809202:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451868416:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 232us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.809213:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16909 00000100:00100000:1.0:1762167007.809220:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762167007.809239:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454464640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.809242:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454464512 00000100:00100000:3.0:1762167007.809250:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454464512 00000100:00100000:1.0:1762167007.809271:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.809286:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454464640 00000100:00100000:3.0:1762167007.809290:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454464640 00000100:00100000:0.0:1762167007.809319:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16910 00000100:00100000:3.0:1762167007.809329:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16911 00000100:00100000:0.0:1762167007.809332:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454464512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.809344:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454464640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.809404:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.809458:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454464256 00000004:00080000:2.0:1762167007.809465:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de02680/2, rc 0, transno 17179875806 00000100:00100000:1.0:1762167007.809466:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454464256 00000100:00100000:2.0:1762167007.809477:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454463360:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167007.809505:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c2a00/2, rc 0, transno 21474843349 00000100:00100000:2.0:1762167007.809514:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454463872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.809521:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16912 00000100:00100000:1.0:1762167007.809543:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454464256:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167007.809564:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f331180/2, rc 0, transno 17179875807 00000100:00100000:2.0:1762167007.809573:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454464384:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167007.809596:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167007.809602:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454464512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 267us (430us total) trans 21474843350 rc 0/0 00002000:00010000:3.0:1762167007.809604:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.809612:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167007.809623:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16910 00002000:00010000:3.0:1762167007.809624:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:2.0:1762167007.809634:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167007.809635:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167007.809671:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454463232 00000100:00100000:0.0:1762167007.809677:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454463232 00000100:00100000:2.0:1762167007.809687:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454463744:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167007.809700:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167007.809701:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454464640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 360us (428us total) trans 21474843351 rc 0/0 00002000:00010000:1.0:1762167007.809707:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.809712:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:3.0:1762167007.809714:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16911 00002000:00010000:1.0:1762167007.809718:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.809723:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167007.809725:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16913 00000100:00100000:2.0:1762167007.809736:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.809749:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454463232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.809828:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454463744 00000100:00100000:3.0:1762167007.809835:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454463744 00000100:00100000:1.0:1762167007.809836:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454464256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 294us (432us total) trans 17179875808 rc 0/0 00000100:00100000:1.0:1762167007.809850:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16912 00000004:00080000:2.0:1762167007.809855:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b01880/2, rc 0, transno 21474843344 00000100:00100000:2.0:1762167007.809866:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454462208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.809882:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16914 00000100:00100000:3.0:1762167007.809896:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454463744:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167007.809896:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c1c00/2, rc 0, transno 21474843343 00000100:00100000:2.0:1762167007.809914:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454462720:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167007.809961:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f331880/2, rc 0, transno 17179875808 00002000:00010000:0.0:1762167007.809961:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.809974:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00000100:00100000:2.0:1762167007.809976:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454464256:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167007.809981:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167007.809988:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.809991:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167007.810022:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.810025:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.810027:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167007.810029:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.810032:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167007.810039:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454463232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 296us (422us total) trans 21474843352 rc 0/0 00000100:00100000:0.0:1762167007.810048:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16913 00000004:00080000:2.0:1762167007.810065:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c0380/2, rc 0, transno 21474843352 00000100:00100000:3.0:1762167007.810073:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454463744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (341us total) trans 17179875809 rc 0/0 00000100:00100000:2.0:1762167007.810082:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454463232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.810093:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16914 00000004:00080000:2.0:1762167007.810123:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f796680/2, rc 0, transno 17179875809 00000100:00100000:2.0:1762167007.810130:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454463744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167007.810140:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc31f80/2, rc 0, transno 21474843351 00000100:00100000:0.0:1762167007.810149:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454464640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167007.810165:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f330e00/2, rc 0, transno 21474843350 00000100:00100000:0.0:1762167007.810168:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454464512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.811330:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.811442:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451868544 00000100:00100000:0.0:1762167007.811447:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451868544 00000100:00100000:0.0:1762167007.811489:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19819 00000100:00100000:0.0:1762167007.811498:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451868544:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.811515:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.811537:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac09 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39ca expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.811631:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac10 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.811646:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.811667:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167007.811696:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 170512 00000004:00200000:0.0:1762167007.811701:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.811717:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.811741:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac09 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39ca expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.811759:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39ca expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.811819:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba100) 00010000:00010000:0.0:1762167007.811823:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.811827:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2ce00, rc 0) 00000100:00100000:0.0:1762167007.811876:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451868544:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 379us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.811883:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19819 00000100:00100000:2.0:1762167007.814397:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.814494:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451868672 00000100:00100000:0.0:1762167007.814504:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451868672 00002000:00100000:0.0:1762167007.814549:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->106495) req@ffff9ee343719c00 x1847765451868672/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.814561:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343719c00 with x1847765451868672 ext(102400->106495) 00002000:00010000:0.0:1762167007.814567:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee343719c00 00000100:00100000:0.0:1762167007.814604:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2922 00000100:00100000:0.0:1762167007.814619:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451868672:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167007.814894:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451868672:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 280us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.814905:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2922 00002000:00100000:0.0:1762167007.814912:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->106495) req@ffff9ee343719c00 x1847765451868672/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/440 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.814920:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343719c00 with x1847765451868672 ext(102400->106495) 00002000:00010000:0.0:1762167007.814923:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee343719c00 00000100:00100000:3.0:1762167007.817084:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.817150:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451868800 00000100:00100000:0.0:1762167007.817166:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451868800 00002000:00100000:0.0:1762167007.817233:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (106496->110591) req@ffff9ee347b05180 x1847765451868800/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.817245:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b05180 with x1847765451868800 ext(106496->110591) 00002000:00010000:0.0:1762167007.817252:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b05180 00000100:00100000:0.0:1762167007.817298:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2923 00000100:00100000:0.0:1762167007.817307:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451868800:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167007.817629:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451868800:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 322us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.817638:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2923 00002000:00100000:0.0:1762167007.817646:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (106496->110591) req@ffff9ee347b05180 x1847765451868800/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/440 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.817654:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b05180 with x1847765451868800 ext(106496->110591) 00002000:00010000:0.0:1762167007.817657:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b05180 00000100:00100000:2.0:1762167007.819642:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.819707:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451868928 00000100:00100000:0.0:1762167007.819721:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451868928 00002000:00100000:0.0:1762167007.819803:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->114687) req@ffff9ee343718000 x1847765451868928/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 504/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.819815:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343718000 with x1847765451868928 ext(81920->114687) 00002000:00010000:0.0:1762167007.819822:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee343718000 00000100:00100000:0.0:1762167007.819864:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2924 00000100:00100000:0.0:1762167007.819874:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451868928:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167007.821004:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451868928:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1127us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.821015:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2924 00002000:00100000:3.0:1762167007.821024:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->114687) req@ffff9ee343718000 x1847765451868928/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 504/440 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167007.821034:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343718000 with x1847765451868928 ext(81920->114687) 00002000:00010000:3.0:1762167007.821038:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee343718000 00000100:00100000:3.0:1762167007.822407:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.822466:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451869056 00000100:00100000:0.0:1762167007.822474:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451869056 00002000:00100000:0.0:1762167007.822508:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->170510) req@ffff9ee347b07100 x1847765451869056/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.822517:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b07100 with x1847765451869056 ext(102400->170510) 00002000:00010000:0.0:1762167007.822522:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b07100 00000100:00100000:0.0:1762167007.822551:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2925 00000100:00100000:0.0:1762167007.822560:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451869056:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:0.0:1762167007.824231:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451869056:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 1665us (1822us total) trans 21474843353 rc 0/0 00000100:00100000:0.0:1762167007.824245:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2925 00002000:00100000:0.0:1762167007.824258:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->170510) req@ffff9ee347b07100 x1847765451869056/t21474843353(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/448 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.824268:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b07100 with x1847765451869056 ext(102400->170510) 00002000:00010000:0.0:1762167007.824274:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b07100 00000100:00100000:2.0:1762167007.825432:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.825484:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451869184 00000100:00100000:3.0:1762167007.825492:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451869184 00000100:00100000:3.0:1762167007.825542:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16915 00000100:00100000:3.0:1762167007.825551:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451869184:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:3.0:1762167007.838346:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843353 is committed 00000001:00080000:3.0:1762167007.838368:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843352 is committed 00000100:00100000:1.0:1762167007.838473:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451869184:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 12917us (13039us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.838486:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16915 00000100:00100000:3.0:1762167007.840954:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.841028:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451869312 00000100:00100000:0.0:1762167007.841039:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451869312 00002000:00100000:0.0:1762167007.841088:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (28672->81919) req@ffff9ee347b06300 x1847765451869312/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.841100:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b06300 with x1847765451869312 ext(28672->81919) 00002000:00010000:0.0:1762167007.841106:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b06300 00000100:00100000:0.0:1762167007.841138:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2926 00000100:00100000:0.0:1762167007.841150:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451869312:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167007.842530:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451869312:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1376us (1579us total) trans 0 rc 53248/53248 00000100:00100000:0.0:1762167007.842542:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2926 00002000:00100000:0.0:1762167007.842552:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (28672->81919) req@ffff9ee347b06300 x1847765451869312/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/440 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.842561:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b06300 with x1847765451869312 ext(28672->81919) 00002000:00010000:0.0:1762167007.842566:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b06300 00000100:00100000:2.0:1762167007.845076:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.845141:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451869440 00000100:00100000:0.0:1762167007.845152:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451869440 00002000:00100000:0.0:1762167007.845193:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (16384->28671) req@ffff9ee343718380 x1847765451869440/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.845205:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343718380 with x1847765451869440 ext(16384->28671) 00002000:00010000:0.0:1762167007.845210:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee343718380 00000100:00100000:0.0:1762167007.845241:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2927 00000100:00100000:0.0:1762167007.845250:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451869440:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167007.845496:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451869440:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 246us (425us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1762167007.845506:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2927 00002000:00100000:0.0:1762167007.845514:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (16384->28671) req@ffff9ee343718380 x1847765451869440/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/12728 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167007.845521:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343718380 with x1847765451869440 ext(16384->28671) 00002000:00010000:0.0:1762167007.845524:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee343718380 00000100:00100000:3.0:1762167007.847651:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.847800:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451869696 00000100:00100000:0.0:1762167007.847809:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451869696 00000100:00100000:0.0:1762167007.847863:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19820 00000100:00100000:0.0:1762167007.847870:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451869696:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167007.847911:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167007.847933:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac10 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39ca expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.847950:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0abfb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39bc expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.847957:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba100) 00010000:00010000:0.0:1762167007.847965:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167007.848215:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.848228:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.848238:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167007.848293:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952917 00000004:00010000:0.0:1762167007.848320:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004f7e1e86 reply state 0000000077acab06 transno 8589952918 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167007.848332:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167007.848442:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451869696:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 570us (797us total) trans 8589952918 rc 0/0 00000100:00100000:0.0:1762167007.848449:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19820 00000020:00080000:0.0:1762167007.848455:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167007.849629:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.849642:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.849648:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.849654:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372a2de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167007.849658:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.849665:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.849678:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bbad00) 00010000:00010000:0.0:1762167007.849681:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167007.849684:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.849689:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac17 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167007.849969:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.850024:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451869824 00000100:00100000:0.0:1762167007.850033:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451869824 00000100:00100000:0.0:1762167007.850078:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19821 00000100:00100000:0.0:1762167007.850085:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451869824:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.850099:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.850111:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ac1e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39d1 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.850158:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ac1e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d1 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.850171:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ac1e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d1 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.850188:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.850190:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167007.850193:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2c000, rc 0) 00000100:00100000:0.0:1762167007.850239:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451869824:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 154us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.850243:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19821 00000100:00100000:2.0:1762167007.851905:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.851946:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.851962:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451869952 00000100:00100000:0.0:1762167007.851971:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451869952 00000100:00100000:2.0:1762167007.851977:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:0.0:1762167007.852000:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (45050->18446744073709551615) 00002000:00100000:0.0:1762167007.852008:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34371b100 with x1847765451869952 ext(45050->18446744073709551615) 00002000:00010000:0.0:1762167007.852018:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34371b100. 00000100:00100000:0.0:1762167007.852048:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451870080 00000100:00100000:0.0:1762167007.852052:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451870080 00000100:00100000:1.0:1762167007.852059:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451870208 00002000:00010000:0.0:1762167007.852067:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:1.0:1762167007.852073:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451870208 00000100:00100000:2.0:1762167007.852074:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2928 00002000:00100000:0.0:1762167007.852074:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343719f80 with x1847765451870080 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.852087:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee343719f80. 00000100:00100000:2.0:1762167007.852093:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451869952:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167007.852110:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:0.0:1762167007.852112:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2929 00002000:00100000:1.0:1762167007.852119:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443caa00 with x1847765451870208 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167007.852131:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451870080:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167007.852132:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443caa00. 00000100:00100000:1.0:1762167007.852166:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2930 00000100:00100000:1.0:1762167007.852179:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451870208:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:0.0:1762167007.852447:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.852454:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:0.0:1762167007.852457:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.852460:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00010000:0.0:1762167007.852462:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167007.852523:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451870080:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 393us (571us total) trans 17179875810 rc 0/0 00000100:00100000:0.0:1762167007.852534:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2929 00002000:00010000:0.0:1762167007.852547:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167007.852554:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee343719f80 with x1847765451870080 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167007.852562:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee343719f80. 00002000:00010000:1.0:1762167007.852615:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.852620:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167007.852624:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.852627:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167007.852630:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.852702:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451870208:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 525us (723us total) trans 21474843354 rc 0/0 00000100:00100000:1.0:1762167007.852712:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2930 00002000:00010000:1.0:1762167007.852716:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167007.852720:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443caa00 with x1847765451870208 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167007.852729:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443caa00. 00002000:00010000:2.0:1762167007.852871:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 44628 -> 45050 00002000:00010000:2.0:1762167007.852875:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:2.0:1762167007.852877:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167007.852879:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00010000:2.0:1762167007.852881:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 185 00000100:00100000:2.0:1762167007.852914:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451869952:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 827us (1012us total) trans 21474843355 rc 0/0 00000100:00100000:2.0:1762167007.852919:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2928 00002000:00010000:2.0:1762167007.852923:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (45050->18446744073709551615) 00002000:00100000:2.0:1762167007.852925:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34371b100 with x1847765451869952 ext(45050->18446744073709551615) 00002000:00010000:2.0:1762167007.852929:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34371b100. 00000100:00100000:3.0:1762167007.854233:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.854283:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451870336 00000100:00100000:0.0:1762167007.854290:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451870336 00000100:00100000:0.0:1762167007.854325:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19822 00000100:00100000:0.0:1762167007.854332:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451870336:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167007.854344:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.854362:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0ac25 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39d8 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.854444:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.854457:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.854467:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167007.854499:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:0.0:1762167007.854504:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.854520:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.854544:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0ac25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d8 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.854563:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d8 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.854572:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.854575:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.854578:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37299e400, rc 0) 00000100:00100000:0.0:1762167007.854629:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451870336:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 297us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.854635:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19822 00000100:00100000:3.0:1762167007.856738:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.856804:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451870464 00000100:00100000:2.0:1762167007.856812:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451870464 00002000:00100000:2.0:1762167007.856855:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->16383) req@ffff9ee348255c00 x1847765451870464/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/0 e 0 to 0 dl 1762167018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167007.856865:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348255c00 with x1847765451870464 ext(4096->16383) 00002000:00010000:2.0:1762167007.856870:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348255c00 00000100:00100000:2.0:1762167007.856905:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2931 00000100:00100000:2.0:1762167007.856914:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451870464:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167007.857140:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451870464:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 225us (413us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1762167007.857148:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2931 00002000:00100000:2.0:1762167007.857156:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->16383) req@ffff9ee348255c00 x1847765451870464/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:38/0 lens 488/12728 e 0 to 0 dl 1762167018 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167007.857170:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348255c00 with x1847765451870464 ext(4096->16383) 00002000:00010000:2.0:1762167007.857174:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348255c00 00000100:00100000:2.0:1762167007.860167:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.860222:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451870720 00000100:00100000:0.0:1762167007.860231:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451870720 00000100:00100000:0.0:1762167007.860279:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7342 00000100:00100000:0.0:1762167007.860286:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451870720:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167007.860603:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451870720:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 316us (448us total) trans 8589952919 rc 0/0 00000100:00100000:0.0:1762167007.860612:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7342 00000100:00100000:3.0:1762167007.869588:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.869663:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451870848 00000100:00100000:0.0:1762167007.869674:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451870848 00000100:00100000:0.0:1762167007.869730:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19823 00000100:00100000:0.0:1762167007.869738:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56207:x1847765451870848:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.869758:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.869796:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0ac33 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39df expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.869885:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac3a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.869899:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac3a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.869911:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac3a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.869922:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ac41 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.869926:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ac41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.869932:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ac41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870052:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac48 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870058:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870063:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167007.870094:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:0.0:1762167007.870099:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.870117:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870128:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870135:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac3a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870141:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac3a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870148:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac3a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870152:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372a2de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167007.870156:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac3a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870162:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac3a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870172:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167007.870175:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167007.870178:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac3a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870183:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ac3a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870197:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ac41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870202:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ac41 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870210:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ac41 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870214:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372a2ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167007.870216:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ac41 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870221:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ac41 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870227:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee242bbad00) 00010000:00010000:0.0:1762167007.870230:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167007.870232:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ac41 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870238:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ac41 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.870263:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0ac33 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39df expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.870275:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac48 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39df expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.870280:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.870281:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.870283:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2ce00, rc 0) 00000100:00100000:0.0:1762167007.870329:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56207:x1847765451870848:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 593us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.870333:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19823 00000100:00100000:3.0:1762167007.871639:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.871697:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451870976 00000100:00100000:1.0:1762167007.871705:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451870976 00000100:00100000:1.0:1762167007.871795:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 648 00000100:00100000:1.0:1762167007.871818:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765451870976:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.871832:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.871851:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ac48 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39df expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.871872:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167007.871876:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167007.871919:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765451870976:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 116us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.871928:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 648 00000100:00100000:2.0:1762167007.872076:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.872121:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451871232 00000100:00100000:0.0:1762167007.872127:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451871232 00000100:00100000:0.0:1762167007.872160:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19824 00000100:00100000:0.0:1762167007.872168:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56207:x1847765451871232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.872181:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.872195:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ac4f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39e6 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.872297:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.872310:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d8 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.872319:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.872354:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d8 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.872367:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d8 expref: 895 pid: 30819 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.872394:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454464768:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.872464:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.873470:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454464768:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.873504:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.873785:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.873845:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451871360 00000100:00100000:1.0:1762167007.873853:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451871360 00010000:00010000:1.0:1762167007.873990:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d8 expref: 896 pid: 30819 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.874027:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7509 00000100:00100000:1.0:1762167007.874038:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451871360:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.874051:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.874057:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d8 expref: 896 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.874070:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d8 expref: 896 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.874088:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0ac2c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d8 expref: 896 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.874102:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167007.874106:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.874112:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.874117:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.874142:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167007.874172:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451871360:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 138us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.874178:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7509 00010000:00010000:0.0:1762167007.874250:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.874258:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167007.874273:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00010000:00010000:0.0:1762167007.874424:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ac4f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39e6 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.874440:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39e6 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.874449:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.874456:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167007.874458:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f0ce00, rc 0) 00000100:00100000:0.0:1762167007.874506:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56207:x1847765451871232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2338us (2430us total) trans 8589952920 rc 0/0 00000100:00100000:0.0:1762167007.874513:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19824 00000100:00100000:2.0:1762167007.875814:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.875852:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451871488 00000100:00100000:0.0:1762167007.875860:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451871488 00000100:00100000:0.0:1762167007.875902:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19825 00000100:00100000:0.0:1762167007.875911:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56207:x1847765451871488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.875931:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.875953:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0d600/0xf915a5bdf3d0ac64 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39ed expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.876020:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.876032:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39e6 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.876040:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.876069:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39e6 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.876082:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39e6 expref: 896 pid: 30819 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.876094:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454464896:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.876154:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167007.877173:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454464896:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167007.877192:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167007.877332:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.877392:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451871616 00000100:00100000:1.0:1762167007.877398:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451871616 00010000:00010000:1.0:1762167007.877424:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39e6 expref: 897 pid: 30819 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.877454:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7510 00000100:00100000:1.0:1762167007.877462:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451871616:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.877483:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167007.877490:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39e6 expref: 897 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.877501:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39e6 expref: 897 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.877520:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0ce00/0xf915a5bdf3d0ac56 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39e6 expref: 897 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.877534:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167007.877538:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.877551:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.877558:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.877585:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167007.877630:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765451871616:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 168us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.877637:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7510 00010000:00010000:0.0:1762167007.877692:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.877698:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167007.877728:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:0.0:1762167007.877732:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167007.877747:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.877818:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0d600/0xf915a5bdf3d0ac64 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39ed expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.877838:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39ed expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.877845:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.877847:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167007.877850:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f0c800, rc 0) 00000100:00100000:0.0:1762167007.877880:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56207:x1847765451871488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1971us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.877887:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19825 00000100:00100000:2.0:1762167007.879599:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.879644:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451871872 00000100:00100000:0.0:1762167007.879651:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451871872 00000100:00100000:0.0:1762167007.879697:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19826 00000100:00100000:0.0:1762167007.879706:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56207:x1847765451871872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.879726:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167007.879742:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0d400/0xf915a5bdf3d0ac72 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39f4 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.879856:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0da00/0xf915a5bdf3d0ac79 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.879869:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0da00/0xf915a5bdf3d0ac79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167007.879878:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0da00/0xf915a5bdf3d0ac79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167007.879889:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00010000:00010000:0.0:1762167007.880018:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0d400/0xf915a5bdf3d0ac72 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39f4 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.880036:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0da00/0xf915a5bdf3d0ac79 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39f4 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.880044:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167007.880046:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167007.880049:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f0da00, rc 0) 00000100:00100000:0.0:1762167007.880103:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56207:x1847765451871872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 398us (509us total) trans 8589952921 rc 0/0 00000100:00100000:0.0:1762167007.880114:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19826 00000100:00100000:3.0:1762167007.881793:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.881824:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.881860:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451872000 00000100:00100000:3.0:1762167007.881869:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.881869:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451872000 00000100:00100000:1.0:1762167007.881916:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451872128 00000100:00100000:1.0:1762167007.881920:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451872128 00000100:00100000:2.0:1762167007.881921:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451872256 00000100:00100000:2.0:1762167007.881928:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451872256 00000100:00100000:3.0:1762167007.881941:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16916 00000100:00100000:1.0:1762167007.881953:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16917 00000100:00100000:3.0:1762167007.881956:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451872000:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167007.881966:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451872128:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167007.881974:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16918 00000100:00100000:2.0:1762167007.881986:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451872256:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167007.882001:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.882002:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.882011:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.882030:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 32 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.882031:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ac02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->172031) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39c3 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.882036:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 20 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.882055:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167007.882056:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167007.882058:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167007.882060:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167007.882060:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167007.882061:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167007.882066:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.882068:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.882069:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.882110:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ac02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->172031) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39c3 expref: 20 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.882115:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 20 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.882116:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 32 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.882139:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ac02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->172031) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39c3 expref: 20 pid: 26444 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.882163:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 20 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.882168:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 32 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1762167007.882199:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454465280:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167007.882200:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348256d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454465024:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.882200:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454465152:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167007.882296:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167007.882297:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3639ac000 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.882297:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e840 going to sleep for 11 seconds 00000100:00100000:1.0:1762167007.884365:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454465280:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167007.884374:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454465152:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167007.884385:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348256d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454465024:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167007.884405:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.884413:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.884416:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167007.884712:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.884749:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.884813:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451872384 00000100:00100000:0.0:1762167007.884821:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451872384 00000100:00100000:1.0:1762167007.884844:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451872512 00000100:00100000:1.0:1762167007.884850:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451872512 00010000:00010000:0.0:1762167007.884852:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 33 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.884872:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 21 pid: 7858 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167007.884897:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7511 00000100:00100000:0.0:1762167007.884904:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451872384:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762167007.884916:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7512 00010000:00010000:0.0:1762167007.884916:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762167007.884937:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451872512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167007.884941:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 33 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.884950:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.884956:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 33 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.884969:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 21 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.884983:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0ab29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb397d expref: 33 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.884984:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 21 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.885017:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0ab30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3984 expref: 21 pid: 7858 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.885017:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.885021:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.885028:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.885039:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885040:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.885044:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.885050:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885058:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.885074:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167007.885082:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167007.885137:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451872384:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 231us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.885139:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451872512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 210us (387us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167007.885148:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.885156:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7511 00010000:00010000:2.0:1762167007.885175:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.885175:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7512 00010000:00010000:2.0:1762167007.885225:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885233:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.885235:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885270:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.885270:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167007.885274:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.885297:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.885304:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.885308:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451872640 00010000:00010000:1.0:1762167007.885309:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.885317:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451872640 00010000:00010000:2.0:1762167007.885321:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885331:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.885337:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ac02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 114688->172031) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39c3 expref: 20 pid: 26444 timeout: 728 lvb_type: 0 00010000:00010000:2.0:1762167007.885350:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885359:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.885385:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0ac95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885388:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a200 already unused, calling callback (ffffffffc1709320) 00000100:00100000:0.0:1762167007.885397:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7513 00010000:00010000:1.0:1762167007.885400:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167007.885417:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451872640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167007.885430:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.885430:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167007.885447:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ac02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 114688->172031) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39c3 expref: 20 pid: 26444 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1762167007.885451:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885471:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0ac87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.885479:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ac02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 114688->172031) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39c3 expref: 20 pid: 26444 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.885497:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ac02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 114688->172031) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39c3 expref: 20 pid: 26444 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167007.885511:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.885513:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.885517:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.885524:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.885545:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167007.885554:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451872128:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3590us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.885564:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451872256:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3571us (3684us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167007.885577:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451872640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 159us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.885578:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16917 00000100:00100000:2.0:1762167007.885590:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16918 00000100:00100000:0.0:1762167007.885593:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7513 00010000:00010000:1.0:1762167007.885627:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885639:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885655:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885662:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885669:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885675:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.885679:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885686:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885696:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.885703:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0ac8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.885746:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451872000:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3797us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.885754:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16916 00000100:00100000:0.0:1762167007.886854:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.886914:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451872896 00000100:00100000:2.0:1762167007.886924:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451872896 00000100:00100000:2.0:1762167007.886976:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19827 00000100:00100000:2.0:1762167007.886983:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56207:x1847765451872896:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167007.887044:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762167007.887074:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0c800/0xf915a5bdf3d0ac6b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39ed expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.887098:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ac1e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39d1 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.887109:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:2.0:1762167007.887113:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167007.887154:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.887168:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167007.887177:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:2.0:1762167007.887901:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5452, 88 off440136 00000004:00080000:2.0:1762167007.887913:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628680149239ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.887987:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5460, 88 off441192 00000004:00080000:2.0:1762167007.887994:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628680231315ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.888055:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5461, 88 off441280 00000004:00080000:2.0:1762167007.888063:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628680300029ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.888123:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5453, 88 off440224 00000004:00080000:2.0:1762167007.888131:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628680367478ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.888168:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5462, 88 off441368 00000004:00080000:2.0:1762167007.888173:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628680409964ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.888209:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5454, 88 off440312 00000004:00080000:2.0:1762167007.888213:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628680450394ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.888239:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5455, 88 off440400 00000004:00080000:2.0:1762167007.888243:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628680480383ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.888260:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5463, 88 off441456 00000004:00080000:2.0:1762167007.888264:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628680501277ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.888278:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5464, 88 off441544 00000004:00080000:2.0:1762167007.888282:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628680518893ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.888297:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5456, 88 off440488 00000004:00080000:2.0:1762167007.888302:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628680539694ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.888318:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5465, 88 off441632 00000004:00080000:2.0:1762167007.888324:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628680560734ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.888351:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5457, 88 off440576 00000004:00080000:2.0:1762167007.888355:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628680592635ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.888389:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5458, 88 off440664 00000004:00080000:2.0:1762167007.888393:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628680630517ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.888426:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5466, 88 off441720 00000004:00080000:2.0:1762167007.888430:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628680667213ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.888455:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5467, 88 off441808 00000004:00080000:2.0:1762167007.888459:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628680696547ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.888477:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5459, 88 off440752 00000004:00080000:2.0:1762167007.888481:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628680718469ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.888496:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5460, 88 off440840 00000004:00080000:2.0:1762167007.888500:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628680737084ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167007.888516:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5468, 88 off441896 00000004:00080000:2.0:1762167007.888519:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628680756148ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.888543:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5469, 88 off441984 00000004:00080000:2.0:1762167007.888548:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628680785083ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167007.888569:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5461, 88 off440928 00000004:00080000:2.0:1762167007.888572:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628680809519ns, next at 628532618837ns, rc = 0 00000004:00010000:3.0:1762167007.900314:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007dba7424 reply state 000000006a2e1662 transno 8589952922 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167007.900334:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167007.900476:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56207:x1847765451872896:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 13488us (13621us total) trans 8589952922 rc 0/0 00000100:00100000:3.0:1762167007.900489:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19827 00000001:00080000:2.0:1762167007.900495:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952921 is committed 00000001:00080000:2.0:1762167007.900544:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952922 is committed 00000004:00080000:2.0:1762167007.900550:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3569 committed 00000004:00080000:2.0:1762167007.900570:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3582 committed 00000004:00080000:2.0:1762167007.900581:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3581 committed 00000004:00080000:2.0:1762167007.900584:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3568 committed 00000004:00080000:2.0:1762167007.900586:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3567 committed 00000004:00080000:2.0:1762167007.900589:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3580 committed 00000004:00080000:2.0:1762167007.900592:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3579 committed 00000004:00080000:2.0:1762167007.900596:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3566 committed 00000004:00080000:2.0:1762167007.900598:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3565 committed 00000004:00080000:2.0:1762167007.900601:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3578 committed 00000004:00080000:2.0:1762167007.900603:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3564 committed 00000004:00080000:2.0:1762167007.900606:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3577 committed 00000004:00080000:2.0:1762167007.900610:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3576 committed 00000004:00080000:2.0:1762167007.900612:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3563 committed 00000004:00080000:2.0:1762167007.900614:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3562 committed 00000004:00080000:2.0:1762167007.900617:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3575 committed 00000004:00080000:2.0:1762167007.900620:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3561 committed 00000004:00080000:2.0:1762167007.900623:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3574 committed 00000004:00080000:2.0:1762167007.900625:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3573 committed 00000004:00080000:2.0:1762167007.900627:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3560 committed 00010000:00010000:1.0:1762167007.900706:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.900726:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.900738:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167007.900742:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454465408:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762167007.900811:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167007.900820:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.900830:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167007.900848:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762167007.900861:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167007.900868:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167007.900877:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167007.900888:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0ac9c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167007.900894:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454465920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.900897:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454465536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.900948:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.900955:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454465664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.900993:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454466432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.901010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.901015:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454465792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.901058:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454465408 00000100:00100000:0.0:1762167007.901067:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454465408 00000100:00100000:2.0:1762167007.901077:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.901108:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454465920 00000100:00100000:1.0:1762167007.901110:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454466048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.901117:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454465920 00000100:00100000:0.0:1762167007.901117:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454465536 00000100:00100000:2.0:1762167007.901123:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454466304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.901132:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454465536 00000100:00100000:3.0:1762167007.901157:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454465792 00000100:00100000:3.0:1762167007.901161:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454465792 00000100:00100000:0.0:1762167007.901176:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16919 00000100:00100000:0.0:1762167007.901191:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3295:x1847765454465408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.901201:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.901207:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16920 00000100:00100000:2.0:1762167007.901216:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16921 00000100:00100000:3.0:1762167007.901230:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1847765454465920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.901232:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3296:x1847765454465536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.901258:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454466560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.901304:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.901335:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454467072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.901388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.901418:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762167007.901428:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454466944:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167007.901464:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167007.901478:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167007.901478:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167007.901490:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762167007.901493:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167007.901496:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167007.901541:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3296:x1847765454465536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 312us (540us total) trans 17179875812 rc 0/0 00000100:00100000:3.0:1762167007.901545:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454465920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 327us (596us total) trans 17179875813 rc 0/0 00000004:00080000:1.0:1762167007.901554:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb4700/2, rc 0, transno 17179875812 00000100:00100000:2.0:1762167007.901556:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16921 00000100:00100000:0.0:1762167007.901557:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454465408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 367us (708us total) trans 17179875811 rc 0/0 00000100:00100000:3.0:1762167007.901569:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16920 00000100:00100000:0.0:1762167007.901577:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16919 00000100:00100000:1.0:1762167007.901579:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454465536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.901583:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454466048 00000100:00100000:2.0:1762167007.901593:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454466048 00000100:00100000:3.0:1762167007.901597:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454466560 00000100:00100000:3.0:1762167007.901604:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454466560 00000100:00100000:0.0:1762167007.901613:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454467072 00000100:00100000:0.0:1762167007.901619:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454467072 00000100:00100000:2.0:1762167007.901625:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454466944 00000100:00100000:2.0:1762167007.901631:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454466944 00000100:00100000:3.0:1762167007.901632:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16922 00000100:00100000:3.0:1762167007.901644:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3294:x1847765454465792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.901655:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16923 00000100:00100000:2.0:1762167007.901662:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16924 00000100:00100000:0.0:1762167007.901667:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454466048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.901676:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454466560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167007.901796:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.901800:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.901804:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167007.901807:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.901810:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167007.901886:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167007.902012:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb5180/2, rc 0, transno 17179875811 00000100:00100000:1.0:1762167007.902025:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454465408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.902031:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454466560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 353us (722us total) trans 21474843357 rc 0/0 00000100:00100000:0.0:1762167007.902031:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454466048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 358us (827us total) trans 21474843356 rc 0/0 00000100:00100000:3.0:1762167007.902032:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3294:x1847765454465792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 378us (945us total) trans 17179875814 rc 0/0 00000004:00080000:1.0:1762167007.902054:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284a80/2, rc 0, transno 17179875813 00000100:00100000:2.0:1762167007.902055:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16924 00000100:00100000:1.0:1762167007.902068:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454465920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.902070:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16922 00000100:00100000:2.0:1762167007.902078:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454466432 00000100:00100000:2.0:1762167007.902089:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454466432 00000100:00100000:0.0:1762167007.902094:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16923 00000100:00100000:3.0:1762167007.902121:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16925 00000100:00100000:2.0:1762167007.902134:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16926 00000100:00100000:3.0:1762167007.902137:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454467072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.902147:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16927 00000100:00100000:2.0:1762167007.902151:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454466944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.902168:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3295:x1847765454466432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.902201:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843352 gen 2 00000004:00080000:0.0:1762167007.902210:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180700, transno 21474843333 00000004:00080000:0.0:1762167007.902219:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180e00, transno 21474843334 00000004:00080000:0.0:1762167007.902222:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b00a80, transno 21474843335 00000004:00080000:0.0:1762167007.902225:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180a80, transno 21474843336 00000004:00080000:0.0:1762167007.902227:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243181180, transno 21474843337 00000004:00080000:0.0:1762167007.902231:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b02a00, transno 21474843338 00000004:00080000:0.0:1762167007.902234:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b03100, transno 21474843339 00000004:00080000:0.0:1762167007.902240:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b00e00, transno 21474843340 00000004:00080000:0.0:1762167007.902245:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b04e00, transno 21474843341 00000004:00080000:0.0:1762167007.902250:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b06a00, transno 21474843342 00000004:00080000:0.0:1762167007.902253:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c1c00, transno 21474843343 00000004:00080000:0.0:1762167007.902256:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b01880, transno 21474843344 00000004:00080000:0.0:1762167007.902265:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c3480, transno 21474843345 00000004:00080000:0.0:1762167007.902271:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24732ed80, transno 21474843346 00000004:00080000:0.0:1762167007.902275:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c0700, transno 21474843347 00000004:00080000:0.0:1762167007.902277:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c1f80, transno 21474843348 00000004:00080000:0.0:1762167007.902281:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c2a00, transno 21474843349 00000004:00080000:0.0:1762167007.902289:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f330e00, transno 21474843350 00000004:00080000:0.0:1762167007.902296:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc31f80, transno 21474843351 00000004:00080000:0.0:1762167007.902300:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c0380, transno 21474843352 00000100:00100000:0.0:1762167007.902312:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee345730700 x1847765454466560/t21474843357(21474843357) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167023 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762167007.902323:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345730700/2, rc 0, transno 21474843357 00000100:00100000:0.0:1762167007.902330:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454466560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167007.902348:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348256d80/2, rc 0, transno 21474843356 00000100:00100000:0.0:1762167007.902354:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454466048:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167007.902371:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.902388:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.902391:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167007.902394:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.902395:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.902399:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167007.902401:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.902406:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167007.902408:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.902411:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167007.902470:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454466944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 324us (1001us total) trans 21474843358 rc 0/0 00000100:00100000:3.0:1762167007.902472:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454467072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 340us (1093us total) trans 21474843359 rc 0/0 00002000:00010000:1.0:1762167007.902475:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 44628 -> 44628 00000004:00080000:0.0:1762167007.902484:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242408000/2, rc 0, transno 21474843358 00002000:00010000:1.0:1762167007.902488:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.902499:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167007.902500:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16926 00000100:00100000:0.0:1762167007.902500:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454466944:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167007.902512:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.902517:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167007.902522:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16925 00000004:00080000:0.0:1762167007.902530:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240bb80/2, rc 0, transno 21474843359 00000100:00100000:0.0:1762167007.902539:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454467072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.902567:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.902604:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3295:x1847765454466432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 439us (715us total) trans 17179875815 rc 0/0 00000100:00100000:2.0:1762167007.902614:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454466176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.902619:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16927 00000004:00080000:0.0:1762167007.902622:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4f800/2, rc 0, transno 17179875815 00000100:00100000:0.0:1762167007.902636:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454466432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.902663:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.902681:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454465664 00000100:00100000:1.0:1762167007.902694:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454465664 00000100:00100000:2.0:1762167007.902696:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454466688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.902703:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454466176 00000100:00100000:0.0:1762167007.902710:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454466176 00000100:00100000:2.0:1762167007.902739:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.902801:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454466688 00000100:00100000:1.0:1762167007.902810:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454466688 00000100:00100000:0.0:1762167007.902814:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16928 00000100:00100000:2.0:1762167007.902817:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454467200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.902836:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3293:x1847765454465664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167007.902860:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16929 00000100:00100000:2.0:1762167007.902871:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167007.902880:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3293:x1847765454466176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.902920:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454467200 00000100:00100000:2.0:1762167007.902928:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454467200 00000100:00100000:2.0:1762167007.902973:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16930 00000100:00100000:2.0:1762167007.902989:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454466688:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167007.903025:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 4 in flight, 20 done 00000100:00100000:0.0:1762167007.903075:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3293:x1847765454465664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 248us (510us total) trans 17179875816 rc 0/0 00000100:00100000:0.0:1762167007.903087:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16928 00000100:00100000:3.0:1762167007.903111:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16931 00000100:00100000:3.0:1762167007.903124:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454467200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.903174:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3293:x1847765454466176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 299us (507us total) trans 17179875817 rc 0/0 00000100:00100000:1.0:1762167007.903185:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16929 00002000:00010000:2.0:1762167007.903211:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167007.903217:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.903220:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167007.903222:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:2.0:1762167007.903225:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167007.903269:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454466688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 286us (529us total) trans 21474843360 rc 0/0 00000100:00100000:2.0:1762167007.903278:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16930 00000100:00100000:3.0:1762167007.903303:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454467200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (434us total) trans 21474843361 rc 0/0 00000100:00100000:2.0:1762167007.903310:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.903316:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16931 00000100:00100000:3.0:1762167007.903333:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454466304 00000100:00100000:3.0:1762167007.903337:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454466304 00000100:00100000:2.0:1762167007.903347:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454466816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.903369:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16932 00000100:00100000:2.0:1762167007.903390:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.903393:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454466304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167007.903413:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454467328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167007.903413:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454466816 00000100:00100000:0.0:1762167007.903420:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454466816 00000100:00100000:2.0:1762167007.903446:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167007.903464:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454467328 00000100:00100000:0.0:1762167007.903468:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454467328 00000004:00080000:2.0:1762167007.903489:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f286680/2, rc 0, transno 17179875814 00000100:00100000:0.0:1762167007.903495:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16933 00000100:00100000:2.0:1762167007.903500:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454465792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.903507:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454466816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167007.903523:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167007.903528:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.903530:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167007.903534:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:3.0:1762167007.903538:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167007.903553:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16934 00000100:00100000:1.0:1762167007.903574:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454467328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.903586:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3294:x1847765454466304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (275us total) trans 17179875818 rc 0/0 00000100:00100000:2.0:1762167007.903589:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454467712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.903601:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16932 00000100:00100000:2.0:1762167007.903631:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167007.903645:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454467456:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167007.903687:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240a300/2, rc 0, transno 21474843361 00000100:00100000:2.0:1762167007.903696:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454467200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.903704:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167007.903713:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcb7800/2, rc 0, transno 17179875816 00000100:00100000:2.0:1762167007.903719:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454465664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.903736:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1762167007.903750:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454467584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167007.903753:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284380/2, rc 0, transno 17179875817 00000100:00100000:2.0:1762167007.903794:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454466176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.903801:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454466816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 261us (385us total) trans 21474843362 rc 0/0 00000100:00100000:0.0:1762167007.903811:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16933 00000004:00080000:2.0:1762167007.903813:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242409f80/2, rc 0, transno 21474843360 00000100:00100000:2.0:1762167007.903820:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454466688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.903823:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167007.903846:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762167007.903850:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454467712 00000100:00100000:0.0:1762167007.903855:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454467712 00000100:00100000:2.0:1762167007.903858:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454467840:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167007.903864:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167007.903870:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454467456 00002000:00010000:1.0:1762167007.903872:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00000100:00100000:3.0:1762167007.903878:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454467456 00002000:00010000:1.0:1762167007.903880:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167007.903881:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454467584 00000100:00100000:0.0:1762167007.903889:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454467584 00002000:00010000:1.0:1762167007.903890:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00000100:00100000:2.0:1762167007.903902:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167007.903908:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:3.0:1762167007.903909:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454467840 00000100:00100000:3.0:1762167007.903916:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454467840 00000100:00100000:0.0:1762167007.903921:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16935 00000100:00100000:0.0:1762167007.903937:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454467712:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167007.903948:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f285180/2, rc 0, transno 17179875818 00000100:00100000:3.0:1762167007.903952:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16936 00000100:00100000:2.0:1762167007.903957:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454466304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.903967:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454467456:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167007.903982:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242408a80/2, rc 0, transno 21474843362 00000100:00100000:2.0:1762167007.903988:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454466816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.903995:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454467328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 428us (545us total) trans 21474843363 rc 0/0 00000100:00100000:1.0:1762167007.904008:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16934 00000004:00080000:2.0:1762167007.904010:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d68a80/2, rc 0, transno 21474843363 00000100:00100000:2.0:1762167007.904021:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454467328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167007.904042:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16937 00000100:00100000:1.0:1762167007.904052:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454467584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167007.904059:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16938 00000100:00100000:2.0:1762167007.904073:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454467840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167007.904200:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454467456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 239us (501us total) trans 21474843364 rc 0/0 00000100:00100000:3.0:1762167007.904209:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16936 00000004:00080000:3.0:1762167007.904259:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d68000/2, rc 0, transno 21474843364 00000100:00100000:3.0:1762167007.904267:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454467456:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167007.904285:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167007.904289:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167007.904292:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.904296:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.904297:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167007.904304:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167007.904306:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:0.0:1762167007.904313:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167007 -> 1762167007 00002000:00010000:1.0:1762167007.904314:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:2.0:1762167007.904324:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3293:x1847765454467840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 247us (422us total) trans 17179875820 rc 0/0 00002000:00010000:0.0:1762167007.904328:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167007.904338:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16938 00000004:00080000:2.0:1762167007.904399:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4ca80/2, rc 0, transno 17179875820 00000100:00100000:0.0:1762167007.904399:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3293:x1847765454467712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 466us (771us total) trans 17179875819 rc 0/0 00000100:00100000:1.0:1762167007.904416:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454467584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 357us (589us total) trans 21474843365 rc 0/0 00000100:00100000:2.0:1762167007.904417:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454467840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167007.904426:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16935 00000100:00100000:3.0:1762167007.904438:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000004:00080000:2.0:1762167007.904451:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4c000/2, rc 0, transno 17179875819 00000100:00100000:1.0:1762167007.904452:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16937 00000100:00100000:2.0:1762167007.904465:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454467712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167007.904489:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d68380/2, rc 0, transno 21474843365 00000100:00100000:3.0:1762167007.904496:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454467584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167007.904516:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451873024 00000100:00100000:3.0:1762167007.904519:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451873024 00000100:00100000:3.0:1762167007.904743:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19828 00000100:00100000:3.0:1762167007.904750:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56207:x1847765451873024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.904798:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.904816:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0aca3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb39fb expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.904868:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0aca3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39fb expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.904882:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0aca3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39fb expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.904899:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:3.0:1762167007.904902:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167007.904906:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167007.904939:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56207:x1847765451873024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 189us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.904958:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19828 00000100:00100000:0.0:1762167007.907277:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.907355:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451873152 00000100:00100000:3.0:1762167007.907370:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451873152 00000100:00100000:3.0:1762167007.907440:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19829 00000100:00100000:3.0:1762167007.907448:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56207:x1847765451873152:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167007.907463:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167007.907494:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0acaa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a02 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.907579:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0acb1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167007.907593:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167007.907604:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167007.907630:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:3.0:1762167007.907634:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167007.907651:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167007.907675:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0acaa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a02 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.907691:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0acb1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a02 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167007.907699:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:3.0:1762167007.907702:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167007.907706:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167007.907819:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56207:x1847765451873152:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 370us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167007.907831:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19829 00000100:00100000:3.0:1762167007.909419:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.909489:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167007.909512:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167007.909579:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451873280 00000100:00100000:0.0:1762167007.909595:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451873280 00000100:00100000:2.0:1762167007.909604:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451873408 00000100:00100000:1.0:1762167007.909605:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451873536 00000100:00100000:2.0:1762167007.909616:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451873408 00000100:00100000:1.0:1762167007.909616:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451873536 00000100:00100000:0.0:1762167007.909711:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16939 00000100:00100000:1.0:1762167007.909729:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16940 00000100:00100000:0.0:1762167007.909732:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451873280:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:2.0:1762167007.909746:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16941 00000100:00100000:1.0:1762167007.909753:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451873408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167007.909821:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762167007.909823:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451873536:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167007.909824:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167007.909835:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167007.909858:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0acb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a10 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167007.909860:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0acbf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a09 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.909867:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0acc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a17 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167007.909916:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888e0, atime: 0x690888de, ctime: 0x690888e0, blocks: 0x3 00002000:00010000:0.0:1762167007.909930:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 45050, mtime: 0x690888e0, atime: 0x690888de, ctime: 0x690888e0, blocks: 0xb9 00002000:00010000:2.0:1762167007.909931:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888e0, atime: 0x690888de, ctime: 0x690888e0, blocks: 0x3 00010000:00010000:1.0:1762167007.909938:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.909945:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.909946:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.909951:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.909962:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0acc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a17 expref: 20 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.909962:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0acb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a10 expref: 32 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.909964:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.909972:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167007.909991:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0acbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a09 expref: 20 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.910002:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0acc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a17 expref: 20 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167007.910002:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0acb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a10 expref: 32 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167007.910032:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0acbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a09 expref: 20 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167007.910033:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d200, rc 0) 00010000:00010000:1.0:1762167007.910033:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a200, rc 0) 00010000:00010000:0.0:1762167007.910055:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f4d9c00, rc 0) 00000100:00100000:2.0:1762167007.910094:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451873536:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 336us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.910096:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451873408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 350us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167007.910106:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16941 00000100:00100000:0.0:1762167007.910114:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451873280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 388us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167007.910117:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16940 00000100:00100000:0.0:1762167007.910146:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16939 00000100:00100000:0.0:1762167007.938505:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.938631:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451873664 00000100:00100000:2.0:1762167007.938648:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451873664 00000100:00100000:2.0:1762167007.938797:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2932 00000100:00100000:2.0:1762167007.938819:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451873664:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167007.938860:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0accd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.938880:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.938882:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.938888:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0accd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.938902:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0accd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.940622:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0accd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.940640:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0accd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.940649:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0accd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.940657:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.940662:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0accd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.940671:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0accd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.940689:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0accd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.940696:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0accd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.940824:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451873664:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2008us (2330us total) trans 0 rc 45050/45050 00000100:00100000:2.0:1762167007.940836:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2932 00000100:00100000:3.0:1762167007.944552:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.944609:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451873792 00000100:00100000:2.0:1762167007.944620:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451873792 00000100:00100000:2.0:1762167007.944694:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2933 00000100:00100000:2.0:1762167007.944705:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451873792:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167007.944756:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 44628, mtime: 0x690888df, atime: 0x690888d5, ctime: 0x690888df, blocks: 0x203 00010000:00010000:2.0:1762167007.944788:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0acd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.944803:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.944807:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.944813:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0acd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.944828:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0acd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167007.963130:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875819 is committed 00000001:00080000:3.0:1762167007.963152:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875810 is committed 00000001:00080000:3.0:1762167007.963191:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875821 is committed 00002000:00010000:2.0:1762167007.963197:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 44628 -> 45056 00000001:00080000:3.0:1762167007.963201:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875820 is committed 00002000:00010000:2.0:1762167007.963204:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:2.0:1762167007.963209:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00010000:00010000:2.0:1762167007.963222:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0acd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.963234:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0acd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.963243:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0acd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.963252:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167007.963259:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0acd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.963268:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0acd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.963285:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0acd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.963290:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0acd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167007.963369:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451873792:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 18664us (18834us total) trans 17179875821 rc 0/0 00000100:00100000:2.0:1762167007.963389:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2933 00000100:00100000:3.0:1762167007.965623:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167007.965679:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451873920 00000100:00100000:2.0:1762167007.965691:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451873920 00000100:00100000:2.0:1762167007.965786:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2934 00000100:00100000:2.0:1762167007.965797:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451873920:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167007.965843:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 44628, mtime: 0x690888df, atime: 0x690888db, ctime: 0x690888df, blocks: 0x203 00010000:00010000:2.0:1762167007.965851:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0acdb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.965863:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.965865:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167007.965870:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0acdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167007.965882:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0acdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167007.979659:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843362 is committed 00000001:00080000:3.0:1762167007.979696:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843365 is committed 00000001:00080000:3.0:1762167007.979708:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843354 is committed 00000001:00080000:3.0:1762167007.979717:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843366 is committed 00002000:00010000:1.0:1762167007.979804:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 44628 -> 45056 00002000:00010000:1.0:1762167007.979813:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167007.979816:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00010000:00010000:1.0:1762167007.979833:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0acdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.979845:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0acdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.979855:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0acdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.979863:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.979869:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0acdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.979883:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0acdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.979907:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0acdb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.979914:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0acdb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.980050:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451873920:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14246us (14425us total) trans 21474843366 rc 0/0 00000100:00100000:1.0:1762167007.980061:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2934 00000100:00100000:0.0:1762167007.982898:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.982984:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451874048 00000100:00100000:1.0:1762167007.983002:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451874048 00000100:00100000:1.0:1762167007.983116:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2935 00000100:00100000:1.0:1762167007.983126:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451874048:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167007.983185:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 44628, mtime: 0x690888df, atime: 0x690888db, ctime: 0x690888df, blocks: 0x203 00010000:00010000:1.0:1762167007.983193:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0ace2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.983207:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.983209:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.983214:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0ace2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.983226:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0ace2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167007.994754:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875822 is committed 00002000:00010000:1.0:1762167007.994794:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 44628 -> 45056 00002000:00010000:1.0:1762167007.994800:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167007.994804:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00010000:00010000:1.0:1762167007.994816:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0ace2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.994828:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0ace2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.994836:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0ace2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.994844:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167007.994849:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0ace2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.994857:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0ace2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.994873:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0ace2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.994878:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0ace2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167007.994954:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451874048:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 11825us (12061us total) trans 17179875822 rc 0/0 00000100:00100000:1.0:1762167007.994968:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2935 00000100:00100000:3.0:1762167007.996969:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167007.997046:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451874176 00000100:00100000:1.0:1762167007.997054:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451874176 00000100:00100000:1.0:1762167007.997126:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2936 00000100:00100000:1.0:1762167007.997136:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451874176:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167007.997183:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 44628, mtime: 0x690888df, atime: 0x690888dd, ctime: 0x690888df, blocks: 0x203 00010000:00010000:1.0:1762167007.997191:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0ace9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.997205:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.997207:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167007.997213:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0ace9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167007.997226:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0ace9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167008.008476:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875823 is committed 00002000:00010000:0.0:1762167008.008548:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 44628 -> 45056 00002000:00010000:0.0:1762167008.008553:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:0.0:1762167008.008556:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00010000:00010000:0.0:1762167008.008569:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0ace9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.008580:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0ace9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.008588:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0ace9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.008594:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ae00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167008.008599:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0ace9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.008607:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0ace9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.008629:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0ace9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.008636:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0ace9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.008734:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451874176:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 11594us (11766us total) trans 17179875823 rc 0/0 00000100:00100000:0.0:1762167008.008744:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2936 00000100:00100000:3.0:1762167008.010972:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.011012:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451874304 00000100:00100000:0.0:1762167008.011020:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451874304 00000100:00100000:0.0:1762167008.011077:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2937 00000100:00100000:0.0:1762167008.011084:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451874304:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167008.011132:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 44628, mtime: 0x690888df, atime: 0x690888dd, ctime: 0x690888df, blocks: 0x203 00010000:00010000:0.0:1762167008.011140:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0acf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.011153:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.011155:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.011160:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0acf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.011172:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0acf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167008.023438:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843367 is committed 00002000:00010000:0.0:1762167008.023486:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 44628 -> 45056 00002000:00010000:0.0:1762167008.023489:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:0.0:1762167008.023491:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00010000:00010000:0.0:1762167008.023503:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0acf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.023511:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0acf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.023517:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0acf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.023522:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480ed600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167008.023526:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0acf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.023550:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0acf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.023572:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0acf0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.023580:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0acf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.023687:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451874304:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 12597us (12715us total) trans 21474843367 rc 0/0 00000100:00100000:0.0:1762167008.023698:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2937 00000100:00100000:2.0:1762167008.026182:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.026236:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451874432 00000100:00100000:0.0:1762167008.026247:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451874432 00000100:00100000:0.0:1762167008.026321:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2938 00000100:00100000:0.0:1762167008.026330:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451874432:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762167008.026366:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.026392:0:14122:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0abed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39b5 expref: 22 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.026401:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.026403:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.026406:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.026444:0:14122:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0abed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39b5 expref: 22 pid: 7858 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.026454:0:14122:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0abed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39b5 expref: 22 pid: 7858 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167008.026469:0:14122:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454467968:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167008.026556:0:14122:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.027979:0:14122:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:14122:1847765454467968:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.028010:0:14122:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.028558:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.028610:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451874560 00000100:00100000:0.0:1762167008.028617:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451874560 00010000:00010000:0.0:1762167008.028652:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0abed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39b5 expref: 23 pid: 7858 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1762167008.028685:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7514 00000100:00100000:0.0:1762167008.028695:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451874560:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167008.028708:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.028733:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0abed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39b5 expref: 23 pid: 7858 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167008.028744:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0abed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39b5 expref: 23 pid: 7858 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167008.028796:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0abed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39b5 expref: 23 pid: 7858 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1762167008.028816:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.028818:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.028823:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.028833:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.028861:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167008.028897:0:14122:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.028910:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451874560:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 215us (353us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167008.028914:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.028921:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7514 00000001:00080000:0.0:1762167008.042295:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875824 is committed 00002000:00010000:3.0:1762167008.042357:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 44628 -> 45056 00002000:00010000:3.0:1762167008.042362:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:3.0:1762167008.042365:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00010000:00010000:3.0:1762167008.042393:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.042404:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.042412:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.042419:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372a2c000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167008.042423:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.042433:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.042450:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.042457:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0acf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167008.042559:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451874432:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16225us (16380us total) trans 17179875824 rc 0/0 00000100:00100000:3.0:1762167008.042570:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2938 00000100:00100000:3.0:1762167008.044928:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.044992:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451874688 00000100:00100000:1.0:1762167008.045002:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451874688 00000100:00100000:1.0:1762167008.045080:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2939 00000100:00100000:1.0:1762167008.045093:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451874688:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167008.045144:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 44628, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x83 00010000:00010000:1.0:1762167008.045153:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0acfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.045167:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.045169:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.045175:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0acfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.045187:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0acfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167008.059490:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843368 is committed 00002000:00010000:1.0:1762167008.059539:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 44628 -> 45056 00002000:00010000:1.0:1762167008.059547:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167008.059549:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00010000:00010000:1.0:1762167008.059560:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0acfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.059571:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0acfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.059580:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0acfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.059586:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.059591:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0acfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.059599:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0acfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.059617:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0acfe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.059624:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0acfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.059728:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451874688:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14633us (14799us total) trans 21474843368 rc 0/0 00000100:00100000:1.0:1762167008.059739:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2939 00000100:00100000:2.0:1762167008.063039:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.063207:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451874816 00000100:00100000:1.0:1762167008.063219:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451874816 00000100:00100000:1.0:1762167008.063308:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2940 00000100:00100000:1.0:1762167008.063319:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451874816:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167008.063389:0:14122:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 44628, mtime: 0x690888df, atime: 0x690888de, ctime: 0x690888df, blocks: 0x103 00010000:00010000:1.0:1762167008.063398:0:14122:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0ad05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.063414:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.063417:0:14122:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.063422:0:14122:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0ad05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.063437:0:14122:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0ad05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167008.079173:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875825 is committed 00002000:00010000:0.0:1762167008.079370:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 44628 -> 45056 00002000:00010000:0.0:1762167008.079385:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:0.0:1762167008.079388:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00010000:00010000:0.0:1762167008.079403:0:14122:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0ad05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.079414:0:14122:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0ad05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.079424:0:14122:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0ad05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.079436:0:14122:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167008.079441:0:14122:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0ad05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.079450:0:14122:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0ad05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.079473:0:14122:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0ad05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.079481:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0ad05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.079585:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451874816:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16264us (16553us total) trans 17179875825 rc 0/0 00000100:00100000:0.0:1762167008.079595:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2940 00000100:00100000:0.0:1762167008.090103:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.090229:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451875072 00000100:00100000:3.0:1762167008.090240:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451875072 00000100:00100000:3.0:1762167008.090306:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19830 00000100:00100000:3.0:1762167008.090317:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56207:x1847765451875072:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167008.090389:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167008.090419:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0acb1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a02 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.090443:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:3.0:1762167008.090449:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167008.090708:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.090723:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.090733:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762167008.091284:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952923 00000004:00010000:3.0:1762167008.091314:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009aefc194 reply state 00000000922eee99 transno 8589952924 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.091324:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167008.091447:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56207:x1847765451875072:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 1131us (1354us total) trans 8589952924 rc 0/0 00000100:00100000:3.0:1762167008.091456:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19830 00000020:00080000:3.0:1762167008.091463:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762167008.092965:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.093070:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451875200 00000100:00100000:2.0:1762167008.093087:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451875200 00000100:00100000:2.0:1762167008.093171:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16942 00000100:00100000:2.0:1762167008.093183:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56207:x1847765451875200:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.093208:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.093243:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0ad13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a1e expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167008.093278:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 45056, mtime: 0x690888e0, atime: 0x690888d5, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:2.0:1762167008.093307:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.093310:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.093319:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0ad13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a1e expref: 22 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.093339:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0ad13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a1e expref: 22 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.093354:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:2.0:1762167008.093447:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56207:x1847765451875200:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 266us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.093456:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16942 00010000:00010000:0.0:1762167008.093883:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.093895:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.093902:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.093908:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.093912:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.093922:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.093938:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.093941:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.093945:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.093951:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0ad0c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167008.095258:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.095313:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.095316:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451875328 00000100:00100000:0.0:1762167008.095328:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451875328 00002000:00010000:0.0:1762167008.095372:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (45050->18446744073709551615) 00002000:00100000:0.0:1762167008.095388:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359065500 with x1847765451875328 ext(45050->18446744073709551615) 00002000:00010000:0.0:1762167008.095401:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359065500. 00000100:00100000:1.0:1762167008.095403:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451875456 00000100:00100000:1.0:1762167008.095409:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451875456 00002000:00010000:1.0:1762167008.095431:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:1.0:1762167008.095435:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359067b80 with x1847765451875456 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167008.095442:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359067b80. 00000100:00100000:0.0:1762167008.095445:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2941 00000100:00100000:0.0:1762167008.095458:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451875328:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167008.095480:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2942 00000100:00100000:1.0:1762167008.095490:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451875456:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167008.095808:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.095812:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167008.095815:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167008.095818:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167008.095820:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167008.095876:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 45056 -> 45050 00002000:00010000:0.0:1762167008.095880:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.095883:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167008.095885:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.095887:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167008.095898:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451875456:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 409us (585us total) trans 21474843369 rc 0/0 00000100:00100000:1.0:1762167008.095907:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2942 00002000:00010000:1.0:1762167008.095911:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00000100:00100000:0.0:1762167008.095916:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451875328:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 459us (663us total) trans 17179875826 rc 0/0 00002000:00100000:1.0:1762167008.095917:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359067b80 with x1847765451875456 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167008.095924:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359067b80. 00000100:00100000:0.0:1762167008.095929:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2941 00002000:00010000:0.0:1762167008.095934:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (45050->18446744073709551615) 00002000:00100000:0.0:1762167008.095938:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359065500 with x1847765451875328 ext(45050->18446744073709551615) 00002000:00010000:0.0:1762167008.095944:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359065500. 00000100:00100000:3.0:1762167008.098675:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.099338:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451875584 00000100:00100000:0.0:1762167008.099349:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451875584 00000100:00100000:0.0:1762167008.099680:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19831 00000100:00100000:0.0:1762167008.099692:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56207:x1847765451875584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.099716:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.099738:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad1a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a25 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.099941:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.099958:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.099969:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.099996:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:0.0:1762167008.100001:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.100017:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.100043:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a25 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.100061:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a25 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.100076:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.100080:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.100085:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2ca00, rc 0) 00000100:00100000:0.0:1762167008.100154:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56207:x1847765451875584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 464us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.100162:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19831 00000100:00100000:3.0:1762167008.102857:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.102939:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451875840 00000100:00100000:0.0:1762167008.102948:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451875840 00000100:00100000:0.0:1762167008.103006:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19832 00000100:00100000:0.0:1762167008.103016:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56207:x1847765451875840:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167008.103067:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.103100:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad21 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a25 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.103120:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.103125:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.103330:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.103344:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.103354:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167008.103418:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952925 00000004:00010000:0.0:1762167008.103443:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a74da0da reply state 0000000097159087 transno 8589952926 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.103452:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167008.103556:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56207:x1847765451875840:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 541us (708us total) trans 8589952926 rc 0/0 00000100:00100000:0.0:1762167008.103568:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19832 00000020:00080000:0.0:1762167008.103573:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762167008.105646:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167008.105651:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.105663:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.105670:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.105676:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372a2c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167008.105682:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.105693:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.105707:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167008.105711:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167008.105715:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.105721:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad28 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.105732:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451875968 00000100:00100000:0.0:1762167008.105740:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451875968 00000100:00100000:0.0:1762167008.105850:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16943 00000100:00100000:0.0:1762167008.105860:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56207:x1847765451875968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.105873:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.105892:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a2c expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167008.105914:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 45056, mtime: 0x690888e0, atime: 0x690888db, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:0.0:1762167008.105933:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.105935:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.105942:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a2c expref: 19 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.105956:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a2c expref: 19 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.105966:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2de00, rc 0) 00000100:00100000:0.0:1762167008.106012:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:56207:x1847765451875968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.106018:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16943 00000100:00100000:3.0:1762167008.107889:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.108119:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451876224 00000100:00100000:2.0:1762167008.108128:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451876224 00002000:00010000:2.0:1762167008.108165:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167008.108170:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6aa00 with x1847765451876224 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167008.108181:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d6aa00. 00000100:00100000:2.0:1762167008.108222:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2943 00000100:00100000:2.0:1762167008.108233:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451876224:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167008.108321:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.108360:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451876096 00000100:00100000:0.0:1762167008.108365:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451876096 00002000:00010000:0.0:1762167008.108399:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (45050->18446744073709551615) 00002000:00100000:0.0:1762167008.108404:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d68e00 with x1847765451876096 ext(45050->18446744073709551615) 00002000:00010000:0.0:1762167008.108411:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d68e00. 00000100:00100000:0.0:1762167008.108435:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2944 00000100:00100000:0.0:1762167008.108443:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451876096:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167008.108516:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167008.108521:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:2.0:1762167008.108524:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167008.108527:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00010000:2.0:1762167008.108529:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.108594:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451876224:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 363us (712us total) trans 17179875827 rc 0/0 00000100:00100000:2.0:1762167008.108603:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2943 00002000:00010000:2.0:1762167008.108608:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167008.108611:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6aa00 with x1847765451876224 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167008.108617:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d6aa00. 00002000:00010000:0.0:1762167008.108681:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 45056 -> 45050 00002000:00010000:0.0:1762167008.108685:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.108687:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167008.108689:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.108692:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167008.108732:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451876096:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 291us (412us total) trans 21474843370 rc 0/0 00000100:00100000:0.0:1762167008.108738:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2944 00002000:00010000:0.0:1762167008.108741:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (45050->18446744073709551615) 00002000:00100000:0.0:1762167008.108743:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d68e00 with x1847765451876096 ext(45050->18446744073709551615) 00002000:00010000:0.0:1762167008.108747:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d68e00. 00000100:00100000:3.0:1762167008.110806:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.110865:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451876352 00000100:00100000:0.0:1762167008.110874:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451876352 00000100:00100000:0.0:1762167008.110939:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19833 00000100:00100000:0.0:1762167008.110951:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56207:x1847765451876352:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.110975:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.110996:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ad36 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a33 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.111074:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad3d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.111088:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.111098:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.111124:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:0.0:1762167008.111128:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.111143:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.111169:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ad36 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a33 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.111189:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a33 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.111198:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.111201:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.111204:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3480ed600, rc 0) 00000100:00100000:0.0:1762167008.111258:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56207:x1847765451876352:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 310us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.111265:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19833 00000100:00100000:3.0:1762167008.113083:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.113129:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451876608 00000100:00100000:0.0:1762167008.113138:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451876608 00000100:00100000:0.0:1762167008.113185:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19834 00000100:00100000:0.0:1762167008.113195:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56207:x1847765451876608:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167008.113243:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.113270:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad3d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a33 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.113293:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.113297:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.113543:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.113558:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.113568:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167008.113618:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952927 00000004:00010000:0.0:1762167008.113643:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d8f72203 reply state 00000000c9c1507f transno 8589952928 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.113650:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167008.113755:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56207:x1847765451876608:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 560us (677us total) trans 8589952928 rc 0/0 00000100:00100000:0.0:1762167008.113799:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19834 00000020:00080000:0.0:1762167008.113808:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167008.115139:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.115153:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.115161:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.115167:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372a2c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.115173:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.115181:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.115199:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.115202:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.115207:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.115213:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad44 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.115235:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.115306:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451876736 00000100:00100000:2.0:1762167008.115314:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451876736 00000100:00100000:2.0:1762167008.115388:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16944 00000100:00100000:2.0:1762167008.115399:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56207:x1847765451876736:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.115415:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.115435:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ad4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a3a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167008.115459:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 45056, mtime: 0x690888e0, atime: 0x690888db, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:2.0:1762167008.115477:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.115479:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.115487:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ad4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a3a expref: 25 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.115501:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ad4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a3a expref: 25 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.115512:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167008.115565:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56207:x1847765451876736:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 168us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.115572:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16944 00000100:00100000:2.0:1762167008.117044:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.117083:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.117156:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451876992 00000100:00100000:0.0:1762167008.117164:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451876992 00000100:00100000:3.0:1762167008.117175:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451876864 00000100:00100000:3.0:1762167008.117182:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451876864 00002000:00010000:0.0:1762167008.117203:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00010000:3.0:1762167008.117204:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (45050->18446744073709551615) 00002000:00100000:3.0:1762167008.117212:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359065f80 with x1847765451876864 ext(45050->18446744073709551615) 00002000:00100000:0.0:1762167008.117212:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359065c00 with x1847765451876992 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167008.117225:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359065f80. 00002000:00010000:0.0:1762167008.117225:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359065c00. 00000100:00100000:0.0:1762167008.117261:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2945 00000100:00100000:0.0:1762167008.117271:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451876992:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167008.117280:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2946 00000100:00100000:3.0:1762167008.117292:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451876864:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167008.117570:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167008.117573:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:0.0:1762167008.117576:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167008.117578:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00010000:0.0:1762167008.117580:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167008.117639:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451876992:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 369us (600us total) trans 21474843371 rc 0/0 00000100:00100000:0.0:1762167008.117647:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2945 00002000:00010000:0.0:1762167008.117652:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167008.117655:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359065c00 with x1847765451876992 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167008.117661:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359065c00. 00002000:00010000:3.0:1762167008.117665:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 45056 -> 45050 00002000:00010000:3.0:1762167008.117670:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.117672:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167008.117675:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.117678:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167008.117705:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451876864:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 414us (619us total) trans 17179875828 rc 0/0 00000100:00100000:3.0:1762167008.117713:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2946 00002000:00010000:3.0:1762167008.117717:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (45050->18446744073709551615) 00002000:00100000:3.0:1762167008.117720:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359065f80 with x1847765451876864 ext(45050->18446744073709551615) 00002000:00010000:3.0:1762167008.117726:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359065f80. 00000100:00100000:3.0:1762167008.119742:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.119869:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451877120 00000100:00100000:0.0:1762167008.119878:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451877120 00000100:00100000:0.0:1762167008.119932:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19835 00000100:00100000:0.0:1762167008.119942:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56207:x1847765451877120:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.119963:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.119992:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ad52 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a41 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.120077:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.120092:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.120104:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.120136:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:0.0:1762167008.120140:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.120157:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.120180:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0ad52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a41 expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.120195:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad59 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a41 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.120201:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.120204:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.120206:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2ca00, rc 0) 00000100:00100000:0.0:1762167008.120248:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56207:x1847765451877120:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 309us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.120253:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19835 00000100:00100000:1.0:1762167008.123600:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.123656:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451877376 00000100:00100000:0.0:1762167008.123667:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451877376 00000100:00100000:0.0:1762167008.123725:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19836 00000100:00100000:0.0:1762167008.123736:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56207:x1847765451877376:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167008.123834:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.123862:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ad59 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a41 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.123885:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.123890:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.124117:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.124130:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.124140:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167008.124194:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952929 00000004:00010000:0.0:1762167008.124236:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cc6cad08 reply state 00000000b465349f transno 8589952930 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.124245:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167008.124344:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56207:x1847765451877376:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 610us (753us total) trans 8589952930 rc 0/0 00000100:00100000:0.0:1762167008.124356:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19836 00000020:00080000:0.0:1762167008.124362:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167008.126518:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.126535:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.126542:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.126548:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480ed600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167008.126552:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.126560:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.126575:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167008.126578:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167008.126582:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.126593:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0ad60 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167008.126800:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.126843:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451877504 00000100:00100000:0.0:1762167008.126853:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451877504 00000100:00100000:0.0:1762167008.126916:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16945 00000100:00100000:0.0:1762167008.126927:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56207:x1847765451877504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.126942:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.126965:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a48 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167008.126991:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 45056, mtime: 0x690888e0, atime: 0x690888dd, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:0.0:1762167008.127014:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.127016:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.127025:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a48 expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.127040:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a48 expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.127050:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2c000, rc 0) 00000100:00100000:0.0:1762167008.127104:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56207:x1847765451877504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 178us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.127110:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16945 00000100:00100000:2.0:1762167008.128399:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.128439:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.128513:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451877632 00000100:00100000:0.0:1762167008.128520:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451877632 00002000:00010000:0.0:1762167008.128548:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (45050->18446744073709551615) 00002000:00100000:0.0:1762167008.128553:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359064700 with x1847765451877632 ext(45050->18446744073709551615) 00002000:00010000:0.0:1762167008.128561:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359064700. 00000100:00100000:0.0:1762167008.128586:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451877760 00000100:00100000:0.0:1762167008.128589:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451877760 00002000:00010000:0.0:1762167008.128602:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:0.0:1762167008.128605:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359066d80 with x1847765451877760 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167008.128611:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359066d80. 00000100:00100000:0.0:1762167008.128636:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2947 00000100:00100000:0.0:1762167008.128646:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451877632:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167008.128662:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2948 00000100:00100000:3.0:1762167008.128675:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451877760:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167008.128985:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 45056 -> 45050 00002000:00010000:2.0:1762167008.128989:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167008.128989:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.128992:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:0.0:1762167008.128992:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167008.128995:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167008.128995:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.128998:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00010000:0.0:1762167008.128998:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167008.129000:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167008.129051:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451877632:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 405us (654us total) trans 17179875829 rc 0/0 00000100:00100000:2.0:1762167008.129055:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451877760:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 385us (619us total) trans 21474843372 rc 0/0 00000100:00100000:0.0:1762167008.129058:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2947 00002000:00010000:0.0:1762167008.129062:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (45050->18446744073709551615) 00002000:00100000:0.0:1762167008.129065:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359064700 with x1847765451877632 ext(45050->18446744073709551615) 00002000:00010000:0.0:1762167008.129070:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359064700. 00000100:00100000:2.0:1762167008.129071:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2948 00002000:00010000:2.0:1762167008.129074:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:2.0:1762167008.129077:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359066d80 with x1847765451877760 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167008.129080:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359066d80. 00000100:00100000:3.0:1762167008.130849:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.130940:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451877888 00000100:00100000:0.0:1762167008.130948:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451877888 00000100:00100000:0.0:1762167008.130997:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19837 00000100:00100000:0.0:1762167008.131006:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56207:x1847765451877888:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.131025:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.131043:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad6e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a4f expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.131129:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ad75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.131143:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ad75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.131153:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ad75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.131178:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:0.0:1762167008.131182:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.131196:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ad75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.131230:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad6e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a4f expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.131247:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ad75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a4f expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.131255:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.131258:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.131262:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b0000, rc 0) 00000100:00100000:0.0:1762167008.131316:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56207:x1847765451877888:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 311us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.131323:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19837 00000100:00100000:1.0:1762167008.133712:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.133989:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451878144 00000100:00100000:3.0:1762167008.133998:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451878144 00000100:00100000:3.0:1762167008.134059:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19838 00000100:00100000:3.0:1762167008.134070:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56207:x1847765451878144:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167008.134120:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167008.134144:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b0000/0xf915a5bdf3d0ad75 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a4f expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.134163:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:3.0:1762167008.134168:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167008.134372:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167008.134396:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167008.134405:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762167008.134457:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952931 00000004:00010000:3.0:1762167008.134482:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009523f10c reply state 00000000a7f3d0ac transno 8589952932 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167008.134490:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167008.134584:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56207:x1847765451878144:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 515us (880us total) trans 8589952932 rc 0/0 00000100:00100000:3.0:1762167008.134591:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19838 00000020:00080000:3.0:1762167008.134596:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167008.135723:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.135733:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.135738:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.135742:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.135745:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.135749:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.135758:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.135760:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.135791:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.135798:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ad7c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167008.136311:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.136372:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451878272 00000100:00100000:0.0:1762167008.136393:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451878272 00000100:00100000:0.0:1762167008.136447:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16946 00000100:00100000:0.0:1762167008.136457:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56207:x1847765451878272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.136472:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.136492:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ad83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a56 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167008.136515:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 45056, mtime: 0x690888e0, atime: 0x690888dd, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:0.0:1762167008.136532:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.136535:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.136541:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ad83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a56 expref: 23 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.136556:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ad83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a56 expref: 23 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.136566:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b1800, rc 0) 00000100:00100000:0.0:1762167008.136630:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56207:x1847765451878272:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 173us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.136636:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16946 00000100:00100000:2.0:1762167008.138219:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.138283:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.138319:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451878400 00000100:00100000:0.0:1762167008.138327:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451878400 00000100:00100000:3.0:1762167008.138355:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451878528 00002000:00010000:0.0:1762167008.138359:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (45050->18446744073709551615) 00000100:00100000:3.0:1762167008.138362:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451878528 00002000:00100000:0.0:1762167008.138368:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359067480 with x1847765451878400 ext(45050->18446744073709551615) 00002000:00010000:0.0:1762167008.138389:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359067480. 00002000:00010000:3.0:1762167008.138395:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:3.0:1762167008.138401:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359066680 with x1847765451878528 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167008.138408:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359066680. 00000100:00100000:0.0:1762167008.138422:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2949 00000100:00100000:0.0:1762167008.138434:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451878400:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167008.138441:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2950 00000100:00100000:3.0:1762167008.138453:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451878528:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167008.138788:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 45056 -> 45050 00002000:00010000:0.0:1762167008.138791:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.138793:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167008.138796:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.138799:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167008.138859:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451878400:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 427us (649us total) trans 21474843373 rc 0/0 00002000:00010000:3.0:1762167008.138864:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167008.138868:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2949 00002000:00010000:3.0:1762167008.138870:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:0.0:1762167008.138874:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (45050->18446744073709551615) 00002000:00010000:3.0:1762167008.138875:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167008.138882:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00100000:0.0:1762167008.138882:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359067480 with x1847765451878400 ext(45050->18446744073709551615) 00002000:00010000:3.0:1762167008.138889:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 1 -> 3 00002000:00010000:0.0:1762167008.138891:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359067480. 00000100:00100000:3.0:1762167008.138918:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451878528:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 468us (635us total) trans 17179875830 rc 0/0 00000100:00100000:3.0:1762167008.138927:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2950 00002000:00010000:3.0:1762167008.138931:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:3.0:1762167008.138933:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359066680 with x1847765451878528 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167008.138938:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359066680. 00000100:00100000:2.0:1762167008.140572:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.140877:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451878656 00000100:00100000:3.0:1762167008.140889:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451878656 00000100:00100000:2.0:1762167008.141025:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19839 00000100:00100000:2.0:1762167008.141036:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56207:x1847765451878656:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.141056:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.141075:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0ad8a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a5d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.141155:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0ad91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.141169:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0ad91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.141181:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0ad91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167008.141208:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:2.0:1762167008.141213:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167008.141231:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0ad91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.141260:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0ad8a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a5d expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.141272:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0ad91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a5d expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.141279:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:2.0:1762167008.141281:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167008.141283:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00000100:00100000:2.0:1762167008.141344:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56207:x1847765451878656:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 309us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.141351:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19839 00000100:00100000:1.0:1762167008.143973:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.144029:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451878912 00000100:00100000:2.0:1762167008.144039:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451878912 00000100:00100000:2.0:1762167008.144089:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19840 00000100:00100000:2.0:1762167008.144096:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56207:x1847765451878912:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167008.144144:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.144172:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0ad91 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a5d expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.144192:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:2.0:1762167008.144197:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167008.144433:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.144445:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.144452:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167008.144506:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952933 00000004:00010000:2.0:1762167008.144532:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009ef30f38 reply state 00000000a7aaecda transno 8589952934 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167008.144545:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167008.144627:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56207:x1847765451878912:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 530us (714us total) trans 8589952934 rc 0/0 00000100:00100000:2.0:1762167008.144632:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19840 00000020:00080000:2.0:1762167008.144635:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167008.145634:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167008.145647:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167008.145654:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167008.145661:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167008.145665:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167008.145672:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167008.145685:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167008.145689:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167008.145693:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167008.145699:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ad98 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167008.146110:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.146455:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451879040 00000100:00100000:0.0:1762167008.146468:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451879040 00000100:00100000:0.0:1762167008.146522:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16947 00000100:00100000:0.0:1762167008.146535:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56207:x1847765451879040:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.146549:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.146567:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a64 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167008.146592:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81e:0x0] initial LVB size: 45056, mtime: 0x690888e0, atime: 0x690888de, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:0.0:1762167008.146610:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.146616:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.146624:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a64 expref: 30 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.146639:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a64 expref: 30 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.146650:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b0200, rc 0) 00000100:00100000:0.0:1762167008.146706:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:56207:x1847765451879040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 172us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.146713:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16947 00000100:00100000:0.0:1762167008.148711:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.148748:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.148792:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451879168 00000100:00100000:3.0:1762167008.148800:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451879168 00002000:00010000:3.0:1762167008.148837:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2078 (45050->18446744073709551615) 00002000:00100000:3.0:1762167008.148843:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc33480 with x1847765451879168 ext(45050->18446744073709551615) 00002000:00010000:3.0:1762167008.148857:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dc33480. 00000100:00100000:3.0:1762167008.148886:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451879296 00000100:00100000:3.0:1762167008.148889:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451879296 00002000:00010000:3.0:1762167008.148901:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2075 (0->18446744073709551615) 00002000:00100000:3.0:1762167008.148905:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc33100 with x1847765451879296 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167008.148910:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dc33100. 00000100:00100000:3.0:1762167008.148936:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2951 00000100:00100000:3.0:1762167008.148950:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451879168:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167008.148950:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2952 00000100:00100000:1.0:1762167008.148969:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451879296:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167008.149248:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.149252:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167008.149255:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167008.149258:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167008.149260:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167008.149270:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 45056 -> 45050 00002000:00010000:3.0:1762167008.149275:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.149277:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167008.149280:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.149281:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167008.149665:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451879296:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 700us (915us total) trans 21474843374 rc 0/0 00000100:00100000:3.0:1762167008.149668:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451879168:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 721us (967us total) trans 17179875831 rc 0/0 00000100:00100000:1.0:1762167008.149678:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2952 00002000:00010000:1.0:1762167008.149683:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2075 (0->18446744073709551615) 00000100:00100000:3.0:1762167008.149687:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2951 00002000:00100000:1.0:1762167008.149688:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc33100 with x1847765451879296 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167008.149694:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2078 (45050->18446744073709551615) 00002000:00010000:1.0:1762167008.149696:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dc33100. 00002000:00100000:3.0:1762167008.149699:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc33480 with x1847765451879168 ext(45050->18446744073709551615) 00002000:00010000:3.0:1762167008.149708:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dc33480. 00000100:00100000:3.0:1762167008.151615:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.151680:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451879424 00000100:00100000:2.0:1762167008.151690:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451879424 00000100:00100000:2.0:1762167008.151745:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19841 00000100:00100000:2.0:1762167008.151755:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56207:x1847765451879424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.151808:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.151829:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ada6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a6b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.151918:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0adad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.151932:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0adad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.151942:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0adad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167008.151968:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:2.0:1762167008.151972:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167008.151989:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0adad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.152012:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ada6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a6b expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.152033:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0adad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a6b expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.152042:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:2.0:1762167008.152045:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167008.152049:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167008.152108:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56207:x1847765451879424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 355us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.152116:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19841 00000100:00100000:0.0:1762167008.154154:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.154201:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451879680 00000100:00100000:2.0:1762167008.154210:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451879680 00000100:00100000:2.0:1762167008.154269:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19842 00000100:00100000:2.0:1762167008.154279:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56207:x1847765451879680:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167008.154328:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.154353:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0adad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a6b expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.154370:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:2.0:1762167008.154387:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167008.154604:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.154618:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.154627:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167008.154693:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952935 00000004:00010000:2.0:1762167008.154725:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000053700206 reply state 0000000092c6ab55 transno 8589952936 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167008.154733:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167008.154852:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56207:x1847765451879680:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 573us (702us total) trans 8589952936 rc 0/0 00000100:00100000:2.0:1762167008.154860:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19842 00000020:00080000:2.0:1762167008.154865:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167008.155845:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.155862:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.155869:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.155875:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167008.155879:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.155887:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.155901:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:2.0:1762167008.155905:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167008.155908:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.155914:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0adb4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167008.156018:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.156060:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451879808 00000100:00100000:2.0:1762167008.156067:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451879808 00000100:00100000:2.0:1762167008.156112:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16948 00000100:00100000:2.0:1762167008.156122:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56207:x1847765451879808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.156136:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.156155:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0adbb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a72 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167008.156176:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 45056, mtime: 0x690888e0, atime: 0x690888de, ctime: 0x690888e0, blocks: 0x83 00010000:00010000:2.0:1762167008.156193:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.156196:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.156203:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0adbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a72 expref: 26 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.156231:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0adbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a72 expref: 26 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.156242:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167008.156286:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56207:x1847765451879808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 165us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.156293:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16948 00000100:00100000:0.0:1762167008.157345:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.157400:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.157432:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451879936 00000100:00100000:3.0:1762167008.157438:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451879936 00000100:00100000:1.0:1762167008.157455:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451880064 00002000:00010000:3.0:1762167008.157462:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (45050->18446744073709551615) 00000100:00100000:1.0:1762167008.157462:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451880064 00002000:00100000:3.0:1762167008.157475:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc30a80 with x1847765451879936 ext(45050->18446744073709551615) 00002000:00010000:1.0:1762167008.157483:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00010000:3.0:1762167008.157486:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dc30a80. 00002000:00100000:1.0:1762167008.157489:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc30700 with x1847765451880064 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167008.157500:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dc30700. 00000100:00100000:3.0:1762167008.157515:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2953 00000100:00100000:3.0:1762167008.157525:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451879936:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167008.157537:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2954 00000100:00100000:1.0:1762167008.157549:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451880064:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167008.157815:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 45056 -> 45050 00002000:00010000:3.0:1762167008.157818:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.157820:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167008.157822:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.157823:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.157824:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 131 -> 131 00002000:00010000:1.0:1762167008.157831:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167008.157834:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167008.157837:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167008.157839:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:3.0:1762167008.157876:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451879936:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 351us (532us total) trans 21474843375 rc 0/0 00000100:00100000:1.0:1762167008.157878:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451880064:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 330us (476us total) trans 17179875832 rc 0/0 00000100:00100000:3.0:1762167008.157889:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2953 00002000:00010000:3.0:1762167008.157894:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (45050->18446744073709551615) 00002000:00100000:3.0:1762167008.157897:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc30a80 with x1847765451879936 ext(45050->18446744073709551615) 00000100:00100000:1.0:1762167008.157899:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2954 00002000:00010000:3.0:1762167008.157904:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dc30a80. 00002000:00010000:1.0:1762167008.157906:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00100000:1.0:1762167008.157911:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc30700 with x1847765451880064 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167008.157917:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dc30700. 00000100:00100000:3.0:1762167008.159271:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.159413:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451880192 00000100:00100000:2.0:1762167008.159422:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451880192 00000100:00100000:2.0:1762167008.159481:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19843 00000100:00100000:2.0:1762167008.159490:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56207:x1847765451880192:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.159510:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.159528:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0adc2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a79 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.159604:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0adc9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.159618:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.159629:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167008.159652:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:2.0:1762167008.159656:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167008.159669:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.159691:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0adc2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a79 expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.159713:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0adc9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a79 expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.159721:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:2.0:1762167008.159724:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167008.159727:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167008.159814:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56207:x1847765451880192:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 324us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.159820:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19843 00000100:00100000:0.0:1762167008.161998:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.162120:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451880448 00000100:00100000:3.0:1762167008.162129:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451880448 00000100:00100000:3.0:1762167008.162186:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19844 00000100:00100000:3.0:1762167008.162197:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56207:x1847765451880448:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167008.162249:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167008.162275:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0adc9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a79 expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.162292:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:3.0:1762167008.162297:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167008.162534:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.162554:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.162564:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762167008.162632:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952937 00000004:00010000:3.0:1762167008.162659:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cf3b7d2c reply state 00000000922eee99 transno 8589952938 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.162667:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167008.162760:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56207:x1847765451880448:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 564us (768us total) trans 8589952938 rc 0/0 00000100:00100000:3.0:1762167008.162799:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19844 00000020:00080000:3.0:1762167008.162805:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167008.164076:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.164091:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.164098:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.164104:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167008.164108:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.164115:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.164129:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:1.0:1762167008.164132:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167008.164136:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.164141:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0add0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.164712:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.164806:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451880576 00000100:00100000:2.0:1762167008.164817:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451880576 00000100:00100000:2.0:1762167008.164878:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16949 00000100:00100000:2.0:1762167008.164890:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56207:x1847765451880576:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.164906:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.164925:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0add7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a80 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167008.164953:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 45056, mtime: 0x690888e0, atime: 0x690888de, ctime: 0x690888e0, blocks: 0x103 00010000:00010000:2.0:1762167008.164971:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.164974:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.164981:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0add7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a80 expref: 33 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.164995:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0add7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a80 expref: 33 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.165006:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00000100:00100000:2.0:1762167008.165148:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:56207:x1847765451880576:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 259us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.165155:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16949 00000100:00100000:3.0:1762167008.166943:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.166982:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.167049:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451880704 00000100:00100000:1.0:1762167008.167057:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451880704 00002000:00010000:1.0:1762167008.167095:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (45050->18446744073709551615) 00002000:00100000:1.0:1762167008.167100:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243181880 with x1847765451880704 ext(45050->18446744073709551615) 00002000:00010000:1.0:1762167008.167111:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee243181880. 00000100:00100000:1.0:1762167008.167143:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451880832 00000100:00100000:1.0:1762167008.167146:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451880832 00002000:00010000:1.0:1762167008.167158:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00100000:1.0:1762167008.167161:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243181c00 with x1847765451880832 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167008.167166:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243181c00. 00000100:00100000:1.0:1762167008.167196:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2955 00000100:00100000:1.0:1762167008.167207:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451880704:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167008.167227:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2956 00000100:00100000:0.0:1762167008.167239:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451880832:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167008.167526:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.167530:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 45056 -> 45050 00002000:00010000:0.0:1762167008.167531:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167008.167536:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.167538:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167008.167540:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167008.167544:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167007 -> 1762167008 00002000:00010000:1.0:1762167008.167545:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.167548:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 259 -> 259 00002000:00010000:0.0:1762167008.167554:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167008.167614:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451880832:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 377us (629us total) trans 21474843376 rc 0/0 00000100:00100000:0.0:1762167008.167622:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2956 00002000:00010000:0.0:1762167008.167626:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00100000:0.0:1762167008.167629:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243181c00 with x1847765451880832 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167008.167635:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243181c00. 00000100:00100000:1.0:1762167008.167679:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451880704:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 474us (742us total) trans 17179875833 rc 0/0 00000100:00100000:1.0:1762167008.167687:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2955 00002000:00010000:1.0:1762167008.167691:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (45050->18446744073709551615) 00002000:00100000:1.0:1762167008.167693:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243181880 with x1847765451880704 ext(45050->18446744073709551615) 00002000:00010000:1.0:1762167008.167698:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee243181880. 00000100:00100000:3.0:1762167008.169234:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.169294:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451881088 00000100:00100000:0.0:1762167008.169300:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451881088 00000100:00100000:0.0:1762167008.169369:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19845 00000100:00100000:0.0:1762167008.169390:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56207:x1847765451881088:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167008.169484:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.169505:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.169517:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00010000:0.0:1762167008.169633:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001227f225 reply state 0000000085e3697a transno 8589952939 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.169643:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167008.169724:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56207:x1847765451881088:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 345us (494us total) trans 8589952939 rc 0/0 00000100:00100000:0.0:1762167008.169732:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19845 00010000:00010000:0.0:1762167008.170597:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.170608:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.170615:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.170621:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372a2ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.170625:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.170632:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.170647:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.170650:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.170654:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.170674:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adde lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.171316:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.171400:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.171536:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451881216 00000100:00100000:1.0:1762167008.171537:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451881344 00000100:00100000:2.0:1762167008.171546:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451881216 00000100:00100000:1.0:1762167008.171546:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451881344 00000100:00100000:3.0:1762167008.171609:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.171723:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451881472 00000100:00100000:1.0:1762167008.171728:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451881472 00000100:00100000:0.0:1762167008.171736:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16950 00000100:00100000:3.0:1762167008.171750:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16951 00000100:00100000:0.0:1762167008.171754:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765451881344:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167008.171789:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451881216:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167008.171790:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16952 00000100:00100000:1.0:1762167008.171806:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451881472:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762167008.172013:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167008.172017:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.172019:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167006 -> 1762167008 00002000:00010000:0.0:1762167008.172022:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.172024:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167008.172079:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765451881344:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 331us (678us total) trans 17179875834 rc 0/0 00000100:00100000:0.0:1762167008.172086:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16950 00002000:00010000:0.0:1762167008.172328:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167008.172332:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.172335:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167006 -> 1762167008 00002000:00010000:0.0:1762167008.172337:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.172339:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167008.172384:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2358:x1847765451881472:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 571us (765us total) trans 21474843377 rc 0/0 00000100:00100000:0.0:1762167008.172393:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16952 00002000:00010000:2.0:1762167008.172671:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:2.0:1762167008.172674:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.172677:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167006 -> 1762167008 00002000:00010000:2.0:1762167008.172679:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.172681:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 185 -> 47 00000100:00100000:2.0:1762167008.172717:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451881216:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 957us (1404us total) trans 21474843378 rc 0/0 00000100:00100000:2.0:1762167008.172728:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16951 00000100:00100000:1.0:1762167008.174897:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.174959:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451881728 00000100:00100000:0.0:1762167008.174968:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451881728 00000100:00100000:0.0:1762167008.175023:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7343 00000100:00100000:0.0:1762167008.175033:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242a6d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56207:x1847765451881728:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762167008.175095:0:30820:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0da00/0xf915a5bdf3d0ac79 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39f4 expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.175152:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167008.175169:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0aca3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39fb expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.175177:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167008.175209:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0aca3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39fb expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.175221:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0aca3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39fb expref: 908 pid: 30819 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167008.175235:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454468096:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167008.175309:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.176450:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454468096:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.176472:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167008.177123:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.177173:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451881856 00000100:00100000:0.0:1762167008.177180:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451881856 00010000:00010000:0.0:1762167008.177212:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0aca3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39fb expref: 909 pid: 30819 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1762167008.177258:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7515 00000100:00100000:0.0:1762167008.177268:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:2360:x1847765451881856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167008.177287:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.177295:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0aca3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39fb expref: 909 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167008.177308:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0aca3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39fb expref: 909 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167008.177328:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0aca3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39fb expref: 909 pid: 30819 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1762167008.177346:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:0.0:1762167008.177352:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167008.177361:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167008.177369:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167008.177408:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167008.177446:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2360:x1847765451881856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 181us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.177452:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7515 00010000:00010000:2.0:1762167008.177545:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.177553:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000040:00080000:2.0:1762167008.178176:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5462, 88 off441016 00000004:00080000:2.0:1762167008.178187:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628970423598ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.178257:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5470, 88 off442072 00000004:00080000:2.0:1762167008.178266:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628970502838ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.178311:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5471, 88 off442160 00000004:00080000:2.0:1762167008.178317:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628970553928ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.178364:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5463, 88 off441104 00000004:00080000:2.0:1762167008.178369:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628970606653ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.178407:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5472, 88 off442248 00000004:00080000:2.0:1762167008.178410:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628970647768ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.178435:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5464, 88 off441192 00000004:00080000:2.0:1762167008.178440:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628970677343ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.178455:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5465, 88 off441280 00000004:00080000:2.0:1762167008.178459:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628970696183ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.178473:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5473, 88 off442336 00000004:00080000:2.0:1762167008.178476:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628970713455ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.178542:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5475, 88 off442456 00000004:00080000:2.0:1762167008.178548:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628970784723ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.178588:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5466, 88 off441368 00000004:00080000:2.0:1762167008.178593:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628970830345ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.178626:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5476, 88 off442544 00000004:00080000:2.0:1762167008.178631:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628970867885ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.178663:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5467, 88 off441456 00000004:00080000:2.0:1762167008.178667:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628970904026ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.178692:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5468, 88 off441544 00000004:00080000:2.0:1762167008.178697:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628970934243ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.178718:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5477, 88 off442632 00000004:00080000:2.0:1762167008.178722:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628970959490ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.178759:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5478, 88 off442720 00000004:00080000:2.0:1762167008.178792:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628971028789ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.178813:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5469, 88 off441632 00000004:00080000:2.0:1762167008.178817:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628971054500ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.178845:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5470, 88 off441720 00000004:00080000:2.0:1762167008.178850:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628971087308ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.178866:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5479, 88 off442808 00000004:00080000:2.0:1762167008.178870:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628971107410ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.178888:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5480, 88 off442896 00000004:00080000:2.0:1762167008.178893:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628971130184ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.178912:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5471, 88 off441808 00000004:00080000:2.0:1762167008.178916:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628971153809ns, next at 628532618837ns, rc = 0 00000001:00080000:2.0:1762167008.195243:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952939 is committed 00000004:00010000:3.0:1762167008.195255:0:30820:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a02cff41 reply state 0000000035c3ca9c transno 8589952940 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167008.195274:0:30820:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1762167008.195274:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952940 is committed 00000004:00080000:2.0:1762167008.195280:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3579 committed 00010000:00010000:3.0:1762167008.195285:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:3.0:1762167008.195289:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:2.0:1762167008.195298:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3592 committed 00010000:00010000:3.0:1762167008.195299:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f0da00/0xf915a5bdf3d0ac79 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb39f4 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762167008.195319:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3591 committed 00000004:00080000:2.0:1762167008.195324:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3578 committed 00000004:00080000:2.0:1762167008.195327:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3577 committed 00000004:00080000:2.0:1762167008.195330:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3590 committed 00000004:00080000:2.0:1762167008.195333:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3589 committed 00000004:00080000:2.0:1762167008.195336:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3576 committed 00000004:00080000:2.0:1762167008.195338:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3575 committed 00000004:00080000:2.0:1762167008.195340:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3588 committed 00000004:00080000:2.0:1762167008.195343:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3574 committed 00000004:00080000:2.0:1762167008.195347:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3587 committed 00000004:00080000:2.0:1762167008.195350:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3586 committed 00000004:00080000:2.0:1762167008.195352:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3573 committed 00000004:00080000:2.0:1762167008.195354:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3572 committed 00000004:00080000:2.0:1762167008.195356:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3585 committed 00000004:00080000:2.0:1762167008.195359:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3571 committed 00000004:00080000:2.0:1762167008.195362:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3584 committed 00000004:00080000:2.0:1762167008.195364:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3583 committed 00000004:00080000:2.0:1762167008.195369:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3570 committed 00000100:00100000:2.0:1762167008.195428:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454468480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.195492:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.195535:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454468992:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1762167008.195559:0:30820:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762167008.195565:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.195576:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454468224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.195579:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242a6d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56207:x1847765451881728:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 20546us (20691us total) trans 8589952940 rc 0/0 00000100:00100000:2.0:1762167008.195591:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454469504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.195594:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7343 00000100:00100000:0.0:1762167008.195632:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.195638:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454468608:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167008.195656:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.195665:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167008.195672:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454468736:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1762167008.195675:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167008.195678:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.195678:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454468480 00010000:00010000:3.0:1762167008.195688:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372a2ca00 already unused, calling callback (ffffffffc2129310) 00000100:00100000:1.0:1762167008.195688:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454468480 00010000:00010000:3.0:1762167008.195695:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167008.195707:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454469120:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167008.195709:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167008.195715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167008.195732:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee242bba400) 00010000:00010000:3.0:1762167008.195735:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167008.195740:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167008.195743:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.195747:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454469248:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167008.195753:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ca00/0xf915a5bdf3d0ade5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167008.195755:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454468992 00000100:00100000:1.0:1762167008.195779:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454468992 00000100:00100000:2.0:1762167008.195785:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454469632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.195803:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454468224 00000100:00100000:1.0:1762167008.195806:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454468224 00000100:00100000:0.0:1762167008.195814:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.195833:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454468608 00000100:00100000:1.0:1762167008.195835:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454468736 00000100:00100000:3.0:1762167008.195836:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454469120 00000100:00100000:2.0:1762167008.195838:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454468608 00000100:00100000:1.0:1762167008.195838:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454468736 00000100:00100000:3.0:1762167008.195844:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454469120 00000100:00100000:0.0:1762167008.195849:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454469760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.195854:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454469248 00000100:00100000:2.0:1762167008.195858:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16953 00000100:00100000:1.0:1762167008.195858:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454469248 00000100:00100000:2.0:1762167008.195866:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765454468480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.195879:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16954 00000100:00100000:1.0:1762167008.195887:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16955 00000100:00100000:0.0:1762167008.195893:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.195894:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3293:x1847765454468992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.195902:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765454468224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.195914:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1762167008.195924:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454468352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.195956:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.195975:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454468864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.196006:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.196020:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454469376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.196048:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.196064:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454469888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.196090:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167008.196093:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167008.196094:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.196094:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:3.0:1762167008.196101:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.196102:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.196102:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.196109:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167008.196109:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.196110:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.196115:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.196117:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.196117:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.196119:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167008.196119:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454469760 00002000:00010000:2.0:1762167008.196122:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167008.196122:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 47 00000100:00100000:0.0:1762167008.196125:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454469760 00000100:00100000:0.0:1762167008.196151:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454468352 00000100:00100000:0.0:1762167008.196154:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454468352 00000100:00100000:3.0:1762167008.196170:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454468992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 281us (603us total) trans 17179875835 rc 0/0 00000100:00100000:0.0:1762167008.196172:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454468864 00000100:00100000:2.0:1762167008.196175:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454468480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 307us (680us total) trans 17179875836 rc 0/0 00000100:00100000:1.0:1762167008.196175:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454468224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 277us (544us total) trans 21474843379 rc 0/0 00000100:00100000:0.0:1762167008.196178:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454468864 00000100:00100000:3.0:1762167008.196187:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16954 00000100:00100000:2.0:1762167008.196195:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16953 00000100:00100000:1.0:1762167008.196200:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16955 00000100:00100000:3.0:1762167008.196210:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454469376 00000100:00100000:2.0:1762167008.196216:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454469888 00000100:00100000:2.0:1762167008.196220:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454469888 00000100:00100000:1.0:1762167008.196222:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16956 00000100:00100000:3.0:1762167008.196228:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454469376 00000100:00100000:0.0:1762167008.196231:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16957 00000100:00100000:1.0:1762167008.196232:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454468736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.196248:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454468608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.196249:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16958 00000100:00100000:2.0:1762167008.196262:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454469120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.196269:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16959 00000100:00100000:3.0:1762167008.196280:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454469248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167008.196341:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:1.0:1762167008.196345:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.196348:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167008.196351:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.196353:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167008.196400:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454468736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (688us total) trans 17179875837 rc 0/0 00000100:00100000:1.0:1762167008.196406:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16956 00002000:00010000:2.0:1762167008.196414:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:2.0:1762167008.196417:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.196420:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:1.0:1762167008.196421:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16960 00002000:00010000:2.0:1762167008.196423:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.196425:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167008.196430:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454469760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167008.196444:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167008.196455:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454469120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (714us total) trans 21474843380 rc 0/0 00002000:00010000:0.0:1762167008.196459:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.196462:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.196468:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.196469:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:2.0:1762167008.196472:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16958 00002000:00010000:0.0:1762167008.196476:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.196477:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.196482:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167008.196484:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.196489:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.196491:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16961 00000100:00100000:2.0:1762167008.196501:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454468352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167008.196517:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:1.0:1762167008.196520:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.196523:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167008.196525:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00000100:00100000:3.0:1762167008.196530:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454469248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 250us (715us total) trans 21474843381 rc 0/0 00002000:00010000:1.0:1762167008.196530:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167008.196541:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454468608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 296us (863us total) trans 21474843382 rc 0/0 00000100:00100000:3.0:1762167008.196545:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16959 00000100:00100000:0.0:1762167008.196555:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16957 00000100:00100000:1.0:1762167008.196569:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454469760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 140us (680us total) trans 17179875838 rc 0/0 00000100:00100000:3.0:1762167008.196570:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16962 00000100:00100000:1.0:1762167008.196581:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16960 00000100:00100000:3.0:1762167008.196585:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454468864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.196592:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16963 00002000:00010000:2.0:1762167008.196601:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167008.196602:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16964 00002000:00010000:2.0:1762167008.196606:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00000100:00100000:0.0:1762167008.196608:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454469888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167008.196611:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1762167008.196613:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454469376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167008.196615:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167008.196619:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.196651:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454468352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (695us total) trans 17179875839 rc 0/0 00000100:00100000:2.0:1762167008.196657:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16961 00000100:00080000:2.0:1762167008.196678:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1762167008.196682:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1762167008.196718:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.196722:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.196725:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167008.196727:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.196730:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167008.196783:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.196788:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.196790:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000100:00100000:3.0:1762167008.196794:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454468864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 182us (756us total) trans 21474843383 rc 0/0 00002000:00010000:1.0:1762167008.196794:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.196801:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.196802:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167008.196806:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16962 00002000:00010000:0.0:1762167008.196811:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.196815:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167008.196818:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.196820:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167008.196841:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454469376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (792us total) trans 21474843384 rc 0/0 00000100:00100000:1.0:1762167008.196849:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16964 00000100:00100000:0.0:1762167008.196863:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454469888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 259us (770us total) trans 21474843385 rc 0/0 00000100:00100000:0.0:1762167008.196871:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16963 00000100:00100000:3.0:1762167008.196930:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.196947:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875820 gen 2 00000004:00080000:0.0:1762167008.196954:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce4700, transno 17179875790 00000004:00080000:0.0:1762167008.196965:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc5b800, transno 17179875791 00000004:00080000:0.0:1762167008.196968:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317dc00, transno 17179875792 00000004:00080000:0.0:1762167008.196970:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc59500, transno 17179875793 00000004:00080000:0.0:1762167008.196973:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243307b80, transno 17179875794 00000004:00080000:0.0:1762167008.196975:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243304000, transno 17179875795 00000004:00080000:0.0:1762167008.196978:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce6a00, transno 17179875796 00000004:00080000:0.0:1762167008.196981:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825a300, transno 17179875797 00000004:00080000:0.0:1762167008.196983:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b00380, transno 17179875798 00000004:00080000:0.0:1762167008.196986:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b00000, transno 17179875799 00000004:00080000:0.0:1762167008.196989:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03480, transno 17179875800 00000004:00080000:0.0:1762167008.196991:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317ce00, transno 17179875801 00000004:00080000:0.0:1762167008.196994:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de01c00, transno 17179875802 00000004:00080000:0.0:1762167008.196996:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f797b80, transno 17179875803 00000004:00080000:0.0:1762167008.196999:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317d180, transno 17179875804 00000004:00080000:0.0:1762167008.197001:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317d500, transno 17179875805 00000004:00080000:0.0:1762167008.197004:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de02680, transno 17179875806 00000004:00080000:0.0:1762167008.197007:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f331180, transno 17179875807 00000004:00080000:0.0:1762167008.197010:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f331880, transno 17179875808 00000004:00080000:0.0:1762167008.197013:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f796680, transno 17179875809 00000004:00080000:0.0:1762167008.197016:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb5180, transno 17179875811 00000004:00080000:0.0:1762167008.197019:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb4700, transno 17179875812 00000004:00080000:0.0:1762167008.197023:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284a80, transno 17179875813 00000004:00080000:0.0:1762167008.197026:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f286680, transno 17179875814 00000004:00080000:0.0:1762167008.197030:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4f800, transno 17179875815 00000004:00080000:0.0:1762167008.197034:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcb7800, transno 17179875816 00000004:00080000:0.0:1762167008.197039:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284380, transno 17179875817 00000004:00080000:0.0:1762167008.197045:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f285180, transno 17179875818 00000100:00100000:1.0:1762167008.197046:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454469632 00000004:00080000:0.0:1762167008.197049:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4c000, transno 17179875819 00000100:00100000:1.0:1762167008.197051:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454469632 00000004:00080000:0.0:1762167008.197053:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4ca80, transno 17179875820 00000100:00100000:0.0:1762167008.197063:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee347b06680 x1847765454468352/t17179875839(17179875839) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167024 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762167008.197073:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b06680/2, rc 0, transno 17179875839 00000100:00100000:3.0:1762167008.197077:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454470144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.197080:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16965 00000100:00100000:0.0:1762167008.197082:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454468352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.197092:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454469632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.197104:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843365 gen 2 00000004:00080000:0.0:1762167008.197109:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348256d80, transno 21474843356 00000100:00100000:3.0:1762167008.197118:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167008.197126:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345730700, transno 21474843357 00000004:00080000:0.0:1762167008.197133:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242408000, transno 21474843358 00000004:00080000:0.0:1762167008.197138:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240bb80, transno 21474843359 00000004:00080000:0.0:1762167008.197142:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242409f80, transno 21474843360 00000004:00080000:0.0:1762167008.197145:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240a300, transno 21474843361 00000004:00080000:0.0:1762167008.197150:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242408a80, transno 21474843362 00000004:00080000:0.0:1762167008.197153:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d68a80, transno 21474843363 00000004:00080000:0.0:1762167008.197157:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d68000, transno 21474843364 00000004:00080000:0.0:1762167008.197160:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d68380, transno 21474843365 00000100:00100000:0.0:1762167008.197168:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee243306a00 x1847765454468864/t21474843383(21474843383) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167024 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00010000:1.0:1762167008.197174:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 45050 -> 45050 00000004:00080000:0.0:1762167008.197177:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243306a00/2, rc 0, transno 21474843383 00002000:00010000:1.0:1762167008.197178:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00000004:00080000:3.0:1762167008.197180:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc31f80/2, rc 0, transno 21474843382 00002000:00010000:1.0:1762167008.197182:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167008.197187:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00000100:00100000:0.0:1762167008.197188:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454468864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.197190:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454468608:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167008.197192:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000004:00080000:0.0:1762167008.197214:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243304e00/2, rc 0, transno 21474843384 00000004:00080000:3.0:1762167008.197215:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243306300/2, rc 0, transno 21474843380 00000100:00100000:3.0:1762167008.197223:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454469120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.197225:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454469376:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167008.197238:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243305f80/2, rc 0, transno 21474843386 00000100:00100000:1.0:1762167008.197244:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454469632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 150us (309us total) trans 21474843386 rc 0/0 00000004:00080000:0.0:1762167008.197247:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e447b80/2, rc 0, transno 21474843385 00000100:00100000:3.0:1762167008.197248:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454469632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.197251:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454470144 00000100:00100000:2.0:1762167008.197258:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454470144 00000100:00100000:1.0:1762167008.197262:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16965 00000100:00100000:0.0:1762167008.197262:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454469888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.197279:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167008.197285:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc30000/2, rc 0, transno 21474843379 00000100:00100000:0.0:1762167008.197293:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454468224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.197295:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454469504 00000100:00100000:1.0:1762167008.197301:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454469504 00000100:00100000:2.0:1762167008.197305:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16966 00000004:00080000:0.0:1762167008.197310:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b07800/2, rc 0, transno 17179875837 00000100:00100000:3.0:1762167008.197311:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454470016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.197318:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454470144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.197319:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454468736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.197331:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16967 00000004:00080000:0.0:1762167008.197340:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243304700/2, rc 0, transno 21474843381 00000100:00100000:1.0:1762167008.197341:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454469504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.197348:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454469248:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167008.197362:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b06a00/2, rc 0, transno 17179875838 00000100:00100000:0.0:1762167008.197366:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454469760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.197416:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167008.197453:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b04700/2, rc 0, transno 17179875835 00000100:00100000:3.0:1762167008.197460:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454468992:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167008.197479:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b05880/2, rc 0, transno 17179875836 00002000:00010000:2.0:1762167008.197483:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 45050 -> 45050 00000100:00100000:3.0:1762167008.197485:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454468480:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167008.197497:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:2.0:1762167008.197499:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.197502:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.197505:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167008.197507:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167008.197509:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00000100:00100000:3.0:1762167008.197511:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454470016 00002000:00010000:1.0:1762167008.197514:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00000100:00100000:3.0:1762167008.197516:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454470016 00002000:00010000:2.0:1762167008.197516:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167008.197519:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167008.197552:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16968 00000100:00100000:3.0:1762167008.197563:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454470016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.197568:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454470144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (448us total) trans 17179875840 rc 0/0 00000100:00100000:1.0:1762167008.197575:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454469504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 234us (295us total) trans 17179875841 rc 0/0 00000100:00100000:2.0:1762167008.197581:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16966 00000100:00100000:1.0:1762167008.197590:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16967 00002000:00010000:3.0:1762167008.197710:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.197714:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.197717:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167008.197720:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.197723:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167008.197790:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454470016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (346us total) trans 17179875842 rc 0/0 00000100:00100000:3.0:1762167008.197798:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16968 00000004:00080000:0.0:1762167008.197823:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 8 in progress, 3 in flight, 30 done 00000004:00080000:3.0:1762167008.197839:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b04e00/2, rc 0, transno 17179875841 00000100:00100000:3.0:1762167008.197847:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454469504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167008.197857:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2477d0700/2, rc 0, transno 17179875842 00000100:00100000:3.0:1762167008.197862:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454470016:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167008.197863:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 0 in flight, 10 done 00000004:00080000:3.0:1762167008.197900:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2477d0000/2, rc 0, transno 17179875840 00000100:00100000:3.0:1762167008.197906:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454470144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.197914:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1762167008.197922:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454470528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.197942:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454470400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.197950:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.197954:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762167008.197967:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454470656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.197981:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.197982:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454470528 00000100:00100000:3.0:1762167008.197988:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454470528 00000100:00100000:3.0:1762167008.198013:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454470400 00000100:00100000:3.0:1762167008.198016:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454470400 00000100:00100000:1.0:1762167008.198039:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454470272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.198040:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16969 00000100:00100000:3.0:1762167008.198050:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454470528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167008.198136:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.198139:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.198141:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167008.198143:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.198145:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.198222:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.198237:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454470656 00000100:00100000:0.0:1762167008.198243:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454470656 00000100:00100000:1.0:1762167008.198248:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16970 00000100:00100000:1.0:1762167008.198260:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454470400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.198268:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.198279:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454470272 00000100:00100000:0.0:1762167008.198283:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454470272 00000100:00100000:3.0:1762167008.198312:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454470528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 260us (360us total) trans 21474843387 rc 0/0 00000100:00100000:0.0:1762167008.198319:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16971 00000100:00100000:2.0:1762167008.198327:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16972 00000100:00100000:0.0:1762167008.198331:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454470656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.198337:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16969 00000100:00100000:2.0:1762167008.198342:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454470272:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167008.198372:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee359064a80/2, rc 0, transno 21474843387 00000100:00100000:3.0:1762167008.198391:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454470528:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167008.198402:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:1.0:1762167008.198407:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.198410:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167008.198413:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.198415:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 131 -> 131 00000100:00100000:1.0:1762167008.198464:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454470400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (484us total) trans 21474843388 rc 0/0 00000100:00100000:1.0:1762167008.198472:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16970 00000004:00080000:3.0:1762167008.198481:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee359064e00/2, rc 0, transno 21474843388 00000100:00100000:3.0:1762167008.198488:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454470400:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167008.198497:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:0.0:1762167008.198502:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.198504:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167008.198507:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.198509:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 259 -> 259 00002000:00010000:2.0:1762167008.198510:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167008.198515:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.198517:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167008.198520:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.198522:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167008.198557:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3293:x1847765454470656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (337us total) trans 17179875843 rc 0/0 00000100:00100000:0.0:1762167008.198565:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16971 00000100:00100000:2.0:1762167008.198570:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454470272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (302us total) trans 17179875844 rc 0/0 00000100:00100000:2.0:1762167008.198579:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16972 00000004:00080000:3.0:1762167008.198623:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242408e00/2, rc 0, transno 17179875843 00000100:00100000:3.0:1762167008.198629:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454470656:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167008.198686:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240b100/2, rc 0, transno 17179875844 00000100:00100000:1.0:1762167008.198691:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454470272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.199529:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.199743:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451881984 00000100:00100000:0.0:1762167008.199749:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451881984 00000100:00100000:0.0:1762167008.199828:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19846 00000100:00100000:0.0:1762167008.199837:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56207:x1847765451881984:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.199853:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.199875:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a87 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.199929:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a87 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.199950:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a87 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.199969:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:0.0:1762167008.199973:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167008.199976:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372a2ce00, rc 0) 00000100:00100000:0.0:1762167008.200028:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56207:x1847765451881984:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 192us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.200040:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19846 00000100:00100000:1.0:1762167008.202858:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.202922:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451882240 00000100:00100000:3.0:1762167008.202944:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451882240 00000100:00100000:3.0:1762167008.203006:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7344 00000100:00100000:3.0:1762167008.203017:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56207:x1847765451882240:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167008.203277:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56207:x1847765451882240:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 262us (427us total) trans 8589952941 rc 0/0 00000100:00100000:3.0:1762167008.203285:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7344 00000100:00100000:3.0:1762167008.213055:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.213137:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451882368 00000100:00100000:2.0:1762167008.213149:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451882368 00000100:00100000:2.0:1762167008.213219:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19847 00000100:00100000:2.0:1762167008.213229:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56208:x1847765451882368:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.213253:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.213276:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0adf3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a8e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.213352:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0adfa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213365:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0adfa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213391:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0adfa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213407:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0ae01 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213414:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0ae01 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213420:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0ae01 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213523:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213532:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213538:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167008.213569:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:2.0:1762167008.213573:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167008.213589:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213600:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213608:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0adfa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213614:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0adfa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213620:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0adfa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213625:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167008.213628:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0adfa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213633:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0adfa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213642:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167008.213645:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167008.213648:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0adfa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213651:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0adfa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213661:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0ae01 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213664:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0ae01 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213668:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0ae01 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213671:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167008.213674:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0ae01 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213679:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0ae01 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213685:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0b00) 00010000:00010000:2.0:1762167008.213687:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167008.213690:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0ae01 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213695:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0ae01 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.213723:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0adf3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a8e expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.213736:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a8e expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.213743:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167008.213745:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167008.213748:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:2.0:1762167008.213870:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56208:x1847765451882368:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 641us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.213877:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19847 00000100:00100000:2.0:1762167008.216606:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.216707:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451882624 00000100:00100000:0.0:1762167008.216717:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451882624 00000100:00100000:3.0:1762167008.216812:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19848 00000100:00100000:3.0:1762167008.216826:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56208:x1847765451882624:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167008.216846:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.216865:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae0f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a95 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.216958:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0ae16 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.216971:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0ae16 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.216987:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0ae16 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167008.216999:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00010000:00010000:3.0:1762167008.217144:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae0f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a95 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.217163:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0ae16 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a95 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.217177:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167008.217180:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167008.217183:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:3.0:1762167008.217241:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56208:x1847765451882624:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 420us (644us total) trans 8589952942 rc 0/0 00000100:00100000:3.0:1762167008.217247:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19848 00000100:00100000:1.0:1762167008.219194:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.219251:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451882880 00000100:00100000:3.0:1762167008.219260:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451882880 00000100:00100000:3.0:1762167008.219313:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19849 00000100:00100000:3.0:1762167008.219324:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56208:x1847765451882880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167008.219344:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.219360:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0ae24 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3a9c expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.219456:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ae2b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.219470:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ae2b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.219480:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ae2b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167008.219490:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00010000:00010000:3.0:1762167008.219590:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0ae24 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a9c expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.219606:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ae2b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a9c expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.219615:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167008.219618:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167008.219621:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:3.0:1762167008.219679:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56208:x1847765451882880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 357us (492us total) trans 8589952943 rc 0/0 00000100:00100000:3.0:1762167008.219686:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19849 00000100:00100000:0.0:1762167008.246805:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.248217:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451883008 00000100:00100000:1.0:1762167008.248231:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451883008 00000100:00100000:1.0:1762167008.248320:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2957 00000100:00100000:1.0:1762167008.248332:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451883008:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167008.248368:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae39 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.248396:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.248399:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.248404:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.248420:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.250709:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae39 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.250727:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.250736:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.250744:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.250748:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.250757:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.250803:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.250810:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.250981:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451883008:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2645us (4218us total) trans 0 rc 45050/45050 00000100:00100000:1.0:1762167008.250992:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2957 00000100:00100000:2.0:1762167008.253159:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.253207:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451883136 00000100:00100000:1.0:1762167008.253219:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451883136 00000100:00100000:1.0:1762167008.253295:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2958 00000100:00100000:1.0:1762167008.253306:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2358:x1847765451883136:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167008.253343:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.253361:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0ad13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a1e expref: 35 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.253369:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.253371:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.253388:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.253430:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0ad13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a1e expref: 35 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.253445:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0ad13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a1e expref: 35 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1762167008.253460:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454470784:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.253543:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.255261:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454470784:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167008.255274:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167008.255295:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.255482:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451883264 00000100:00100000:2.0:1762167008.255490:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451883264 00010000:00010000:2.0:1762167008.255521:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0ad13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a1e expref: 36 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.255562:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7516 00000100:00100000:2.0:1762167008.255571:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451883264:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.255585:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.255618:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0ad13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a1e expref: 36 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.255630:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0ad13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a1e expref: 36 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.255659:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0ad13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a1e expref: 36 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.255673:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.255675:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.255679:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.255688:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.255716:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167008.255753:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.255793:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.255811:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451883264:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 239us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.255820:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7516 00010000:00010000:1.0:1762167008.257980:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.257998:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.258006:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.258013:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.258017:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.258025:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.258042:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.258050:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.258729:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451883136:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5419us (5573us total) trans 0 rc 45050/45050 00000100:00100000:1.0:1762167008.258741:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2958 00000100:00100000:2.0:1762167008.261718:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.261796:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451883392 00000100:00100000:1.0:1762167008.261808:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451883392 00000100:00100000:1.0:1762167008.261925:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2959 00000100:00100000:1.0:1762167008.261941:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451883392:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167008.261984:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.262003:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a2c expref: 30 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.262011:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.262021:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.262025:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.262071:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a2c expref: 30 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.262091:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a2c expref: 30 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1762167008.262110:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454470912:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.262222:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.263558:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454470912:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167008.263581:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.263854:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.263908:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451883520 00000100:00100000:0.0:1762167008.263916:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451883520 00010000:00010000:0.0:1762167008.263949:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a2c expref: 31 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167008.263987:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7517 00000100:00100000:0.0:1762167008.263999:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451883520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167008.264013:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.264041:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a2c expref: 31 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.264054:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a2c expref: 31 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.264079:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee372a2de00/0xf915a5bdf3d0ad2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a2c expref: 31 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.264095:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.264097:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.264101:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.264124:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.264157:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167008.264209:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.264213:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451883520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 214us (360us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167008.264218:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.264220:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7517 00010000:00010000:1.0:1762167008.265534:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.265548:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.265557:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.265563:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.265568:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.265575:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.265590:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.265596:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0ae47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.265675:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451883392:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3730us (3962us total) trans 0 rc 45050/45050 00000100:00100000:1.0:1762167008.265685:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2959 00000100:00100000:0.0:1762167008.268258:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.268303:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451883648 00000100:00100000:1.0:1762167008.268314:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451883648 00000100:00100000:1.0:1762167008.268390:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2960 00000100:00100000:1.0:1762167008.268400:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451883648:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167008.268433:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.268453:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ad4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a3a expref: 34 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.268462:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.268464:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.268468:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.268501:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ad4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a3a expref: 34 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.268515:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ad4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a3a expref: 34 pid: 6535 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1762167008.268531:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454471040:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.268625:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.270440:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454471040:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167008.270468:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.270564:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.270657:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451883776 00000100:00100000:2.0:1762167008.270664:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451883776 00010000:00010000:2.0:1762167008.270695:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ad4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a3a expref: 35 pid: 6535 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.270723:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7518 00000100:00100000:2.0:1762167008.270749:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451883776:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.270853:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.270882:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ad4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a3a expref: 35 pid: 6535 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.270895:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ad4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a3a expref: 35 pid: 6535 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.270918:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ad4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a3a expref: 35 pid: 6535 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.270932:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.270934:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.270938:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.270946:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.270977:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.271026:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451883776:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 293us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.271034:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7518 00010000:00010000:1.0:1762167008.271040:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.271049:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.272271:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.272285:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.272294:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.272301:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.272305:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.272313:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.272327:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.272334:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.272415:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2358:x1847765451883648:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4014us (4161us total) trans 0 rc 45050/45050 00000100:00100000:1.0:1762167008.272425:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2960 00000100:00100000:3.0:1762167008.274245:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.274334:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451883904 00000100:00100000:1.0:1762167008.274348:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451883904 00000100:00100000:1.0:1762167008.274431:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2961 00000100:00100000:1.0:1762167008.274441:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451883904:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167008.274476:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.274494:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a48 expref: 33 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.274502:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.274504:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.274507:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.274556:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a48 expref: 33 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.274570:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a48 expref: 33 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1762167008.274586:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454471168:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.274671:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.275949:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454471168:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167008.275977:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167008.276244:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.276400:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451884032 00000100:00100000:2.0:1762167008.276406:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451884032 00010000:00010000:2.0:1762167008.276438:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a48 expref: 34 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.276474:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7519 00000100:00100000:2.0:1762167008.276484:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451884032:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.276498:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.276520:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a48 expref: 34 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.276532:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a48 expref: 34 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.276565:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee372a2c000/0xf915a5bdf3d0ad67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a48 expref: 34 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.276580:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.276583:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.276587:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.276596:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.276626:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.276679:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451884032:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 195us (436us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167008.276684:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.276689:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7519 00010000:00010000:1.0:1762167008.276701:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.278217:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.278239:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.278248:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.278256:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.278262:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.278273:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.278294:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.278303:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.278420:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451883904:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3974us (4175us total) trans 0 rc 45050/45050 00000100:00100000:1.0:1762167008.278432:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2961 00000100:00100000:2.0:1762167008.281100:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.281200:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451884160 00000100:00100000:1.0:1762167008.281218:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451884160 00000100:00100000:1.0:1762167008.281321:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2962 00000100:00100000:1.0:1762167008.281332:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451884160:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167008.281398:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.281424:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ad83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a56 expref: 29 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.281438:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.281442:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.281449:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.281501:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ad83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a56 expref: 29 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.281518:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ad83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a56 expref: 29 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1762167008.281536:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454471296:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.281642:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.283136:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454471296:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167008.283172:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.284159:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.284274:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451884288 00000100:00100000:0.0:1762167008.284285:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451884288 00010000:00010000:0.0:1762167008.284326:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ad83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a56 expref: 30 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167008.284367:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7520 00000100:00100000:0.0:1762167008.284390:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451884288:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167008.284407:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.284431:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ad83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a56 expref: 30 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.284446:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ad83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a56 expref: 30 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.284470:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b1800/0xf915a5bdf3d0ad83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a56 expref: 30 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.284495:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.284498:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.284503:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.284514:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.284553:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167008.284604:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.284620:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.284632:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451884288:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 251us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.284644:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7520 00010000:00010000:1.0:1762167008.287989:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.288012:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.288019:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.288026:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.288030:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.288039:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.288058:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.288064:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0ae5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.288160:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451884160:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6825us (7066us total) trans 0 rc 45050/45050 00000100:00100000:1.0:1762167008.288171:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2962 00000100:00100000:0.0:1762167008.290328:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.291071:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451884416 00000100:00100000:1.0:1762167008.291085:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451884416 00000100:00100000:1.0:1762167008.291161:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2963 00000100:00100000:1.0:1762167008.291171:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451884416:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167008.291204:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.291223:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a64 expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.291232:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.291234:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167008.291237:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.291269:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a64 expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.291284:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a64 expref: 32 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1762167008.291299:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454471424:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.291393:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.294854:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.294944:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454471424:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.294973:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.295059:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451884544 00000100:00100000:0.0:1762167008.295068:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451884544 00010000:00010000:0.0:1762167008.295103:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a64 expref: 33 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167008.295143:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7521 00000100:00100000:0.0:1762167008.295151:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451884544:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167008.295167:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.295189:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a64 expref: 33 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.295201:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a64 expref: 33 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.295228:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b0200/0xf915a5bdf3d0ad9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a64 expref: 33 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.295243:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.295245:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.295249:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.295259:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.295290:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167008.295352:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451884544:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 201us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.295359:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7521 00010000:00010000:2.0:1762167008.295680:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.295691:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.298451:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.298468:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.298477:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.298483:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167008.298487:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.298495:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.298515:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.298522:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0ae63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.298624:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451884416:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 7450us (8300us total) trans 0 rc 45050/45050 00000100:00100000:2.0:1762167008.298635:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2963 00000100:00100000:1.0:1762167008.301515:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.301572:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451884672 00000100:00100000:2.0:1762167008.301584:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451884672 00000100:00100000:2.0:1762167008.301664:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2964 00000100:00100000:2.0:1762167008.301675:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451884672:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167008.301711:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.301742:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0adbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a72 expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.301751:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167008.301753:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167008.301756:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.301824:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0adbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a72 expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.301839:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0adbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a72 expref: 28 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.301855:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454471552:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.301952:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460240 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.303288:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454471552:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.303310:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.303867:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.303985:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451884800 00000100:00100000:3.0:1762167008.303992:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451884800 00010000:00010000:3.0:1762167008.304023:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0adbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a72 expref: 29 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:3.0:1762167008.304073:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7522 00000100:00100000:3.0:1762167008.304084:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451884800:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167008.304104:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167008.304130:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0adbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a72 expref: 29 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.304144:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0adbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a72 expref: 29 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.304167:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0adbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a72 expref: 29 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.304183:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.304184:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.304188:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.304197:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.304231:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167008.304287:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451884800:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 204us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.304296:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7522 00010000:00010000:2.0:1762167008.304298:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.304309:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.305952:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.305970:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.305978:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.305985:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167008.305990:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.305999:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.306016:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.306023:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0ae6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.306112:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451884672:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4437us (4602us total) trans 0 rc 45050/45050 00000100:00100000:2.0:1762167008.306122:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2964 00000100:00100000:1.0:1762167008.308718:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.309047:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451884928 00000100:00100000:2.0:1762167008.309061:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451884928 00000100:00100000:2.0:1762167008.309157:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2965 00000100:00100000:2.0:1762167008.309168:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451884928:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167008.309207:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.309227:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0add7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a80 expref: 31 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.309236:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167008.309238:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167008.309242:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.309282:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0add7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a80 expref: 31 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.309296:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0add7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a80 expref: 31 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.309310:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454471680:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.309407:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460240 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.311082:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:14117:1847765454471680:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.311103:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.312158:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.312205:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451885056 00000100:00100000:3.0:1762167008.312253:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451885056 00010000:00010000:3.0:1762167008.312296:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0add7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a80 expref: 32 pid: 12400 timeout: 729 lvb_type: 0 00000100:00100000:3.0:1762167008.312352:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7523 00000100:00100000:3.0:1762167008.312363:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451885056:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167008.312393:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167008.312430:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0add7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a80 expref: 32 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.312445:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0add7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a80 expref: 32 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.312478:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0add7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a80 expref: 32 pid: 12400 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.312500:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.312502:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.312505:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.312513:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.312538:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167008.312576:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167008.312586:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451885056:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 225us (431us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167008.312587:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167008.312598:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7523 00010000:00010000:2.0:1762167008.313790:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.313804:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.313813:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.313820:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167008.313825:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.313834:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.313848:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.313855:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.313943:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451884928:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4774us (5236us total) trans 0 rc 45050/45050 00000100:00100000:2.0:1762167008.313953:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2965 00000100:00100000:0.0:1762167008.321711:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.321808:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451885184 00000100:00100000:3.0:1762167008.321820:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451885184 00000100:00100000:3.0:1762167008.322060:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 649 00000100:00100000:3.0:1762167008.322072:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56208:x1847765451885184:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:3.0:1762167008.322090:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167008.322117:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ae2b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a9c expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.322141:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167008.322147:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167008.322334:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56208:x1847765451885184:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 263us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.322345:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 649 00000100:00100000:1.0:1762167008.323723:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.324160:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451885440 00000100:00100000:3.0:1762167008.324169:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451885440 00000100:00100000:3.0:1762167008.324226:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7345 00000100:00100000:3.0:1762167008.324238:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56208:x1847765451885440:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167008.324501:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56208:x1847765451885440:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 265us (783us total) trans 8589952944 rc 0/0 00000100:00100000:3.0:1762167008.324509:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7345 00000100:00100000:1.0:1762167008.327297:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.327346:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451885696 00000100:00100000:3.0:1762167008.327356:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451885696 00000100:00100000:3.0:1762167008.327433:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19850 00000100:00100000:3.0:1762167008.327445:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451885696:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167008.327485:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.327509:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0ae78 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3aa3 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.327619:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.327634:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a8e expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.327643:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.327682:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a8e expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.327701:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a8e expref: 897 pid: 30817 timeout: 729 lvb_type: 0 00000100:00100000:3.0:1762167008.327714:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454471808:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.328095:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.329943:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454471808:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.329975:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167008.331409:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.331810:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451885824 00000100:00100000:3.0:1762167008.331821:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451885824 00010000:00010000:2.0:1762167008.331955:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a8e expref: 898 pid: 30817 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.332000:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7524 00000100:00100000:2.0:1762167008.332009:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451885824:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.332022:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.332033:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a8e expref: 898 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.332046:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a8e expref: 898 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.332067:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0ae08 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a8e expref: 898 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.332082:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167008.332087:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.332100:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.332108:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.332140:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167008.332175:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.332186:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167008.332196:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451885824:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 188us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.332203:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7524 00000004:00200000:3.0:1762167008.332206:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00010000:00010000:3.0:1762167008.332443:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0ae78 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aa3 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.332475:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aa3 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.332484:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167008.332486:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167008.332489:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167008.332549:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451885696:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 5098us (5253us total) trans 8589952945 rc 0/0 00000100:00100000:3.0:1762167008.332557:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19850 00000100:00100000:1.0:1762167008.334811:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.334846:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451885952 00000100:00100000:3.0:1762167008.334863:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451885952 00000100:00100000:3.0:1762167008.334928:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19851 00000100:00100000:3.0:1762167008.334940:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451885952:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167008.334961:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.334979:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ae8d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3aaa expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.335069:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.335086:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aa3 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.335094:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.335137:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aa3 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.335152:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aa3 expref: 898 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:3.0:1762167008.335167:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454471936:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167008.335262:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.336940:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454471936:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167008.336978:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.337001:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.337143:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451886080 00000100:00100000:2.0:1762167008.337151:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451886080 00010000:00010000:2.0:1762167008.337182:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aa3 expref: 899 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.337222:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7525 00000100:00100000:2.0:1762167008.337230:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2361:x1847765451886080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.337244:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.337250:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aa3 expref: 899 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.337263:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aa3 expref: 899 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.337283:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0ae7f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aa3 expref: 899 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.337299:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:2.0:1762167008.337304:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.337312:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.337320:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.337352:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.337417:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451886080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.337426:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7525 00010000:00010000:3.0:1762167008.337435:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.337445:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167008.337488:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 45050 00000004:00200000:3.0:1762167008.337492:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167008.337514:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.337542:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0ae8d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aaa expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.337559:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aaa expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.337566:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167008.337569:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167008.337571:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167008.337608:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451885952:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2669us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.337615:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19851 00000100:00100000:0.0:1762167008.339164:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.339215:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451886208 00000100:00100000:2.0:1762167008.339224:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451886208 00000100:00100000:2.0:1762167008.339283:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16973 00000100:00100000:2.0:1762167008.339292:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451886208:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167008.339309:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.339328:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ab1 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167008.339355:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81e:0x0] initial LVB size: 45050, mtime: 0x690888e0, atime: 0x690888de, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:2.0:1762167008.339372:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.339388:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.339396:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab1 expref: 31 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167008.339412:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab1 expref: 31 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167008.339429:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00000100:00100000:2.0:1762167008.339480:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451886208:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 189us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.339488:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16973 00000100:00100000:1.0:1762167008.341686:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.341741:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451886336 00000100:00100000:2.0:1762167008.341752:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451886336 00002000:00100000:2.0:1762167008.341832:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x81e:0x0] (0->4095) req@ffff9ee36dc32a00 x1847765451886336/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.341841:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc32a00 with x1847765451886336 ext(0->4095) 00002000:00010000:2.0:1762167008.341845:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dc32a00 00000100:00100000:2.0:1762167008.341866:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2966 00000100:00100000:2.0:1762167008.341872:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451886336:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167008.342106:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451886336:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 233us (428us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167008.342115:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2966 00002000:00100000:2.0:1762167008.342122:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x81e:0x0] (0->4095) req@ffff9ee36dc32a00 x1847765451886336/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/4536 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.342130:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dc32a00 with x1847765451886336 ext(0->4095) 00002000:00010000:2.0:1762167008.342133:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dc32a00 00000100:00100000:0.0:1762167008.343990:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.344039:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451886464 00000100:00100000:2.0:1762167008.344047:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451886464 00002000:00100000:2.0:1762167008.344093:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x81e:0x0] (4096->8191) req@ffff9ee372a4c700 x1847765451886464/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.344110:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4c700 with x1847765451886464 ext(4096->8191) 00002000:00010000:2.0:1762167008.344115:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee372a4c700 00000100:00100000:2.0:1762167008.344151:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2967 00000100:00100000:2.0:1762167008.344161:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451886464:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167008.344340:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451886464:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 180us (357us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167008.344348:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2967 00002000:00100000:2.0:1762167008.344354:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x81e:0x0] (4096->8191) req@ffff9ee372a4c700 x1847765451886464/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/4536 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.344361:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4c700 with x1847765451886464 ext(4096->8191) 00002000:00010000:2.0:1762167008.344364:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee372a4c700 00000100:00100000:0.0:1762167008.346322:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.346362:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451886592 00000100:00100000:2.0:1762167008.346370:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451886592 00002000:00100000:2.0:1762167008.346421:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x81e:0x0] (8192->12287) req@ffff9ee372a4ed80 x1847765451886592/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.346434:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4ed80 with x1847765451886592 ext(8192->12287) 00002000:00010000:2.0:1762167008.346439:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee372a4ed80 00000100:00100000:2.0:1762167008.346474:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2968 00000100:00100000:2.0:1762167008.346484:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765451886592:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167008.346650:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765451886592:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 167us (332us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167008.346658:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2968 00002000:00100000:2.0:1762167008.346666:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x81e:0x0] (8192->12287) req@ffff9ee372a4ed80 x1847765451886592/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/4536 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.346674:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4ed80 with x1847765451886592 ext(8192->12287) 00002000:00010000:2.0:1762167008.346677:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee372a4ed80 00000100:00100000:1.0:1762167008.348410:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.348503:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451886720 00000100:00100000:2.0:1762167008.348512:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451886720 00002000:00100000:2.0:1762167008.348562:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x81e:0x0] (12288->45055) req@ffff9ee243181500 x1847765451886720/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.348572:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243181500 with x1847765451886720 ext(12288->45055) 00002000:00010000:2.0:1762167008.348576:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee243181500 00000100:00100000:2.0:1762167008.348599:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2969 00000100:00100000:2.0:1762167008.348605:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451886720:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167008.349950:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451886720:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1338us (1544us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1762167008.349962:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2969 00002000:00100000:2.0:1762167008.349971:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x81e:0x0] (12288->45055) req@ffff9ee243181500 x1847765451886720/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/440 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 32768/32768 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.349981:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243181500 with x1847765451886720 ext(12288->45055) 00002000:00010000:2.0:1762167008.349986:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee243181500 00000100:00100000:0.0:1762167008.353758:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.353863:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451886976 00000100:00100000:3.0:1762167008.353873:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451886976 00000100:00100000:3.0:1762167008.353933:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7346 00000100:00100000:3.0:1762167008.353956:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451886976:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:3.0:1762167008.354237:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451886976:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 290us (485us total) trans 8589952946 rc 0/0 00000100:00100000:3.0:1762167008.354247:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7346 00000100:00100000:1.0:1762167008.356169:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.356243:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451887232 00000100:00100000:3.0:1762167008.356257:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451887232 00000100:00100000:3.0:1762167008.356329:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19852 00000100:00100000:3.0:1762167008.356342:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451887232:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167008.356383:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.356388:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:3.0:1762167008.356425:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0ae94 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3aaa expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.356467:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0ae16 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a95 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.356482:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372a2ce00/0xf915a5bdf3d0adec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a87 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.356497:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8400) 00010000:00010000:3.0:1762167008.356510:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167008.356528:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aea2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ab8 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.356598:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0aea9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.356613:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0aea9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.356624:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0aea9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:2.0:1762167008.357334:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5472, 88 off441896 00000004:00080000:2.0:1762167008.357344:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629149580937ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.357439:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5481, 88 off442984 00000004:00080000:2.0:1762167008.357447:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629149683991ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.357498:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5482, 88 off443072 00000004:00080000:2.0:1762167008.357503:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629149740548ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.357524:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5473, 88 off441984 00000004:00080000:2.0:1762167008.357543:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629149780215ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.357575:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5483, 88 off443160 00000004:00080000:2.0:1762167008.357585:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629149821817ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.357606:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5474, 88 off442072 00000004:00080000:2.0:1762167008.357610:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629149847501ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.357633:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5475, 88 off442160 00000004:00080000:2.0:1762167008.357640:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629149877097ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.357680:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5484, 88 off443248 00000004:00080000:2.0:1762167008.357686:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629149923411ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.357750:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5485, 88 off443336 00000004:00080000:2.0:1762167008.357756:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629149993277ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.357812:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5476, 88 off442248 00000004:00080000:2.0:1762167008.357819:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629150055787ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.357948:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5486, 88 off443424 00000004:00080000:2.0:1762167008.357954:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629150191698ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.357982:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5477, 88 off442336 00000004:00080000:2.0:1762167008.357986:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629150223223ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.358063:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5479, 88 off442456 00000004:00080000:2.0:1762167008.358067:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629150304355ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.358086:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5487, 88 off443512 00000004:00080000:2.0:1762167008.358089:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629150326433ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.358103:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5488, 88 off443600 00000004:00080000:2.0:1762167008.358105:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629150342961ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.358118:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5480, 88 off442544 00000004:00080000:2.0:1762167008.358122:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629150358932ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.358140:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5481, 88 off442632 00000004:00080000:2.0:1762167008.358145:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629150382087ns, next at 628532618837ns, rc = 0 00000040:00080000:2.0:1762167008.358169:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5489, 88 off443688 00000004:00080000:2.0:1762167008.358173:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629150410597ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.358208:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5490, 88 off443776 00000004:00080000:2.0:1762167008.358213:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629150449797ns, next at 628532566027ns, rc = 0 00000040:00080000:2.0:1762167008.358238:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5482, 88 off442720 00000004:00080000:2.0:1762167008.358242:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629150479495ns, next at 628532618837ns, rc = 0 00000001:00080000:2.0:1762167008.374094:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952947 is committed 00000004:00080000:2.0:1762167008.374107:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3589 committed 00000004:00080000:2.0:1762167008.374128:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3602 committed 00000004:00080000:2.0:1762167008.374141:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3601 committed 00010000:00010000:3.0:1762167008.374143:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0aea9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab8 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762167008.374145:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3588 committed 00000004:00080000:2.0:1762167008.374149:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3587 committed 00000004:00080000:2.0:1762167008.374153:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3600 committed 00010000:00010000:3.0:1762167008.374161:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00000004:00080000:2.0:1762167008.374162:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3599 committed 00000004:00080000:2.0:1762167008.374166:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3586 committed 00010000:00010000:3.0:1762167008.374168:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:2.0:1762167008.374169:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3585 committed 00000004:00080000:2.0:1762167008.374173:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3598 committed 00000004:00080000:2.0:1762167008.374176:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3584 committed 00000004:00080000:2.0:1762167008.374178:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3597 committed 00000004:00080000:2.0:1762167008.374179:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3596 committed 00000004:00080000:2.0:1762167008.374182:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3583 committed 00000004:00080000:2.0:1762167008.374184:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3582 committed 00000004:00080000:2.0:1762167008.374188:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3595 committed 00010000:00010000:3.0:1762167008.374191:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aea2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab8 expref: 897 pid: 30819 timeout: 0 lvb_type: 3 00000004:00080000:2.0:1762167008.374192:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3581 committed 00000004:00080000:2.0:1762167008.374196:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3594 committed 00000004:00080000:2.0:1762167008.374200:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3593 committed 00000004:00080000:2.0:1762167008.374203:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3580 committed 00010000:00010000:3.0:1762167008.374227:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0aea9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab8 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.374264:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:3.0:1762167008.374266:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762167008.374270:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922200, rc 0) 00000100:00100000:3.0:1762167008.374357:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451887232:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 18016us (18201us total) trans 8589952947 rc 0/0 00000100:00100000:3.0:1762167008.374366:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19852 00000100:00100000:2.0:1762167008.374428:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454472064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.374487:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454472192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.374508:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.374536:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454472320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.374563:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.374567:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454472576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.374591:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454472832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.374608:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.374638:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.374648:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454473088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.374665:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454472064 00000100:00100000:0.0:1762167008.374672:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454472704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.374675:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454472064 00000100:00100000:2.0:1762167008.374684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.374705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.374714:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454473600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.374720:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454472320 00000100:00100000:3.0:1762167008.374725:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454472320 00000100:00100000:1.0:1762167008.374727:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454472576 00000100:00100000:1.0:1762167008.374733:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454472576 00000100:00100000:0.0:1762167008.374739:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454473216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.374746:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.374758:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454472192 00000100:00100000:1.0:1762167008.374792:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454473088 00000100:00100000:0.0:1762167008.374792:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.374795:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454473088 00000100:00100000:0.0:1762167008.374813:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454473728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.374814:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454472192 00000100:00100000:1.0:1762167008.374815:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454472704 00000100:00100000:1.0:1762167008.374820:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454472704 00000100:00100000:2.0:1762167008.374827:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454473600 00000100:00100000:2.0:1762167008.374832:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454473600 00000100:00100000:0.0:1762167008.374843:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.374848:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454473216 00000100:00100000:1.0:1762167008.374848:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454473728 00000100:00100000:3.0:1762167008.374854:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454473216 00000100:00100000:2.0:1762167008.374864:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16974 00000100:00100000:1.0:1762167008.374865:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454473728 00000100:00100000:2.0:1762167008.374880:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3295:x1847765454472064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.374880:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16975 00000100:00100000:3.0:1762167008.374889:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16976 00000100:00100000:0.0:1762167008.374894:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3293:x1847765454472320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.374896:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16977 00000100:00100000:3.0:1762167008.374903:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1847765454472576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.374908:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454473088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167008.375094:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167008.375094:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.375098:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167008.375098:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.375103:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.375103:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762167008.375103:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167008.375107:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167008.375107:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.375109:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.375113:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:3.0:1762167008.375114:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167008.375114:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167008.375114:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167008.375122:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.375123:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.375129:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.375130:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167008.375136:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.375139:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 47 00000100:00100000:0.0:1762167008.375149:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454472320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 259us (584us total) trans 21474843389 rc 0/0 00000100:00100000:1.0:1762167008.375152:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3295:x1847765454473088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (470us total) trans 17179875845 rc 0/0 00000100:00100000:0.0:1762167008.375157:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16975 00000100:00100000:1.0:1762167008.375160:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16977 00000100:00100000:0.0:1762167008.375175:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16978 00000100:00100000:1.0:1762167008.375181:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16979 00000100:00100000:3.0:1762167008.375186:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454472576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 284us (576us total) trans 21474843390 rc 0/0 00000100:00100000:0.0:1762167008.375187:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454472192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.375188:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454472064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 310us (678us total) trans 21474843391 rc 0/0 00000100:00100000:1.0:1762167008.375193:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454472704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.375207:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16974 00000100:00100000:3.0:1762167008.375218:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16976 00000100:00100000:2.0:1762167008.375229:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16980 00000100:00100000:2.0:1762167008.375241:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454473600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.375243:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16981 00000100:00100000:3.0:1762167008.375256:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3296:x1847765454473216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167008.375297:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.375301:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.375303:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167008.375307:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.375307:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.375310:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167008.375310:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.375312:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.375315:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.375317:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167008.375344:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454472704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (639us total) trans 21474843392 rc 0/0 00000100:00100000:0.0:1762167008.375344:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454472192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (707us total) trans 21474843393 rc 0/0 00000100:00100000:1.0:1762167008.375352:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16979 00000100:00100000:0.0:1762167008.375359:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16978 00000100:00100000:1.0:1762167008.375368:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16982 00000100:00100000:1.0:1762167008.375385:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454473728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167008.375411:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.375415:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.375418:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.375421:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.375423:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:0.0:1762167008.375428:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4e680/2, rc 0, transno 21474843393 00000100:00100000:0.0:1762167008.375441:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454472192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.375451:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1847765454473600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (704us total) trans 17179875847 rc 0/0 00000004:00080000:0.0:1762167008.375456:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4c000/2, rc 0, transno 21474843392 00000100:00100000:2.0:1762167008.375461:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16980 00000100:00100000:3.0:1762167008.375465:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454473216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (671us total) trans 17179875846 rc 0/0 00000100:00100000:0.0:1762167008.375465:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454472704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.375479:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16981 00000004:00080000:0.0:1762167008.375488:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180000/2, rc 0, transno 17179875846 00000100:00100000:0.0:1762167008.375501:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454473216:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167008.375514:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180e00/2, rc 0, transno 17179875847 00000100:00100000:1.0:1762167008.375519:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454473728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (675us total) trans 17179875848 rc 0/0 00000004:00080000:0.0:1762167008.375519:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e447800/2, rc 0, transno 17179875848 00000100:00100000:2.0:1762167008.375524:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454473600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.375526:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454473728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.375529:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16982 00000004:00080000:2.0:1762167008.375550:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180380/2, rc 0, transno 17179875845 00000100:00100000:2.0:1762167008.375555:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454473088:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167008.375568:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4f800/2, rc 0, transno 21474843390 00000100:00100000:2.0:1762167008.375573:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454472576:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167008.375580:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4fb80/2, rc 0, transno 21474843391 00000100:00100000:2.0:1762167008.375584:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454472064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.375596:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454474112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.375623:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.375648:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454474240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.375660:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454472448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.375666:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454474112 00000100:00100000:3.0:1762167008.375671:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454474112 00000100:00100000:1.0:1762167008.375680:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.375712:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454474240 00000100:00100000:3.0:1762167008.375714:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454474240 00000100:00100000:0.0:1762167008.375718:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16983 00000100:00100000:0.0:1762167008.375730:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3295:x1847765454474112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.375734:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16984 00000100:00100000:3.0:1762167008.375743:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454474240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167008.375882:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167008.375886:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.375889:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167008.375891:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.375894:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167008.375920:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454474240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (238us total) trans 17179875850 rc 0/0 00000100:00100000:3.0:1762167008.375929:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16984 00000100:00100000:0.0:1762167008.375941:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454474112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (316us total) trans 17179875849 rc 0/0 00000100:00100000:0.0:1762167008.375950:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16983 00000004:00080000:1.0:1762167008.375951:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce5f80/2, rc 0, transno 17179875850 00000100:00100000:1.0:1762167008.375955:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454474240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.375972:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167008.375999:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce7800/2, rc 0, transno 17179875849 00000100:00100000:0.0:1762167008.376001:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454472960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.376008:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454474112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.376014:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454472448 00000100:00100000:3.0:1762167008.376019:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454472448 00000100:00100000:0.0:1762167008.376032:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.376064:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454472960 00000100:00100000:3.0:1762167008.376069:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454472960 00000100:00100000:0.0:1762167008.376072:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454473472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.376074:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16985 00000100:00100000:2.0:1762167008.376091:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3294:x1847765454472448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.376100:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16986 00000100:00100000:0.0:1762167008.376106:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.376114:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1847765454472960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.376119:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454473472 00000100:00100000:1.0:1762167008.376127:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454473472 00000100:00100000:0.0:1762167008.376131:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454473984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.376162:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.376166:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16987 00000100:00100000:1.0:1762167008.376176:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3294:x1847765454473472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.376194:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454474496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.376226:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.376257:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00002000:00010000:3.0:1762167008.376264:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167008.376265:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454473344:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167008.376270:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.376276:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167008.376277:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454472448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 189us (301us total) trans 21474843394 rc 0/0 00002000:00010000:3.0:1762167008.376281:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.376287:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.376292:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16985 00000100:00100000:0.0:1762167008.376300:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.376314:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454473984 00002000:00010000:1.0:1762167008.376315:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167008.376320:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454473984 00002000:00010000:1.0:1762167008.376321:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00000100:00100000:0.0:1762167008.376323:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454473856:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167008.376327:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:3.0:1762167008.376330:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454472960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (295us total) trans 21474843395 rc 0/0 00002000:00010000:1.0:1762167008.376333:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.376339:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.376341:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454474496 00000100:00100000:3.0:1762167008.376346:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16986 00000100:00100000:2.0:1762167008.376347:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454474496 00000100:00100000:0.0:1762167008.376352:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.376367:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454473344 00000100:00100000:0.0:1762167008.376370:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454474368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.376383:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454473344 00000100:00100000:2.0:1762167008.376385:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454473856 00000100:00100000:2.0:1762167008.376392:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454473856 00000100:00100000:1.0:1762167008.376395:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454473472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (290us total) trans 17179875851 rc 0/0 00000100:00100000:1.0:1762167008.376405:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16987 00000100:00100000:3.0:1762167008.376412:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16988 00000100:00100000:0.0:1762167008.376419:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.376424:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454473984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.376425:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454474368 00000100:00100000:1.0:1762167008.376431:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454474368 00000100:00100000:2.0:1762167008.376434:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16989 00000004:00080000:0.0:1762167008.376442:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4d880/2, rc 0, transno 21474843394 00000100:00100000:0.0:1762167008.376449:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454472448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.376457:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454474496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.376460:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16990 00000004:00080000:0.0:1762167008.376462:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce4700/2, rc 0, transno 21474843395 00000100:00100000:0.0:1762167008.376468:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454472960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.376475:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454473344:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167008.376478:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243181180/2, rc 0, transno 17179875851 00000100:00100000:0.0:1762167008.376483:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454473472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.376504:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16991 00000100:00100000:0.0:1762167008.376513:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454473856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167008.376563:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:3.0:1762167008.376567:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.376570:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167008.376573:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.376576:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167008.376618:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454473984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (456us total) trans 17179875852 rc 0/0 00000100:00100000:3.0:1762167008.376626:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16988 00002000:00010000:2.0:1762167008.376636:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167008.376640:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00000100:00100000:3.0:1762167008.376649:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16992 00002000:00010000:2.0:1762167008.376658:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167008.376658:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167008.376663:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454473344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 190us (362us total) trans 17179875853 rc 0/0 00002000:00010000:0.0:1762167008.376665:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00000100:00100000:3.0:1762167008.376666:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454474368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167008.376666:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.376673:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167008.376675:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167008.376680:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.376683:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167008.376689:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16990 00000100:00100000:2.0:1762167008.376729:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454474496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 284us (500us total) trans 21474843396 rc 0/0 00000100:00100000:0.0:1762167008.376730:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3294:x1847765454473856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (377us total) trans 17179875854 rc 0/0 00000100:00100000:2.0:1762167008.376745:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16989 00000100:00100000:0.0:1762167008.376752:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16991 00000100:00100000:0.0:1762167008.376805:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.376814:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454472832 00000100:00100000:2.0:1762167008.376820:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454472832 00000100:00100000:3.0:1762167008.376833:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3294:x1847765454474368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (414us total) trans 21474843397 rc 0/0 00000004:00080000:0.0:1762167008.376842:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4f100/2, rc 0, transno 21474843389 00000100:00100000:3.0:1762167008.376843:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16992 00000100:00100000:0.0:1762167008.376850:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454472320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.376852:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16993 00000100:00100000:2.0:1762167008.376864:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454472832:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167008.376883:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180a80/2, rc 0, transno 17179875853 00000100:00100000:0.0:1762167008.376889:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454473344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167008.376896:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e447480/2, rc 0, transno 17179875854 00000100:00100000:0.0:1762167008.376900:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454473856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167008.376911:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee35047c700/2, rc 0, transno 21474843397 00000100:00100000:0.0:1762167008.376914:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454474368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167008.376921:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e444e00/2, rc 0, transno 17179875852 00000100:00100000:0.0:1762167008.376925:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454473984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167008.376934:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee35047d500/2, rc 0, transno 21474843396 00000100:00100000:0.0:1762167008.376937:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454474496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.377000:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454472832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (192us total) trans 21474843398 rc 0/0 00000100:00100000:2.0:1762167008.377008:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16993 00000004:00080000:1.0:1762167008.377033:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee372a4ca80/2, rc 0, transno 21474843398 00000100:00100000:1.0:1762167008.377042:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454472832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.379256:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.380442:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451887360 00000100:00100000:2.0:1762167008.380453:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451887360 00000100:00100000:2.0:1762167008.380521:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16994 00000100:00100000:2.0:1762167008.380532:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451887360:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167008.380548:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.380565:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3abf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.380596:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0acbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a09 expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167008.380604:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.380605:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.380609:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [40960->102399] (req 40960->102399) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 28 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.380648:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0acbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a09 expref: 28 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167008.380662:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0acbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a09 expref: 28 pid: 12400 timeout: 729 lvb_type: 1 00000100:00100000:2.0:1762167008.380675:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454474624:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.380794:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460f00 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.382486:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.382528:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454474624:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.382556:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [40960->102399] (req 40960->102399) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 28 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.382559:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451887488 00000100:00100000:1.0:1762167008.382566:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451887488 00010000:00010000:2.0:1762167008.382579:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00010000:00010000:1.0:1762167008.382596:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0acbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a09 expref: 29 pid: 12400 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1762167008.382632:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7526 00000100:00100000:2.0:1762167008.382635:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56065:x1847765451887360:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2106us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.382644:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16994 00000100:00100000:1.0:1762167008.382644:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451887488:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167008.382656:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.382678:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0acbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a09 expref: 28 pid: 12400 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.382695:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0acbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a09 expref: 28 pid: 12400 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.382717:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0acbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a09 expref: 28 pid: 12400 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.382732:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.382735:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.382741:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->102399) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.382751:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->102399) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.382815:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->102399) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.382829:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454474752:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167008.382891:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.384339:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454474752:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167008.384359:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167008.384417:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451887488:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1775us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.384429:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7526 00000100:00100000:3.0:1762167008.384937:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.385011:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451887616 00000100:00100000:2.0:1762167008.385018:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451887616 00002000:00100000:2.0:1762167008.385059:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (12288->45055) req@ffff9ee347b00e00 x1847765451887616/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.385071:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b00e00 with x1847765451887616 ext(12288->45055) 00002000:00010000:2.0:1762167008.385076:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b00e00 00000100:00100000:2.0:1762167008.385103:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2970 00000100:00100000:2.0:1762167008.385113:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451887616:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167008.386387:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451887616:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1257us (1432us total) trans 0 rc 32768/32768 00000100:00100000:1.0:1762167008.386399:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2970 00002000:00100000:1.0:1762167008.386410:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (12288->45055) req@ffff9ee347b00e00 x1847765451887616/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/440 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167008.386420:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b00e00 with x1847765451887616 ext(12288->45055) 00002000:00010000:1.0:1762167008.386425:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b00e00 00000100:00100000:0.0:1762167008.389727:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.389805:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451887744 00000100:00100000:3.0:1762167008.389818:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451887744 00000100:00100000:3.0:1762167008.389895:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19853 00000100:00100000:3.0:1762167008.389906:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451887744:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167008.389936:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.389963:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aeb7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ac6 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.390077:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0aebe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.390094:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0aebe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.390106:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0aebe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167008.390134:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 100327 00000004:00200000:3.0:1762167008.390137:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167008.390154:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0aebe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.390174:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aeb7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ac6 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.390188:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0aebe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ac6 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.390195:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:3.0:1762167008.390198:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167008.390201:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:3.0:1762167008.390279:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451887744:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 374us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.390286:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19853 00000100:00100000:3.0:1762167008.397129:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.397237:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451888000 00000100:00100000:2.0:1762167008.397249:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451888000 00000100:00100000:2.0:1762167008.397308:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19854 00000100:00100000:2.0:1762167008.397317:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451888000:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167008.397369:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762167008.397418:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0aebe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ac6 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.397441:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0aea9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab8 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.397451:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:2.0:1762167008.397460:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167008.397809:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.397824:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.397835:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167008.397892:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952948 00000004:00010000:2.0:1762167008.397916:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000701a7bff reply state 00000000637bc2b8 transno 8589952949 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167008.397923:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167008.398010:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451888000:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 694us (891us total) trans 8589952949 rc 0/0 00000100:00100000:2.0:1762167008.398018:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19854 00000020:00080000:2.0:1762167008.398024:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167008.399864:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.399879:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.399886:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.399891:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167008.399897:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.399904:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167008.399915:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167008.399925:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2429d0d00) 00010000:00010000:3.0:1762167008.399928:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167008.399931:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.399938:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0aec5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.399984:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451888128 00000100:00100000:0.0:1762167008.399993:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451888128 00000100:00100000:0.0:1762167008.400046:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19855 00000100:00100000:0.0:1762167008.400056:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451888128:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.400077:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.400094:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0aecc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3acd expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.400142:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0aecc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3acd expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.400154:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0aecc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3acd expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.400171:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167008.400173:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167008.400175:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc66600, rc 0) 00000100:00100000:0.0:1762167008.400230:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451888128:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 175us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.400240:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19855 00000100:00100000:0.0:1762167008.402204:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.402276:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451888256 00000100:00100000:2.0:1762167008.402283:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451888256 00000100:00100000:2.0:1762167008.402328:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16995 00000100:00100000:2.0:1762167008.402338:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56065:x1847765451888256:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167008.402355:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.402371:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ad4 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.402411:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0acb8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a10 expref: 32 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167008.402419:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.402421:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.402425:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 32 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.402462:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0acb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a10 expref: 32 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167008.402486:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0acb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a10 expref: 32 pid: 6535 timeout: 729 lvb_type: 1 00000100:00100000:2.0:1762167008.402502:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454474880:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.402588:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.404338:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.404394:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454474880:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.404428:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 32 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.404432:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451888384 00000100:00100000:1.0:1762167008.404443:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451888384 00010000:00010000:2.0:1762167008.404459:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00010000:00010000:1.0:1762167008.404486:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0acb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a10 expref: 33 pid: 6535 timeout: 729 lvb_type: 1 00000100:00100000:2.0:1762167008.404520:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:56065:x1847765451888256:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2179us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.404535:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7527 00000100:00100000:1.0:1762167008.404548:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451888384:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167008.404551:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16995 00010000:00010000:1.0:1762167008.404565:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.404589:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0acb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a10 expref: 32 pid: 6535 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.404603:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0acb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a10 expref: 32 pid: 6535 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.404625:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0acb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a10 expref: 32 pid: 6535 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.404639:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.404642:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.404648:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.404658:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.404688:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.404701:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765454475008:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167008.404787:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.406504:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.406664:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451888512 00000100:00100000:2.0:1762167008.406672:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451888512 00000100:00100000:1.0:1762167008.406700:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765454475008:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167008.406722:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.406732:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16996 00000100:00100000:2.0:1762167008.406744:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451888512:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167008.406783:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167008.406799:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451888384:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2251us (2467us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167008.406800:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3adb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.406816:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7527 00010000:00010000:2.0:1762167008.406835:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0acc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a17 expref: 28 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167008.406844:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.406846:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.406850:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 28 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.406883:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0acc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a17 expref: 28 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167008.406897:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0acc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a17 expref: 28 pid: 6533 timeout: 729 lvb_type: 1 00000100:00100000:2.0:1762167008.406911:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454475136:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.406971:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350460f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.408393:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.408416:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454475136:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.408448:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 28 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.408456:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451888640 00000100:00100000:1.0:1762167008.408464:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451888640 00010000:00010000:0.0:1762167008.408467:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00010000:00010000:1.0:1762167008.408493:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0acc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a17 expref: 29 pid: 6533 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1762167008.408520:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56065:x1847765451888512:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1777us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.408529:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16996 00000100:00100000:1.0:1762167008.408543:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7528 00000100:00100000:1.0:1762167008.408555:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451888640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167008.408569:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.408590:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0acc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a17 expref: 28 pid: 6533 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.408611:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0acc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a17 expref: 28 pid: 6533 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.408633:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0acc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3a17 expref: 28 pid: 6533 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.408645:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.408647:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.408652:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.408661:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.408687:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 27 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.408698:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454475264:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167008.408755:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.410235:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454475264:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167008.410249:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167008.410293:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451888640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1739us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.410303:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7528 00000100:00100000:3.0:1762167008.410428:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.410473:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451888768 00000100:00100000:1.0:1762167008.410479:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451888768 00002000:00010000:1.0:1762167008.410505:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (116957->18446744073709551615) 00002000:00100000:1.0:1762167008.410509:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b00380 with x1847765451888768 ext(116957->18446744073709551615) 00002000:00010000:1.0:1762167008.410517:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b00380. 00000100:00100000:1.0:1762167008.410547:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2971 00000100:00100000:3.0:1762167008.410555:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.410559:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451888768:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167008.410585:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451888896 00000100:00100000:3.0:1762167008.410592:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.410592:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451888896 00002000:00010000:0.0:1762167008.410617:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:2.0:1762167008.410619:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451889024 00002000:00100000:0.0:1762167008.410622:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b00000 with x1847765451888896 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167008.410626:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451889024 00002000:00010000:0.0:1762167008.410632:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee347b00000. 00002000:00010000:2.0:1762167008.410649:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:0.0:1762167008.410655:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2972 00002000:00100000:2.0:1762167008.410656:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b03100 with x1847765451889024 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167008.410664:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b03100. 00000100:00100000:0.0:1762167008.410685:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451888896:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167008.410698:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2973 00000100:00100000:3.0:1762167008.410712:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451889024:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167008.410867:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 45050 -> 116957 00002000:00010000:1.0:1762167008.410871:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.410874:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.410876:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.410879:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 47 00002000:00010000:0.0:1762167008.410907:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167008.410912:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.410915:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.410917:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.410919:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167008.410927:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451888768:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 371us (498us total) trans 21474843399 rc 0/0 00000100:00100000:1.0:1762167008.410935:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2971 00002000:00010000:1.0:1762167008.410939:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (116957->18446744073709551615) 00000100:00100000:0.0:1762167008.410951:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451888896:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 267us (396us total) trans 17179875855 rc 0/0 00002000:00100000:1.0:1762167008.410952:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b00380 with x1847765451888768 ext(116957->18446744073709551615) 00002000:00010000:1.0:1762167008.410963:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b00380. 00002000:00010000:2.0:1762167008.410964:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167008.410966:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2972 00002000:00010000:2.0:1762167008.410972:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.410974:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:2.0:1762167008.410978:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00100000:0.0:1762167008.410980:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b00000 with x1847765451888896 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167008.410983:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.410988:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167008.410988:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee347b00000. 00000100:00100000:2.0:1762167008.411019:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451889024:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 311us (426us total) trans 21474843400 rc 0/0 00000100:00100000:2.0:1762167008.411027:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2973 00002000:00010000:2.0:1762167008.411031:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:2.0:1762167008.411034:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b03100 with x1847765451889024 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167008.411039:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b03100. 00000100:00100000:0.0:1762167008.413479:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.413578:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451889152 00000100:00100000:2.0:1762167008.413586:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451889152 00002000:00100000:2.0:1762167008.413634:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->118783) req@ffff9ee36de01500 x1847765451889152/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.413646:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01500 with x1847765451889152 ext(102400->118783) 00002000:00010000:2.0:1762167008.413653:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de01500 00000100:00100000:2.0:1762167008.413686:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2974 00000100:00100000:2.0:1762167008.413697:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451889152:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167008.414061:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451889152:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 365us (588us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1762167008.414067:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2974 00002000:00100000:2.0:1762167008.414073:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (102400->118783) req@ffff9ee36de01500 x1847765451889152/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/16824 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.414078:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01500 with x1847765451889152 ext(102400->118783) 00002000:00010000:2.0:1762167008.414081:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de01500 00000100:00100000:3.0:1762167008.416607:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.416759:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451889280 00000100:00100000:2.0:1762167008.416793:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451889280 00002000:00100000:2.0:1762167008.416840:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->116956) req@ffff9ee359066a00 x1847765451889280/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 504/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.416852:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359066a00 with x1847765451889280 ext(40960->116956) 00002000:00010000:2.0:1762167008.416857:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359066a00 00000100:00100000:2.0:1762167008.416893:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2975 00000100:00100000:2.0:1762167008.416903:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451889280:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:2.0:1762167008.418977:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451889280:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 2067us (2373us total) trans 21474843401 rc 0/0 00000100:00100000:2.0:1762167008.418990:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2975 00002000:00100000:2.0:1762167008.419000:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->116956) req@ffff9ee359066a00 x1847765451889280/t21474843401(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 504/448 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167008.419017:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359066a00 with x1847765451889280 ext(40960->116956) 00002000:00010000:2.0:1762167008.419022:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359066a00 00000100:00100000:1.0:1762167008.420451:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.420542:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451889408 00000100:00100000:0.0:1762167008.420551:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451889408 00000100:00100000:0.0:1762167008.420610:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16997 00000100:00100000:0.0:1762167008.420619:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451889408:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:2.0:1762167008.434612:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843393 is committed 00000001:00080000:2.0:1762167008.434645:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843377 is committed 00000001:00080000:2.0:1762167008.434666:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843399 is committed 00000001:00080000:2.0:1762167008.434694:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843401 is committed 00000001:00080000:2.0:1762167008.434708:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843398 is committed 00000100:00100000:1.0:1762167008.434750:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451889408:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 14124us (14299us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.434790:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16997 00000100:00100000:3.0:1762167008.436592:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.436689:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451889536 00000100:00100000:0.0:1762167008.436698:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451889536 00000100:00100000:0.0:1762167008.436745:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19856 00000100:00100000:0.0:1762167008.436752:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451889536:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.436798:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.436823:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0aee1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ae2 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.436916:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0aee8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.436939:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0aee8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.436952:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0aee8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.436985:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 116957 00000004:00200000:0.0:1762167008.436990:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.437007:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0aee8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.437033:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0aee1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ae2 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.437053:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0aee8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ae2 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.437061:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167008.437065:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.437068:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29400, rc 0) 00000100:00100000:0.0:1762167008.437137:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451889536:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 384us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.437144:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19856 00000100:00100000:3.0:1762167008.440224:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.440342:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451889792 00000100:00100000:0.0:1762167008.440356:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451889792 00000100:00100000:0.0:1762167008.440443:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19857 00000100:00100000:0.0:1762167008.440455:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451889792:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167008.440536:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.440574:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0aee8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ae2 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.440601:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167008.440608:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.440919:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.440934:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.440944:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167008.441005:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952950 00000004:00010000:0.0:1762167008.441039:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003338ec6b reply state 00000000a40e4668 transno 8589952951 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.441050:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167008.441160:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451889792:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 707us (949us total) trans 8589952951 rc 0/0 00000100:00100000:0.0:1762167008.441165:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19857 00000020:00080000:0.0:1762167008.441169:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167008.442461:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.442477:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.442485:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.442492:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a28800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167008.442497:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.442505:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.442520:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:2.0:1762167008.442523:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167008.442526:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.442538:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0aeef lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.443219:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.443255:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.443283:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451889920 00000100:00100000:2.0:1762167008.443293:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451889920 00000100:00100000:0.0:1762167008.443334:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451890176 00002000:00010000:2.0:1762167008.443339:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (232603->18446744073709551615) 00000100:00100000:0.0:1762167008.443341:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451890176 00000100:00100000:3.0:1762167008.443348:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00100000:2.0:1762167008.443348:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732c000 with x1847765451889920 ext(232603->18446744073709551615) 00002000:00010000:0.0:1762167008.443358:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:2.0:1762167008.443362:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732c000. 00002000:00100000:0.0:1762167008.443382:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732e680 with x1847765451890176 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167008.443395:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732e680. 00000100:00100000:2.0:1762167008.443400:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451890048 00000100:00100000:2.0:1762167008.443405:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451890048 00002000:00010000:2.0:1762167008.443422:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:0.0:1762167008.443423:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2976 00002000:00100000:2.0:1762167008.443428:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732dc00 with x1847765451890048 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167008.443436:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2977 00002000:00010000:2.0:1762167008.443437:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732dc00. 00000100:00100000:0.0:1762167008.443438:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451889920:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167008.443459:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2978 00000100:00100000:1.0:1762167008.443460:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451890176:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167008.443473:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451890048:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167008.443687:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.443691:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.443694:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.443697:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.443699:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167008.443740:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.443745:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.443747:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 116957 -> 232603 00002000:00010000:1.0:1762167008.443749:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.443753:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.443755:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.443758:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.443787:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167008.443787:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00000100:00100000:3.0:1762167008.443789:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765451890048:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 296us (417us total) trans 17179875856 rc 0/0 00002000:00010000:0.0:1762167008.443795:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 47 -> 185 00000100:00100000:3.0:1762167008.443798:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2978 00002000:00010000:3.0:1762167008.443802:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167008.443805:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732dc00 with x1847765451890048 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167008.443810:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732dc00. 00000100:00100000:1.0:1762167008.443821:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451890176:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 371us (564us total) trans 21474843402 rc 0/0 00000100:00100000:0.0:1762167008.443828:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451889920:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 392us (611us total) trans 21474843403 rc 0/0 00000100:00100000:1.0:1762167008.443837:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2977 00002000:00010000:1.0:1762167008.443842:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:0.0:1762167008.443846:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2976 00002000:00100000:1.0:1762167008.443847:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732e680 with x1847765451890176 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167008.443852:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (232603->18446744073709551615) 00002000:00010000:1.0:1762167008.443855:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732e680. 00002000:00100000:0.0:1762167008.443859:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732c000 with x1847765451889920 ext(232603->18446744073709551615) 00002000:00010000:0.0:1762167008.443866:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732c000. 00000100:00100000:1.0:1762167008.446440:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.446544:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451890304 00000100:00100000:0.0:1762167008.446554:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451890304 00002000:00100000:0.0:1762167008.446600:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (135168->200703) req@ffff9ee347b04000 x1847765451890304/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.446608:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b04000 with x1847765451890304 ext(135168->200703) 00002000:00010000:0.0:1762167008.446613:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b04000 00000100:00100000:0.0:1762167008.446643:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2979 00000100:00100000:0.0:1762167008.446653:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451890304:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167008.448860:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451890304:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 2198us (2418us total) trans 0 rc 65536/65536 00000100:00100000:0.0:1762167008.448878:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2979 00002000:00100000:0.0:1762167008.448890:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (135168->200703) req@ffff9ee347b04000 x1847765451890304/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/440 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.448901:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b04000 with x1847765451890304 ext(135168->200703) 00002000:00010000:0.0:1762167008.448907:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b04000 00000100:00100000:3.0:1762167008.452456:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.452570:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451890432 00000100:00100000:0.0:1762167008.452580:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451890432 00002000:00100000:0.0:1762167008.452626:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (200704->233471) req@ffff9ee24732df80 x1847765451890432/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.452637:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732df80 with x1847765451890432 ext(200704->233471) 00002000:00010000:0.0:1762167008.452643:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732df80 00000100:00100000:0.0:1762167008.452681:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2980 00000100:00100000:0.0:1762167008.452690:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451890432:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167008.454240:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451890432:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1544us (1788us total) trans 0 rc 32768/32768 00000100:00100000:0.0:1762167008.454251:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2980 00002000:00100000:0.0:1762167008.454261:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (200704->233471) req@ffff9ee24732df80 x1847765451890432/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/440 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.454271:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732df80 with x1847765451890432 ext(200704->233471) 00002000:00010000:0.0:1762167008.454276:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732df80 00000100:00100000:2.0:1762167008.457907:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.458020:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451890560 00000100:00100000:0.0:1762167008.458032:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451890560 00002000:00100000:0.0:1762167008.458078:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (163840->232602) req@ffff9ee381d68380 x1847765451890560/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.458096:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d68380 with x1847765451890560 ext(163840->232602) 00002000:00010000:0.0:1762167008.458101:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d68380 00000100:00100000:0.0:1762167008.458140:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2981 00000100:00100000:0.0:1762167008.458149:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451890560:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:0.0:1762167008.460273:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451890560:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 2115us (2371us total) trans 21474843404 rc 0/0 00000100:00100000:0.0:1762167008.460287:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2981 00002000:00100000:0.0:1762167008.460298:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (163840->232602) req@ffff9ee381d68380 x1847765451890560/t21474843404(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/448 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.460309:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d68380 with x1847765451890560 ext(163840->232602) 00002000:00010000:0.0:1762167008.460315:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d68380 00000100:00100000:1.0:1762167008.462430:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.462628:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451890688 00000100:00100000:0.0:1762167008.462638:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451890688 00000100:00100000:0.0:1762167008.462683:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16998 00000100:00100000:0.0:1762167008.462693:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451890688:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:3.0:1762167008.476896:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843404 is committed 00000100:00100000:0.0:1762167008.476954:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451890688:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 14256us (14525us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.476966:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16998 00000100:00100000:2.0:1762167008.478844:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.478944:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451890816 00000100:00100000:0.0:1762167008.478953:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451890816 00000100:00100000:0.0:1762167008.479010:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19858 00000100:00100000:0.0:1762167008.479020:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451890816:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.479043:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.479068:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0aef6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ae9 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.479150:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0aefd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.479165:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0aefd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.479176:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0aefd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.479200:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 232603 00000004:00200000:0.0:1762167008.479205:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.479222:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0aefd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.479246:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0aef6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ae9 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.479266:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0aefd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ae9 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.479275:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167008.479278:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.479282:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29c00, rc 0) 00000100:00100000:0.0:1762167008.479354:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451890816:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 336us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.479362:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19858 00000100:00100000:3.0:1762167008.485231:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.485343:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451891072 00000100:00100000:0.0:1762167008.485353:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451891072 00000100:00100000:0.0:1762167008.485433:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19859 00000100:00100000:0.0:1762167008.485444:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451891072:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167008.485515:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.485544:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0aefd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ae9 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.485565:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167008.485570:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.485847:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.485860:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.485869:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167008.485918:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952952 00000004:00010000:0.0:1762167008.485936:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a9f1f568 reply state 00000000340e3e3a transno 8589952953 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.485943:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167008.486025:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451891072:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 584us (809us total) trans 8589952953 rc 0/0 00000100:00100000:0.0:1762167008.486031:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19859 00000020:00080000:0.0:1762167008.486035:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167008.487032:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.487046:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.487053:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.487059:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167008.487068:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.487075:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.487089:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:3.0:1762167008.487092:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167008.487096:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.487102:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af04 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.487419:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.487450:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.487494:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451891328 00000100:00100000:3.0:1762167008.487500:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.487503:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451891328 00002000:00010000:1.0:1762167008.487537:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167008.487542:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732f480 with x1847765451891328 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167008.487552:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732f480. 00000100:00100000:1.0:1762167008.487578:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451891456 00000100:00100000:0.0:1762167008.487578:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451891200 00000100:00100000:1.0:1762167008.487582:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451891456 00000100:00100000:0.0:1762167008.487585:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451891200 00002000:00010000:1.0:1762167008.487595:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167008.487598:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732ca80 with x1847765451891456 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167008.487604:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732ca80. 00000100:00100000:3.0:1762167008.487605:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2982 00002000:00010000:0.0:1762167008.487606:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (131446->18446744073709551615) 00002000:00100000:0.0:1762167008.487613:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732ce00 with x1847765451891200 ext(131446->18446744073709551615) 00002000:00010000:0.0:1762167008.487621:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732ce00. 00000100:00100000:3.0:1762167008.487623:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451891328:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167008.487628:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2983 00000100:00100000:1.0:1762167008.487637:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451891456:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167008.487809:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2984 00000100:00100000:0.0:1762167008.487819:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451891200:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167008.487907:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.487911:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.487914:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.487917:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.487919:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167008.487969:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451891328:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 350us (552us total) trans 17179875857 rc 0/0 00000100:00100000:3.0:1762167008.487978:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2982 00002000:00010000:3.0:1762167008.487982:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167008.487985:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732f480 with x1847765451891328 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167008.487991:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732f480. 00002000:00010000:1.0:1762167008.488001:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.488006:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.488009:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.488012:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.488015:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167008.488046:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451891456:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 407us (546us total) trans 21474843405 rc 0/0 00000100:00100000:1.0:1762167008.488055:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2983 00002000:00010000:1.0:1762167008.488058:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167008.488061:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732ca80 with x1847765451891456 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167008.488066:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732ca80. 00002000:00010000:0.0:1762167008.488174:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 232603 -> 131446 00002000:00010000:0.0:1762167008.488178:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.488180:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.488182:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.488184:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 185 -> 325 00000100:00100000:0.0:1762167008.488221:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451891200:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 404us (769us total) trans 21474843406 rc 0/0 00000100:00100000:0.0:1762167008.488232:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2984 00002000:00010000:0.0:1762167008.488236:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (131446->18446744073709551615) 00002000:00100000:0.0:1762167008.488238:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732ce00 with x1847765451891200 ext(131446->18446744073709551615) 00002000:00010000:0.0:1762167008.488243:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732ce00. 00000100:00100000:3.0:1762167008.490051:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.490100:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451891584 00000100:00100000:0.0:1762167008.490109:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451891584 00000100:00100000:0.0:1762167008.490162:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19860 00000100:00100000:0.0:1762167008.490171:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451891584:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.490189:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.490205:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0af0b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3af0 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.490275:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0af12 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.490285:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0af12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.490293:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0af12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.490313:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:0.0:1762167008.490316:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.490327:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0af12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.490344:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0af0b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3af0 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.490357:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0af12 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3af0 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.490363:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167008.490365:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.490366:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29200, rc 0) 00000100:00100000:0.0:1762167008.490431:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451891584:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 260us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.490438:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19860 00000100:00100000:1.0:1762167008.493032:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.493200:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451891840 00000100:00100000:3.0:1762167008.493209:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451891840 00000100:00100000:3.0:1762167008.493261:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7347 00000100:00100000:3.0:1762167008.493271:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451891840:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:3.0:1762167008.493592:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451891840:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 323us (566us total) trans 8589952954 rc 0/0 00000100:00100000:3.0:1762167008.493599:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7347 00000100:00100000:2.0:1762167008.503889:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.503943:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451892096 00000100:00100000:0.0:1762167008.503954:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451892096 00000100:00100000:0.0:1762167008.504014:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19861 00000100:00100000:0.0:1762167008.504025:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56209:x1847765451892096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.504047:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.504064:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0af19 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3af7 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.504137:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af20 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504154:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af20 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504164:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af20 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504178:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af27 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504185:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af27 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504192:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af27 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504345:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af2e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504354:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504361:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.504371:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:0.0:1762167008.504490:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af20 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504498:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af20 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504504:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af20 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504513:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.504517:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af20 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504523:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af20 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504535:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167008.504538:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.504542:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af20 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504548:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af20 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504566:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af27 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504572:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af27 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504577:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af27 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504581:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a28600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.504584:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af27 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504589:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af27 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504597:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167008.504600:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.504603:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af27 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504608:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af27 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.504646:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0af19 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3af7 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.504659:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3af7 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.504666:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167008.504669:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.504672:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29400, rc 0) 00000100:00100000:0.0:1762167008.504732:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56209:x1847765451892096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 709us (852us total) trans 8589952955 rc 0/0 00000100:00100000:0.0:1762167008.504740:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19861 00000100:00100000:0.0:1762167008.506477:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.506579:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451892224 00000100:00100000:1.0:1762167008.506587:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451892224 00000100:00100000:1.0:1762167008.506645:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 650 00000100:00100000:1.0:1762167008.506663:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2360:x1847765451892224:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167008.506679:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.506699:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af2e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3af7 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.506715:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:1.0:1762167008.506720:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167008.506795:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765451892224:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 141us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.506804:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 650 00000100:00100000:1.0:1762167008.507283:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.507344:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451892480 00000100:00100000:0.0:1762167008.507349:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451892480 00000100:00100000:0.0:1762167008.507416:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19862 00000100:00100000:0.0:1762167008.507424:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56209:x1847765451892480:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.507451:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.507467:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af3c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3afe expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.508017:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.508031:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.508040:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.508050:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64d:0x0]: returning size 0 00010000:00010000:0.0:1762167008.508090:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af3c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3afe expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.508107:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3afe expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.508115:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167008.508118:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.508120:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372abbe00, rc 0) 00000100:00100000:0.0:1762167008.508177:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56209:x1847765451892480:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 753us (894us total) trans 8589952956 rc 0/0 00000100:00100000:0.0:1762167008.508185:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19862 00000100:00100000:2.0:1762167008.509879:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.509930:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451892736 00000100:00100000:0.0:1762167008.509939:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451892736 00000100:00100000:0.0:1762167008.509982:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19863 00000100:00100000:0.0:1762167008.509992:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56209:x1847765451892736:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.510011:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.510034:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0af51 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b05 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.510111:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.510124:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3afe expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.510131:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.510163:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3afe expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.510176:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3afe expref: 902 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167008.510189:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454475392:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167008.510261:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a900 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.511580:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454475392:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.511604:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167008.511696:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.511838:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451892864 00000100:00100000:1.0:1762167008.511845:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451892864 00010000:00010000:1.0:1762167008.511875:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3afe expref: 903 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1762167008.511906:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7529 00000100:00100000:1.0:1762167008.511914:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2361:x1847765451892864:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167008.511926:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.511932:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3afe expref: 903 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167008.511943:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3afe expref: 903 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167008.511961:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0af43 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3afe expref: 903 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167008.511976:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:1.0:1762167008.511981:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.511990:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.511996:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.512023:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.512064:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.512072:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167008.512081:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2361:x1847765451892864:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 164us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.512091:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7529 00000004:00200000:0.0:1762167008.512091:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64d:0x0]: returning size 0 00000004:00080000:0.0:1762167008.512400:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81e:0x0], index 0: 0 00000004:00080000:0.0:1762167008.512413:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x821:0x0], index 1: 0 00010000:00010000:0.0:1762167008.512565:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.512578:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.512584:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.512589:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a28600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.512599:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.512609:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.512619:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee2446b8000) 00010000:00010000:0.0:1762167008.512622:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167008.512625:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.512630:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af58 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.512684:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0af51 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b05 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.512691:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167008.512693:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762167008.512696:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0af51 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b05 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.512702:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28800, rc 0) 00000100:00100000:0.0:1762167008.512741:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56209:x1847765451892736:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2752us (2871us total) trans 8589952957 rc 301/301 00000100:00100000:0.0:1762167008.512747:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19863 00000100:00100000:2.0:1762167008.514091:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.514134:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451893120 00000100:00100000:3.0:1762167008.514142:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451893120 00000100:00100000:3.0:1762167008.514193:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7348 00000100:00100000:3.0:1762167008.514203:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56209:x1847765451893120:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167008.514506:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56209:x1847765451893120:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 303us (418us total) trans 8589952958 rc 0/0 00000100:00100000:3.0:1762167008.514513:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7348 00000100:00100000:1.0:1762167008.516600:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.516692:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451893248 00000100:00100000:0.0:1762167008.516700:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451893248 00000100:00100000:0.0:1762167008.516791:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19864 00000100:00100000:0.0:1762167008.516803:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56209:x1847765451893248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.516825:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.516858:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af66 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b0c expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.516926:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.516939:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.516949:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.516991:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64d:0x0]: returning size 0 00000004:00200000:0.0:1762167008.516995:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.517016:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.517041:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0af66 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b0c expref: 904 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.517063:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b0c expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.517071:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167008.517074:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762167008.517078:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29400, rc 0) 00000100:00100000:0.0:1762167008.517139:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56209:x1847765451893248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 339us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.517146:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19864 00000100:00100000:1.0:1762167008.519143:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.519180:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.519209:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451893376 00000100:00100000:0.0:1762167008.519218:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451893376 00000100:00100000:2.0:1762167008.519239:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451893504 00000100:00100000:2.0:1762167008.519246:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451893504 00000100:00100000:0.0:1762167008.519279:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 16999 00000100:00100000:2.0:1762167008.519287:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17000 00000100:00100000:0.0:1762167008.519293:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451893376:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:2.0:1762167008.519305:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451893504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.519309:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.519315:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.519330:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b13 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.519332:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0af7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b1a expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167008.519366:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x821:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:0.0:1762167008.519367:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1762167008.519400:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.519400:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.519403:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.519405:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.519414:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0af7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b1a expref: 35 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.519415:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b13 expref: 20 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.519442:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b13 expref: 20 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167008.519448:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0af7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b1a expref: 35 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.519458:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29c00, rc 0) 00010000:00010000:2.0:1762167008.519463:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167008.519559:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451893504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 256us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.519560:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451893376:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 268us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.519575:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17000 00000100:00100000:0.0:1762167008.519582:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 16999 00000100:00100000:2.0:1762167008.521900:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.522309:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451893760 00000100:00100000:0.0:1762167008.522326:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451893760 00000100:00100000:0.0:1762167008.522426:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19865 00000100:00100000:0.0:1762167008.522441:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56209:x1847765451893760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.522473:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.522511:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0af82 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b21 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.522643:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af89 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.522658:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af89 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.522667:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af89 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.522678:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:0.0:1762167008.522866:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0af82 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b21 expref: 906 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.522885:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af89 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b21 expref: 905 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.522895:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:0.0:1762167008.522898:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167008.522902:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28600, rc 0) 00000100:00100000:0.0:1762167008.522991:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56209:x1847765451893760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 554us (1096us total) trans 8589952959 rc 0/0 00000100:00100000:0.0:1762167008.522999:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19865 00000100:00100000:1.0:1762167008.525745:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.525835:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.525847:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451893888 00000100:00100000:1.0:1762167008.525867:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.525867:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451893888 00000100:00100000:2.0:1762167008.525877:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451894016 00000100:00100000:2.0:1762167008.525884:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451894016 00000100:00100000:3.0:1762167008.525889:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451894144 00000100:00100000:3.0:1762167008.525896:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451894144 00000100:00100000:0.0:1762167008.525926:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17001 00000100:00100000:2.0:1762167008.525941:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17002 00000100:00100000:0.0:1762167008.525943:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451893888:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167008.525952:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17003 00000100:00100000:2.0:1762167008.525956:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765451894016:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167008.525967:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451894144:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167008.525993:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.525997:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.525998:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.526014:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.526029:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167008.526031:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->102399) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.526032:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167008.526035:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 35 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.526037:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.526052:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167008.526056:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167008.526062:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167008.526065:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167008.526067:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.526069:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.526088:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.526102:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 21 pid: 6533 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.526105:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->102399) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.526110:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 35 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167008.526128:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454475520:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.526130:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->102399) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 21 pid: 6533 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.526147:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 35 pid: 6533 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167008.526153:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454475648:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.526167:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454475776:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167008.526214:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287180 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.526214:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59840 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.526214:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.528212:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.528239:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454475776:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.528263:0:33894:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.528287:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454475648:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.528302:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167008.528307:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.528326:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451894272 00000100:00100000:2.0:1762167008.528334:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451894272 00000100:00100000:0.0:1762167008.528344:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451894400 00000100:00100000:0.0:1762167008.528351:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451894400 00010000:00010000:2.0:1762167008.528365:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 36 pid: 6533 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.528371:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 22 pid: 6533 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.528431:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7530 00000100:00100000:2.0:1762167008.528442:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451894272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.528456:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.528489:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 36 pid: 6533 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.528501:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 36 pid: 6533 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.528524:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0aed3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ad4 expref: 36 pid: 6533 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.528542:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.528544:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.528549:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.528559:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.528585:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167008.528587:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454475520:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167008.528605:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.528629:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451894272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 188us (426us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167008.528634:0:33894:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.528640:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7530 00010000:00010000:3.0:1762167008.528653:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.528666:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7531 00000100:00100000:2.0:1762167008.528675:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451894400:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167008.528676:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.528687:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.528687:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167008.528697:0:33894:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.528704:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 22 pid: 6533 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.528706:0:33894:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167008.528713:0:33894:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.528722:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 22 pid: 6533 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.528723:0:33894:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.528748:0:33894:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.528754:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0aeda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3adb expref: 22 pid: 6533 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.528757:0:33894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0af9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.528803:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.528807:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.528811:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.528820:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.528840:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.528860:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451894400:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.528867:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7531 00000100:00100000:0.0:1762167008.529023:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.529043:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451894528 00000100:00100000:0.0:1762167008.529048:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451894528 00010000:00010000:0.0:1762167008.529064:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->102399) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 21 pid: 6533 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167008.529085:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7532 00000100:00100000:0.0:1762167008.529092:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451894528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167008.529100:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.529111:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->102399) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 21 pid: 6533 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167008.529134:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->102399) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 21 pid: 6533 timeout: 729 lvb_type: 0 00000100:00100000:3.0:1762167008.529146:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765451894016:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3192us (3309us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167008.529153:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0aeb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->102399) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3abf expref: 21 pid: 6533 timeout: 729 lvb_type: 0 00000100:00100000:3.0:1762167008.529160:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17002 00010000:00010000:0.0:1762167008.529172:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.529174:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.529178:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.529186:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.529188:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.529199:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.529216:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167008.529219:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.529228:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.529235:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.529240:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451894528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 146us (216us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167008.529248:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167008.529253:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.529254:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7532 00010000:00010000:3.0:1762167008.529264:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.529275:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.529282:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.529283:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0af97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.529303:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.529321:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.529329:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167008.529339:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451894144:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3374us (3470us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167008.529339:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167008.529355:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17003 00010000:00010000:0.0:1762167008.529356:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167008.529362:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.529369:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.529398:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.529404:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0afa5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.529439:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451893888:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3504us (3703us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.529446:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17001 00000100:00100000:1.0:1762167008.533385:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.533534:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451894656 00000100:00100000:0.0:1762167008.533543:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451894656 00000100:00100000:0.0:1762167008.533598:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17004 00000100:00100000:0.0:1762167008.533607:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451894656:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.533624:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.533644:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d0afac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b28 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167008.533666:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 131446, mtime: 0x690888e0, atime: 0x690888e0, ctime: 0x690888e0, blocks: 0x145 00010000:00010000:0.0:1762167008.533683:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.533685:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.533693:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d0afac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b28 expref: 19 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.533707:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d0afac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b28 expref: 19 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.533724:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f2d1400, rc 0) 00000100:00100000:0.0:1762167008.533806:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451894656:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 198us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.533813:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17004 00000100:00100000:1.0:1762167008.533877:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.533949:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451894912 00000100:00100000:0.0:1762167008.533953:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451894912 00000100:00100000:3.0:1762167008.534003:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17005 00000100:00100000:3.0:1762167008.534016:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451894912:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167008.534025:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167008.534031:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167008.534043:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0afb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b36 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167008.534060:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888e0, atime: 0x690888e0, ctime: 0x690888e0, blocks: 0x3 00010000:00010000:3.0:1762167008.534071:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.534073:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.534079:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0afb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b36 expref: 20 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167008.534091:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0afb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b36 expref: 20 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167008.534100:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:2.0:1762167008.534102:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451894784 00000100:00100000:2.0:1762167008.534108:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451894784 00000100:00100000:3.0:1762167008.534195:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451894912:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 182us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.534201:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17005 00000100:00100000:3.0:1762167008.534217:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17006 00000100:00100000:3.0:1762167008.534224:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451894784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167008.534235:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.534245:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0afba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b2f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167008.534260:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888e0, atime: 0x690888e0, ctime: 0x690888e0, blocks: 0x3 00010000:00010000:3.0:1762167008.534270:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.534272:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.534277:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0afba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b2f expref: 35 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167008.534287:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0afba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b2f expref: 35 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167008.534295:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167008.534330:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451894784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 106us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.534336:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17006 00000100:00100000:2.0:1762167008.560472:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.560657:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451895040 00000100:00100000:0.0:1762167008.560667:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451895040 00000100:00100000:0.0:1762167008.560743:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2985 00000100:00100000:0.0:1762167008.560753:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451895040:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167008.560822:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afc1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.560837:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.560839:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.560844:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afc1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.560856:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afc1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.563805:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afc1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.563824:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.563837:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.563844:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f2d1000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167008.563848:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.563857:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.563875:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.563883:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.563970:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451895040:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3214us (3503us total) trans 0 rc 131446/131446 00000100:00100000:0.0:1762167008.563980:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2985 00000100:00100000:3.0:1762167008.566889:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.566945:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451895168 00000100:00100000:1.0:1762167008.566955:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451895168 00000100:00100000:1.0:1762167008.567028:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2986 00000100:00100000:1.0:1762167008.567039:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451895168:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:1.0:1762167008.567079:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.567100:0:14117:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af74 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b13 expref: 20 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167008.567107:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.567108:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.567111:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.567140:0:14117:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b13 expref: 20 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167008.567153:0:14117:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b13 expref: 20 pid: 6533 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1762167008.567169:0:14117:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454475904:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.567234:0:14117:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e240 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.570327:0:14117:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14117:1847765454475904:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167008.570359:0:14117:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167008.570428:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.570533:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451895296 00000100:00100000:1.0:1762167008.570540:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451895296 00010000:00010000:1.0:1762167008.570575:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b13 expref: 21 pid: 6533 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1762167008.570616:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7533 00000100:00100000:1.0:1762167008.570626:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451895296:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167008.570640:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.570661:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b13 expref: 21 pid: 6533 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.570673:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b13 expref: 21 pid: 6533 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.570701:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0af74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b13 expref: 21 pid: 6533 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.570715:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.570718:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.570722:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.570731:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.570811:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167008.570881:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451895296:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 255us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.570890:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7533 00010000:00010000:2.0:1762167008.570952:0:14117:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.570961:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167008.593976:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843406 is committed 00000001:00080000:0.0:1762167008.593994:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843407 is committed 00002000:00010000:1.0:1762167008.594070:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 0 -> 131446 00002000:00010000:1.0:1762167008.594074:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 0 -> 1762167008 00002000:00010000:1.0:1762167008.594076:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 0 -> 1762167008 00002000:00010000:1.0:1762167008.594077:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 1 -> 515 00010000:00010000:1.0:1762167008.594089:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.594099:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.594108:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.594115:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ba00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.594119:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.594127:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.594149:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.594156:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.594256:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451895168:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 27215us (27372us total) trans 21474843407 rc 0/0 00000100:00100000:1.0:1762167008.594267:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2986 00000100:00100000:3.0:1762167008.596397:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.596500:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451895424 00000100:00100000:0.0:1762167008.596511:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451895424 00000100:00100000:0.0:1762167008.596573:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19866 00000100:00100000:0.0:1762167008.596584:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56209:x1847765451895424:12345-192.168.203.35@tcp:44:lfs.0 00000001:00080000:3.0:1762167008.612389:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952959 is committed 00000100:00100000:0.0:1762167008.612496:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56209:x1847765451895424:12345-192.168.203.35@tcp:44:lfs.0 Request processed in 15908us (16100us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.612508:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19866 00000100:00100000:3.0:1762167008.614504:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.614554:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.614586:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451895552 00000100:00100000:0.0:1762167008.614597:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451895552 00000100:00100000:1.0:1762167008.614619:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451895680 00000100:00100000:1.0:1762167008.614627:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451895680 00000100:00100000:0.0:1762167008.614663:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17007 00000100:00100000:0.0:1762167008.614673:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451895552:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:1.0:1762167008.614688:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17008 00000100:00100000:1.0:1762167008.614702:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451895680:12345-192.168.203.35@tcp:16:lfs.0 00000100:00100000:0.0:1762167008.614800:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451895552:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 126us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.614808:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17007 00000100:00100000:1.0:1762167008.614814:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451895680:12345-192.168.203.35@tcp:16:lfs.0 Request processed in 112us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.614823:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17008 00000100:00100000:2.0:1762167008.622530:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.622576:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.622615:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.622635:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451895808 00000100:00100000:1.0:1762167008.622646:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451895808 00000100:00100000:0.0:1762167008.622672:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451896064 00000100:00100000:3.0:1762167008.622676:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451895936 00000100:00100000:0.0:1762167008.622679:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451896064 00000100:00100000:3.0:1762167008.622685:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451895936 00000100:00100000:1.0:1762167008.622709:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17009 00000100:00100000:1.0:1762167008.622722:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451895808:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:0.0:1762167008.622726:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17010 00000100:00100000:3.0:1762167008.622743:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17011 00000100:00100000:0.0:1762167008.622745:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451896064:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167008.622758:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451895936:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167008.622798:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afcf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.622800:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afd6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.622813:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0afdd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.622822:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.622822:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.622826:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.622827:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.622830:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.622832:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afcf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.622833:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.622840:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0afdd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.622843:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afd6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.622850:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afcf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.622864:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0afdd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.622869:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afd6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.622890:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afcf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.622893:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afd6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.622896:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0afdd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.622905:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afcf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.622917:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afd6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.622921:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0afdd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.622925:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.622945:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0afdd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.622947:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ba00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167008.622947:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.622954:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.622969:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167008.622970:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f2d1000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.622976:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.622979:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0afdd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.622980:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.622992:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.623003:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.623006:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0afdd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.623013:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0afcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.623029:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afd6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.623036:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0afdd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.623039:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0afd6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.623057:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0afdd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.623098:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451895808:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 380us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.623105:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17009 00000100:00100000:0.0:1762167008.623239:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451896064:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 500us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.623241:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451895936:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 485us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.623253:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17010 00000100:00100000:3.0:1762167008.623260:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17011 00000100:00100000:3.0:1762167008.624597:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.624655:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451896320 00000100:00100000:0.0:1762167008.624662:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451896320 00000100:00100000:0.0:1762167008.624713:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19867 00000100:00100000:0.0:1762167008.624721:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56209:x1847765451896320:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167008.624799:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167008.624827:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0af6d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b0c expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.624846:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167008.624856:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.624899:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.624910:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.624918:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00010000:0.0:1762167008.625083:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000af930d0a reply state 0000000077acab06 transno 8589952960 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167008.625097:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167008.625179:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56209:x1847765451896320:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 458us (586us total) trans 8589952960 rc 0/0 00000100:00100000:0.0:1762167008.625186:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19867 00010000:00010000:0.0:1762167008.626442:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.626454:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.626462:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167008.626469:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167008.626482:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f2d1a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.626487:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.626498:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.626517:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167008.626520:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.626523:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.626529:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0afe4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.626694:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451896448 00000100:00100000:3.0:1762167008.626702:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451896448 00000100:00100000:3.0:1762167008.626757:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19868 00000100:00100000:3.0:1762167008.626788:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56209:x1847765451896448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167008.626809:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.626825:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0afeb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b3d expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.626868:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0afeb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b3d expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.626881:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0afeb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b3d expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.626897:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167008.626900:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167008.626902:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:3.0:1762167008.626952:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56209:x1847765451896448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 167us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.626963:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19868 00000100:00100000:2.0:1762167008.628105:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.628139:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.628156:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451896576 00000100:00100000:3.0:1762167008.628164:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451896576 00000100:00100000:0.0:1762167008.628202:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451896704 00000100:00100000:0.0:1762167008.628208:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451896704 00000100:00100000:3.0:1762167008.628209:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17012 00000100:00100000:3.0:1762167008.628232:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451896576:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167008.628244:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17013 00000100:00100000:1.0:1762167008.628258:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451896704:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167008.628489:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.628492:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 0 -> 1762167008 00002000:00010000:1.0:1762167008.628494:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 0 -> 1762167008 00002000:00010000:1.0:1762167008.628496:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 0 -> 1762167008 00002000:00010000:1.0:1762167008.628497:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167008.628551:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765451896704:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 297us (411us total) trans 17179875858 rc 0/0 00000100:00100000:3.0:1762167008.628557:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451896576:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 328us (452us total) trans 21474843408 rc 0/0 00000100:00100000:1.0:1762167008.628564:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17013 00000100:00100000:3.0:1762167008.628570:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17012 00000100:00100000:2.0:1762167008.629814:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.629863:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451896960 00000100:00100000:3.0:1762167008.629869:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451896960 00000100:00100000:3.0:1762167008.629913:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19869 00000100:00100000:3.0:1762167008.629923:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56209:x1847765451896960:12345-192.168.203.35@tcp:55:lfs.0 00010000:00010000:3.0:1762167008.629977:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0aff2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.629992:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0aff2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.630002:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0aff2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.630023:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0aff2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.630030:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0aff2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.630036:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0aff2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.630045:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167008.630049:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0aff2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.630056:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0aff2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.630066:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167008.630069:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1762167008.630073:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0aff2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.630079:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0aff2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.630135:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56209:x1847765451896960:12345-192.168.203.35@tcp:55:lfs.0 Request processed in 213us (327us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762167008.630143:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19869 00000100:00100000:2.0:1762167008.631280:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.631321:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451897216 00000100:00100000:3.0:1762167008.631327:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451897216 00000100:00100000:3.0:1762167008.631367:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19870 00000100:00100000:3.0:1762167008.631386:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56209:x1847765451897216:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167008.631424:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167008.631446:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0af12 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3af0 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.631463:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:3.0:1762167008.631467:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167008.631499:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.631510:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.631517:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00010000:3.0:1762167008.631644:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000adf541a7 reply state 00000000048704ae transno 8589952961 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.631653:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167008.631720:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56209:x1847765451897216:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 336us (444us total) trans 8589952961 rc 0/0 00000100:00100000:3.0:1762167008.631727:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19870 00010000:00010000:3.0:1762167008.632419:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.632429:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.632436:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.632441:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167008.632445:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.632452:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.632462:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:3.0:1762167008.632466:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167008.632469:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.632475:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0aff9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167008.632812:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.632840:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.632881:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.632902:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451897344 00000100:00100000:0.0:1762167008.632910:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451897344 00000100:00100000:0.0:1762167008.632953:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451897472 00000100:00100000:0.0:1762167008.632955:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451897472 00000100:00100000:1.0:1762167008.632995:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451897600 00000100:00100000:0.0:1762167008.632999:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17014 00000100:00100000:1.0:1762167008.633013:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451897600 00000100:00100000:3.0:1762167008.633014:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17015 00000100:00100000:0.0:1762167008.633015:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451897344:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167008.633035:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2358:x1847765451897472:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167008.633066:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17016 00000100:00100000:1.0:1762167008.633080:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451897600:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:0.0:1762167008.633191:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:0.0:1762167008.633196:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.633199:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.633201:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167008.633203:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 325 -> 185 00002000:00010000:3.0:1762167008.633208:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.633212:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.633215:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.633217:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.633220:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167008.633273:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451897344:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 258us (506us total) trans 21474843409 rc 0/0 00000100:00100000:3.0:1762167008.633279:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2358:x1847765451897472:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 248us (434us total) trans 17179875859 rc 0/0 00000100:00100000:0.0:1762167008.633289:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17014 00000100:00100000:3.0:1762167008.633300:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17015 00002000:00010000:1.0:1762167008.633300:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.633310:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.633315:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.633319:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.633322:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167008.633397:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451897600:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 320us (514us total) trans 21474843410 rc 0/0 00000100:00100000:1.0:1762167008.633406:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17016 00000100:00100000:2.0:1762167008.634639:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.634709:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451897856 00000100:00100000:3.0:1762167008.634715:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451897856 00000100:00100000:3.0:1762167008.634757:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7349 00000100:00100000:3.0:1762167008.634788:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242a6e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56209:x1847765451897856:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:3.0:1762167008.634850:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af89 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b21 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.634889:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.634903:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0aecc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3acd expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.634911:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.634945:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0aecc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3acd expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.634958:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0aecc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3acd expref: 894 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:3.0:1762167008.634971:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454476032:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167008.635032:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.636275:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454476032:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167008.636298:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167008.636512:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.636593:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451897984 00000100:00100000:1.0:1762167008.636601:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451897984 00010000:00010000:1.0:1762167008.636631:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0aecc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3acd expref: 895 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1762167008.636664:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7534 00000100:00100000:1.0:1762167008.636673:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451897984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167008.636686:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.636693:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0aecc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3acd expref: 895 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167008.636705:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0aecc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3acd expref: 895 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167008.636724:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0aecc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3acd expref: 895 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167008.636753:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:1.0:1762167008.636758:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.636803:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.636811:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.636834:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167008.636853:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.636862:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.636880:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.636891:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0afeb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b3d expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.636899:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.636923:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0afeb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b3d expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.636930:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451897984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 256us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.636947:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7534 00010000:00010000:3.0:1762167008.636952:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0afeb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b3d expref: 894 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:3.0:1762167008.636967:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454476160:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167008.637009:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.638085:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454476160:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167008.638169:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167008.638230:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.638296:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898112 00000100:00100000:1.0:1762167008.638302:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898112 00010000:00010000:1.0:1762167008.638326:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0afeb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b3d expref: 894 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1762167008.638362:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7535 00000100:00100000:1.0:1762167008.638382:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765451898112:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167008.638393:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.638399:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0afeb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b3d expref: 894 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167008.638411:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0afeb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b3d expref: 894 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167008.638427:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0afeb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b3d expref: 894 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167008.638440:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:1.0:1762167008.638444:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.638461:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.638467:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.638488:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167008.638523:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167008.638530:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2361:x1847765451898112:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (299us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167008.638535:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167008.638548:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7535 00000100:00100000:3.0:1762167008.639143:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.639185:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.639212:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.639226:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454476288 00000100:00100000:0.0:1762167008.639233:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454476288 00000100:00100000:0.0:1762167008.639270:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:0.0:1762167008.639278:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454476288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.639361:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454476288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.639369:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:3.0:1762167008.639392:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843398 gen 2 00000004:00080000:3.0:1762167008.639398:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc30000, transno 21474843379 00000004:00080000:3.0:1762167008.639411:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243306300, transno 21474843380 00000004:00080000:3.0:1762167008.639414:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243304700, transno 21474843381 00000004:00080000:3.0:1762167008.639417:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc31f80, transno 21474843382 00000004:00080000:3.0:1762167008.639419:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243306a00, transno 21474843383 00000004:00080000:3.0:1762167008.639422:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243304e00, transno 21474843384 00000004:00080000:3.0:1762167008.639425:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e447b80, transno 21474843385 00000004:00080000:3.0:1762167008.639428:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243305f80, transno 21474843386 00000004:00080000:3.0:1762167008.639434:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee359064a80, transno 21474843387 00000004:00080000:3.0:1762167008.639438:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee359064e00, transno 21474843388 00000004:00080000:3.0:1762167008.639441:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4f100, transno 21474843389 00000004:00080000:3.0:1762167008.639444:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4f800, transno 21474843390 00000004:00080000:3.0:1762167008.639446:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4fb80, transno 21474843391 00000004:00080000:3.0:1762167008.639448:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4c000, transno 21474843392 00000004:00080000:3.0:1762167008.639450:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4e680, transno 21474843393 00000004:00080000:3.0:1762167008.639452:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4d880, transno 21474843394 00000004:00080000:3.0:1762167008.639455:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce4700, transno 21474843395 00000004:00080000:3.0:1762167008.639458:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee35047d500, transno 21474843396 00000004:00080000:3.0:1762167008.639460:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee35047c700, transno 21474843397 00000004:00080000:3.0:1762167008.639462:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee372a4ca80, transno 21474843398 00000100:00100000:3.0:1762167008.639468:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.639520:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.639548:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.639574:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348287180 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.639591:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454476416 00000100:00100000:1.0:1762167008.639596:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454476416 00000100:00100000:1.0:1762167008.639626:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1762167008.639635:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454476416:12345-0@lo:1000:mdt_rdpg00_000.0 00000004:00080000:0.0:1762167008.639649:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 12 in progress, 0 in flight, 8 done 00000100:00100000:1.0:1762167008.639708:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454476416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 73us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.639716:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:3.0:1762167008.639722:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476416:0@lo:1000:mdt_rdpg00_000.0 00000004:00080000:0.0:1762167008.639790:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 12 done 00000100:00100000:3.0:1762167008.639816:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.639841:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.639853:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485d80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.639861:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454476544 00000100:00100000:1.0:1762167008.639866:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454476544 00000100:00100000:1.0:1762167008.639895:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1762167008.639905:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454476544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.639955:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454476544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.639962:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:3.0:1762167008.639970:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640002:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476672:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640023:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.640042:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.640074:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454476672 00000100:00100000:1.0:1762167008.640078:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454476672 00000100:00100000:1.0:1762167008.640104:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:1.0:1762167008.640113:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454476672:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.640168:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454476672:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.640175:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:3.0:1762167008.640183:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476672:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640224:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640247:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.640267:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3482d7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.640273:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454476800 00000100:00100000:1.0:1762167008.640277:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454476800 00000100:00100000:1.0:1762167008.640302:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1762167008.640310:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454476800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.640361:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454476800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.640368:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1762167008.640384:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640420:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640442:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.640461:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.640486:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454476928 00000100:00100000:1.0:1762167008.640491:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454476928 00000100:00100000:1.0:1762167008.640516:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1762167008.640523:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454476928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.640572:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454476928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.640579:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:3.0:1762167008.640585:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454476928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640615:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640636:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.640653:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.640657:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454477056 00000100:00100000:1.0:1762167008.640661:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454477056 00000100:00100000:1.0:1762167008.640684:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1762167008.640690:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454477056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.640736:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454477056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 45us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.640744:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1762167008.640748:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640800:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640821:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.640839:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.640841:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454477184 00000100:00100000:1.0:1762167008.640846:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454477184 00000100:00100000:1.0:1762167008.640871:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1762167008.640879:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454477184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.640924:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454477184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 46us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.640930:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1762167008.640939:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640972:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.640993:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.641012:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454477312 00000100:00100000:3.0:1762167008.641013:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.641018:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454477312 00000100:00100000:1.0:1762167008.641044:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1762167008.641052:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454477312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.641099:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454477312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.641105:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1762167008.641110:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.641141:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.641163:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.641184:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.641184:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454477440 00000100:00100000:1.0:1762167008.641190:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454477440 00000100:00100000:1.0:1762167008.641213:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1762167008.641219:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454477440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.641265:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454477440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 44us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.641271:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1762167008.641278:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.641313:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.641335:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.641354:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454477568 00000100:00100000:3.0:1762167008.641355:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.641358:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454477568 00000100:00100000:1.0:1762167008.641393:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1762167008.641399:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454477568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.641432:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454477568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.641436:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:3.0:1762167008.641451:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.641482:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.641508:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.641524:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454477696 00000100:00100000:1.0:1762167008.641527:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454477696 00000100:00100000:3.0:1762167008.641529:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.641552:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1762167008.641558:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454477696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.641607:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454477696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 48us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.641614:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1762167008.641622:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.641655:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438bb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.641677:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.641697:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.641698:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454477824 00000100:00100000:1.0:1762167008.641703:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454477824 00000100:00100000:1.0:1762167008.641734:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1762167008.641740:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454477824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.641806:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454477824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.641813:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:2.0:1762167008.641837:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438bb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.641875:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.641902:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.641923:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454477952 00000100:00100000:2.0:1762167008.641924:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.641929:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454477952 00000100:00100000:1.0:1762167008.641950:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1762167008.641957:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454477952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.642004:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454477952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 47us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.642011:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:2.0:1762167008.642028:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454477952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.642062:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.642084:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.642102:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.642103:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454478080 00000100:00100000:1.0:1762167008.642109:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454478080 00000100:00100000:1.0:1762167008.642134:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1762167008.642143:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454478080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.642190:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454478080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.642197:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:2.0:1762167008.642210:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.642232:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.642250:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.642267:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.642269:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454478208 00000100:00100000:1.0:1762167008.642274:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454478208 00000100:00100000:1.0:1762167008.642300:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1762167008.642306:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454478208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.642355:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454478208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.642364:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1762167008.642413:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.642451:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.642479:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.642508:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.642522:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454478336 00000100:00100000:1.0:1762167008.642527:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454478336 00000100:00100000:1.0:1762167008.642548:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1762167008.642553:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454478336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.642601:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454478336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 47us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.642608:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1762167008.642619:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.642659:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.642689:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.642717:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.642738:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454478464 00000100:00100000:3.0:1762167008.642744:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454478464 00000100:00100000:3.0:1762167008.642813:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1762167008.642824:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454478464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.642901:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454478464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.642909:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1762167008.642920:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.642956:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.642979:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.643000:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.643012:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454478592 00000100:00100000:3.0:1762167008.643017:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454478592 00000100:00100000:3.0:1762167008.643043:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1762167008.643051:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454478592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.643099:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454478592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.643108:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1762167008.643126:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.643157:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.643179:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.643200:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.643205:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454478720 00000100:00100000:3.0:1762167008.643209:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454478720 00000100:00100000:3.0:1762167008.643251:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1762167008.643258:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454478720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.643307:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454478720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.643314:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:2.0:1762167008.643333:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.643366:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.643401:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.643422:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.643443:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454478848 00000100:00100000:3.0:1762167008.643449:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454478848 00000100:00100000:3.0:1762167008.643476:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1762167008.643483:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454478848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.643533:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454478848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 51us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.643544:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:2.0:1762167008.643558:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.643592:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.643615:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.643635:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.643649:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454478976 00000100:00100000:3.0:1762167008.643654:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454478976 00000100:00100000:1.0:1762167008.643698:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1762167008.643708:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454478976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.643780:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454478976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.643788:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:2.0:1762167008.643810:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454478976:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1762167008.644142:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].54, 1176 off66712 00000001:00080000:2.0:1762167008.644155:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952962 00000100:00100000:2.0:1762167008.644216:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454479104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.644243:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.644267:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.644286:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454479104 00000100:00100000:1.0:1762167008.644292:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454479104 00000100:00100000:1.0:1762167008.644325:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1762167008.644331:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454479104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.644557:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454479104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 226us (313us total) trans 21474843411 rc 0/0 00000100:00100000:1.0:1762167008.644562:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1762167008.644720:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454479104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.644746:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454479232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167008.644808:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.644830:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.644832:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454479232 00000100:00100000:1.0:1762167008.644849:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454479232 00000100:00100000:1.0:1762167008.644887:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1762167008.644895:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454479232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.645083:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:30820:x1847765454479232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 188us (276us total) trans 17179875860 rc 0/0 00000100:00100000:1.0:1762167008.645088:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:2.0:1762167008.645233:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454479232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762167008.645324:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952963 00010000:00010000:2.0:1762167008.645355:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645366:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645386:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645392:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167008.645396:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645403:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645420:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:2.0:1762167008.645423:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167008.645428:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645434:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b007 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645463:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645470:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645476:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645481:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167008.645484:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645489:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645497:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:2.0:1762167008.645500:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167008.645502:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645507:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b000 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.645519:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8d00) 00010000:00010000:2.0:1762167008.645522:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167008.645528:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0af89 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b21 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.645623:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242a6e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56209:x1847765451897856:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 10858us (10988us total) trans 8589952964 rc 0/0 00000100:00100000:2.0:1762167008.645632:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7349 00000020:00080000:2.0:1762167008.645637:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762167008.647185:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.647235:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898240 00000100:00100000:3.0:1762167008.647242:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898240 00000100:00100000:3.0:1762167008.647291:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19871 00000100:00100000:3.0:1762167008.647300:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56209:x1847765451898240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167008.647327:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.647346:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b00e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b44 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.647411:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b00e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b44 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.647426:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b00e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b44 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.647443:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:3.0:1762167008.647447:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167008.647449:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:3.0:1762167008.647502:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56209:x1847765451898240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 204us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.647508:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19871 00000100:00100000:0.0:1762167008.649456:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.649505:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898496 00000100:00100000:2.0:1762167008.649514:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898496 00000100:00100000:2.0:1762167008.649580:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7350 00000100:00100000:2.0:1762167008.649590:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56209:x1847765451898496:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167008.649830:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56209:x1847765451898496:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 240us (377us total) trans 8589952965 rc 0/0 00000100:00100000:2.0:1762167008.649840:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7350 00000100:00100000:0.0:1762167008.651425:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.651819:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898752 00000100:00100000:2.0:1762167008.651844:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898752 00000100:00100000:2.0:1762167008.651924:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7351 00000100:00100000:2.0:1762167008.651933:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56209:x1847765451898752:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:2.0:1762167008.652277:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x64d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762167008.652406:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.652423:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.652433:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.652441:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.652446:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.652449:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.652475:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762167008.652576:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167008.652588:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167008.652600:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167008.652604:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167008.652615:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167008.652635:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64d:0x0].0x0 (ffff9ee2429d0800) 00010000:00010000:0.0:1762167008.652639:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762167008.652644:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167008.652650:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56209:x1847765451898752:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 712us (1223us total) trans 8589952966 rc 0/0 00010000:00010000:0.0:1762167008.652664:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b015 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167008.652674:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7351 00010000:00010000:0.0:1762167008.652713:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167008.652718:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167008.652720:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167008.663075:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.663153:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451898880 00000100:00100000:0.0:1762167008.663163:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451898880 00000100:00100000:0.0:1762167008.663223:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19872 00000100:00100000:0.0:1762167008.663234:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56210:x1847765451898880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.663261:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.663286:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b01c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b4b expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.663362:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b023 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663387:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b023 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663398:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b023 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663411:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b02a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663418:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b02a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663424:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b02a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663522:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663530:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663536:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.663566:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:0.0:1762167008.663570:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.663585:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663595:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663603:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b023 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663609:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b023 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663615:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b023 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663621:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f2d0e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.663625:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b023 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663632:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b023 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663643:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167008.663646:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.663650:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b023 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663656:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b023 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663669:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b02a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663675:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b02a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663692:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b02a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663697:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f2d1000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.663700:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b02a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663706:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b02a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663713:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167008.663715:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.663718:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b02a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663724:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b02a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.663749:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b01c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b4b expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.663805:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b4b expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.663814:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:0.0:1762167008.663816:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.663819:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28600, rc 0) 00000100:00100000:0.0:1762167008.663876:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56210:x1847765451898880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 644us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.663884:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19872 00000100:00100000:3.0:1762167008.666414:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.666803:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451899136 00000100:00100000:0.0:1762167008.666813:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451899136 00000100:00100000:0.0:1762167008.666874:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19873 00000100:00100000:0.0:1762167008.666884:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56210:x1847765451899136:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.666904:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.666922:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b038 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b52 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.667017:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b03f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.667031:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b03f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.667041:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b03f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.667050:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:0.0:1762167008.667175:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b038 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b52 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.667195:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b03f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b52 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.667204:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:0.0:1762167008.667207:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762167008.667210:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29400, rc 0) 00000100:00100000:0.0:1762167008.667282:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56210:x1847765451899136:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 398us (877us total) trans 8589952967 rc 0/0 00000100:00100000:0.0:1762167008.667292:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19873 00000100:00100000:2.0:1762167008.670352:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.670439:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451899392 00000100:00100000:0.0:1762167008.670449:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451899392 00000100:00100000:0.0:1762167008.670509:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19874 00000100:00100000:0.0:1762167008.670518:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56210:x1847765451899392:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.670541:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.670560:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b04d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b59 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.670647:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b054 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.670667:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b054 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.670677:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b054 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.670688:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:0.0:1762167008.670864:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b04d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b59 expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.670882:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b054 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b59 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.670891:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:0.0:1762167008.670894:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167008.670898:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29000, rc 0) 00000100:00100000:0.0:1762167008.670958:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56210:x1847765451899392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 440us (615us total) trans 8589952968 rc 0/0 00000100:00100000:0.0:1762167008.670965:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19874 00010000:00010000:1.0:1762167008.679972:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167008.698749:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.699304:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451899520 00000100:00100000:1.0:1762167008.699314:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451899520 00000100:00100000:1.0:1762167008.699402:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2987 00000100:00100000:1.0:1762167008.699412:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451899520:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167008.699446:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b062 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.699462:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.699464:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.699469:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b062 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.699483:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b062 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.701329:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b062 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.701345:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b062 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.701354:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b062 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.701361:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ba00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.701365:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b062 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.701387:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b062 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.701405:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b062 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.701412:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b062 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.701478:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451899520:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2063us (2735us total) trans 0 rc 131446/131446 00000100:00100000:1.0:1762167008.701487:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2987 00000100:00100000:2.0:1762167008.704149:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.704224:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451899648 00000100:00100000:1.0:1762167008.704235:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451899648 00000100:00100000:1.0:1762167008.704306:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2988 00000100:00100000:1.0:1762167008.704317:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451899648:12345-192.168.203.35@tcp:3:lfs.0 00002000:00010000:1.0:1762167008.704369:0:14117:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 131446, mtime: 0x690888e0, atime: 0x690888e0, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:1.0:1762167008.704403:0:14117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b069 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.704416:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.704418:0:14117:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.704424:0:14117:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b069 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.704444:0:14117:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b069 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.706830:0:14117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b069 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.706848:0:14117:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b069 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.706857:0:14117:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.706865:0:14117:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.706869:0:14117:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.706878:0:14117:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b069 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.706895:0:14117:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b069 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.706903:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b069 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.707008:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451899648:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2689us (2862us total) trans 0 rc 131446/131446 00000100:00100000:1.0:1762167008.707019:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2988 00000100:00100000:3.0:1762167008.715418:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.715496:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451899776 00000100:00100000:2.0:1762167008.715506:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451899776 00000100:00100000:2.0:1762167008.715732:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 651 00000100:00100000:2.0:1762167008.715744:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56210:x1847765451899776:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762167008.715798:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.715828:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b054 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b59 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.715849:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:2.0:1762167008.715861:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.715934:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56210:x1847765451899776:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 192us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.715942:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 651 00000100:00100000:2.0:1762167008.717298:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.717357:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451900032 00000100:00100000:3.0:1762167008.717365:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451900032 00000100:00100000:3.0:1762167008.717430:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7352 00000100:00100000:3.0:1762167008.717440:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56210:x1847765451900032:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167008.717680:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56210:x1847765451900032:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 241us (385us total) trans 8589952969 rc 0/0 00000100:00100000:3.0:1762167008.717688:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7352 00000100:00100000:3.0:1762167008.720289:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.720354:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451900288 00000100:00100000:2.0:1762167008.720364:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451900288 00000100:00100000:2.0:1762167008.720438:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19875 00000100:00100000:2.0:1762167008.720448:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56065:x1847765451900288:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167008.720470:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.720501:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b070 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b60 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.720606:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.720622:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b4b expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.720630:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.720688:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b4b expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.720702:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b4b expref: 903 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.720717:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454479360:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.720838:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242c59480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.722090:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454479360:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.722115:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167008.722353:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.722413:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451900416 00000100:00100000:2.0:1762167008.722421:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451900416 00010000:00010000:2.0:1762167008.722450:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b4b expref: 904 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.722490:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7536 00000100:00100000:2.0:1762167008.722501:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2361:x1847765451900416:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.722514:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.722520:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b4b expref: 904 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.722533:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b4b expref: 904 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.722552:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b031 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b4b expref: 904 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.722568:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:2.0:1762167008.722573:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.722581:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.722588:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.722618:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.722661:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.722671:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167008.722672:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2361:x1847765451900416:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 172us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.722688:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7536 00000004:00200000:0.0:1762167008.722696:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:0.0:1762167008.722875:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b070 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b60 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.722897:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b60 expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.722905:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:0.0:1762167008.722908:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167008.722911:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:0.0:1762167008.722953:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451900288:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2506us (2672us total) trans 8589952970 rc 0/0 00000100:00100000:0.0:1762167008.722961:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19875 00000100:00100000:3.0:1762167008.724583:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.724671:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451900544 00000100:00100000:0.0:1762167008.724679:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451900544 00000100:00100000:0.0:1762167008.724729:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19876 00000100:00100000:0.0:1762167008.724738:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451900544:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.724759:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.724795:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b085 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b67 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.724877:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.724891:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b60 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.724898:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.724924:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b60 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.724933:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b60 expref: 904 pid: 30817 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167008.724943:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454479488:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167008.725010:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.726282:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454479488:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.726305:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167008.726633:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.726703:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451900672 00000100:00100000:2.0:1762167008.726711:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451900672 00010000:00010000:2.0:1762167008.726751:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b60 expref: 905 pid: 30817 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.726818:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7537 00000100:00100000:2.0:1762167008.726829:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2360:x1847765451900672:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.726843:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.726850:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b60 expref: 905 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.726862:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b60 expref: 905 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.726882:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b077 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b60 expref: 905 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.726898:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:2.0:1762167008.726902:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.726911:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.726917:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.726947:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.726987:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167008.726998:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2360:x1847765451900672:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 168us (364us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167008.726999:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167008.727014:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7537 00000004:00200000:0.0:1762167008.727056:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:0.0:1762167008.727060:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.727077:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.727100:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b085 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b67 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.727113:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b67 expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.727118:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:0.0:1762167008.727120:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.727122:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29000, rc 0) 00000100:00100000:0.0:1762167008.727164:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451900544:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2427us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.727171:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19876 00000100:00100000:3.0:1762167008.729478:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.729529:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.729576:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451900800 00000100:00100000:0.0:1762167008.729585:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451900928 00000100:00100000:1.0:1762167008.729589:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451900800 00000100:00100000:0.0:1762167008.729592:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451900928 00000100:00100000:1.0:1762167008.729668:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17017 00000100:00100000:0.0:1762167008.729677:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17018 00000100:00100000:1.0:1762167008.729684:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2358:x1847765451900800:12345-192.168.203.35@tcp:101:fsx.0 00000100:00100000:0.0:1762167008.729692:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2359:x1847765451900928:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167008.729703:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.729703:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.729724:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b093 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b75 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.729726:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b09a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b6e expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.729759:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1762167008.729760:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 131446, mtime: 0x690888e0, atime: 0x690888e0, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:0.0:1762167008.729788:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.729798:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b093 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b75 expref: 38 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167008.729809:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.729812:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.729818:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b093 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b75 expref: 38 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167008.729822:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b09a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b6e expref: 21 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.729835:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29200, rc 0) 00010000:00010000:1.0:1762167008.729842:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b09a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b6e expref: 21 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167008.729853:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7bc00, rc 0) 00000100:00100000:0.0:1762167008.729896:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2359:x1847765451900928:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 208us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.729900:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451900800:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 221us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.729909:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17018 00000100:00100000:1.0:1762167008.729919:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17017 00000100:00100000:1.0:1762167008.731855:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.731959:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901056 00000100:00100000:3.0:1762167008.731967:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901056 00000100:00100000:3.0:1762167008.732025:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17019 00000100:00100000:3.0:1762167008.732037:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2361:x1847765451901056:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167008.732052:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.732067:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b0a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b7c expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.732089:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.732092:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.732099:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b7c expref: 39 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167008.732114:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b7c expref: 39 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167008.732128:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:3.0:1762167008.732182:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2361:x1847765451901056:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 148us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.732189:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17019 00000100:00100000:3.0:1762167008.734109:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.734164:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901184 00000100:00100000:0.0:1762167008.734172:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901184 00000100:00100000:0.0:1762167008.734235:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17020 00000100:00100000:0.0:1762167008.734245:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2359:x1847765451901184:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.734260:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.734276:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b0a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b83 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.734298:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.734301:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.734308:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b83 expref: 40 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.734323:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b83 expref: 40 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.734333:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29c00, rc 0) 00000100:00100000:0.0:1762167008.734391:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2359:x1847765451901184:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 148us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.734397:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17020 00000100:00100000:2.0:1762167008.736498:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.736567:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901312 00000100:00100000:0.0:1762167008.736579:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901312 00000100:00100000:0.0:1762167008.736629:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17021 00000100:00100000:0.0:1762167008.736638:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2358:x1847765451901312:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.736655:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.736672:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b0af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b8a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.736704:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.736707:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.736713:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b0af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b8a expref: 41 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.736726:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b0af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b8a expref: 41 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.736737:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28600, rc 0) 00000100:00100000:0.0:1762167008.736849:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2358:x1847765451901312:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 211us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.736855:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17021 00000100:00100000:1.0:1762167008.738821:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.738867:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901440 00000100:00100000:0.0:1762167008.738876:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901440 00000100:00100000:0.0:1762167008.738925:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17022 00000100:00100000:0.0:1762167008.738934:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2358:x1847765451901440:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.738955:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.738972:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b0b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b91 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.738997:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.739000:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.739007:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b0b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b91 expref: 42 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.739021:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b0b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b91 expref: 42 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.739034:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f2d1a00, rc 0) 00000100:00100000:0.0:1762167008.739076:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:2358:x1847765451901440:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 144us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.739081:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17022 00000100:00100000:3.0:1762167008.740869:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.740997:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901568 00000100:00100000:0.0:1762167008.741005:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901568 00000100:00100000:0.0:1762167008.741053:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17023 00000100:00100000:0.0:1762167008.741063:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56065:x1847765451901568:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.741078:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.741092:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b98 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.741118:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b09a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b6e expref: 22 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.741127:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.741129:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.741133:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 22 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.741165:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b09a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b6e expref: 22 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.741179:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b09a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b6e expref: 22 pid: 12402 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1762167008.741193:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454479616:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167008.741262:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.742643:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.742731:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454479616:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.742757:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 22 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.742804:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f2d1000, rc 0) 00000100:00100000:0.0:1762167008.742850:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56065:x1847765451901568:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1788us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.742859:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17023 00000100:00100000:1.0:1762167008.743150:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901696 00000100:00100000:1.0:1762167008.743157:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901696 00010000:00010000:1.0:1762167008.743188:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b09a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b6e expref: 22 pid: 12402 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1762167008.743222:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7538 00000100:00100000:1.0:1762167008.743230:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451901696:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167008.743242:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.743260:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b09a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b6e expref: 22 pid: 12402 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.743273:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b09a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b6e expref: 22 pid: 12402 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.743293:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b09a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b6e expref: 22 pid: 12402 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.743316:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.743318:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.743324:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.743334:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.743359:0:5741:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.743383:0:5741:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765454479744:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167008.743454:0:5741:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.744636:0:5741:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5741:1847765454479744:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167008.744654:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167008.744698:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451901696:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1468us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.744711:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7538 00000100:00100000:3.0:1762167008.745305:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.745351:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451901824 00000100:00100000:1.0:1762167008.745358:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451901824 00002000:00100000:1.0:1762167008.745403:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x81e:0x0] (40960->45055) req@ffff9ee37f8c0380 x1847765451901824/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167008.745413:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c0380 with x1847765451901824 ext(40960->45055) 00002000:00010000:1.0:1762167008.745419:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f8c0380 00000100:00100000:1.0:1762167008.745437:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2989 00000100:00100000:1.0:1762167008.745445:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451901824:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:1.0:1762167008.745623:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451901824:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 179us (319us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762167008.745630:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2989 00002000:00100000:1.0:1762167008.745636:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x81e:0x0] (40960->45055) req@ffff9ee37f8c0380 x1847765451901824/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/4536 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167008.745644:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c0380 with x1847765451901824 ext(40960->45055) 00002000:00010000:1.0:1762167008.745648:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f8c0380 00000100:00100000:3.0:1762167008.747426:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.747495:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451902080 00000100:00100000:2.0:1762167008.747504:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451902080 00000100:00100000:2.0:1762167008.747554:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7353 00000100:00100000:2.0:1762167008.747564:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56065:x1847765451902080:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167008.747862:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451902080:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 299us (443us total) trans 8589952971 rc 0/0 00000100:00100000:2.0:1762167008.747871:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7353 00000100:00100000:3.0:1762167008.749244:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.749315:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451902336 00000100:00100000:0.0:1762167008.749322:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451902336 00000100:00100000:0.0:1762167008.749390:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19877 00000100:00100000:0.0:1762167008.749401:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56065:x1847765451902336:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.749422:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.749425:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762167008.749453:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b08c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b67 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.749478:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b03f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b52 expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.749496:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b00e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b44 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.749508:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23c00) 00010000:00010000:0.0:1762167008.749518:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.749533:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b0c4 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3b9f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.749581:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.749593:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167008.749603:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000040:00080000:0.0:1762167008.750198:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5483, 88 off442808 00000004:00080000:0.0:1762167008.750207:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629542444367ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.750279:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5491, 88 off443864 00000004:00080000:0.0:1762167008.750284:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629542521384ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167008.750319:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5492, 88 off443952 00000004:00080000:0.0:1762167008.750323:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629542560181ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167008.750342:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5484, 88 off442896 00000004:00080000:0.0:1762167008.750346:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629542583634ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.750534:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5493, 88 off444040 00000004:00080000:0.0:1762167008.750542:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629542779516ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167008.750581:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5485, 88 off442984 00000004:00080000:0.0:1762167008.750586:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629542823313ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.750711:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5486, 88 off443072 00000004:00080000:0.0:1762167008.750716:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629542953541ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.750754:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5494, 88 off444128 00000004:00080000:0.0:1762167008.750758:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629542995812ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167008.750809:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5495, 88 off444216 00000004:00080000:0.0:1762167008.750815:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629543051909ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167008.750836:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5487, 88 off443160 00000004:00080000:0.0:1762167008.750840:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629543077342ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.750857:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5496, 88 off444304 00000004:00080000:0.0:1762167008.750860:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629543097514ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167008.750893:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5488, 88 off443248 00000004:00080000:0.0:1762167008.750897:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629543134164ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.750926:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5489, 88 off443336 00000004:00080000:0.0:1762167008.750931:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629543168099ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.750960:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5497, 88 off444392 00000004:00080000:0.0:1762167008.750964:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629543201826ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167008.750998:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5498, 88 off444480 00000004:00080000:0.0:1762167008.751002:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629543239464ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167008.751023:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5490, 88 off443424 00000004:00080000:0.0:1762167008.751027:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629543264129ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.751061:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5491, 88 off443512 00000004:00080000:0.0:1762167008.751066:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629543303376ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.751087:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5499, 88 off444568 00000004:00080000:0.0:1762167008.751091:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629543328811ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167008.751119:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5500, 88 off444656 00000004:00080000:0.0:1762167008.751123:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629543359872ns, next at 628532566027ns, rc = 0 00000040:00080000:0.0:1762167008.751143:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5492, 88 off443600 00000004:00080000:0.0:1762167008.751146:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629543383312ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.751160:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5493, 88 off443688 00000004:00080000:0.0:1762167008.751162:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629543399404ns, next at 628532618837ns, rc = 0 00000040:00080000:0.0:1762167008.751173:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5501, 88 off444744 00000004:00080000:0.0:1762167008.751175:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629543412864ns, next at 628532566027ns, rc = 0 00010000:00010000:2.0:1762167008.773132:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b9f expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.773149:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167008.773153:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762167008.773172:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f2d0e00/0xf915a5bdf3d0b0c4 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b9f expref: 904 pid: 30817 timeout: 0 lvb_type: 3 00000001:00080000:3.0:1762167008.773187:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952972 is committed 00010000:00010000:2.0:1762167008.773192:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b9f expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762167008.773196:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3613 committed 00000004:00080000:3.0:1762167008.773212:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3600 committed 00000004:00080000:3.0:1762167008.773225:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3599 committed 00000004:00080000:3.0:1762167008.773228:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3612 committed 00010000:00010000:2.0:1762167008.773228:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00000004:00080000:3.0:1762167008.773230:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3611 committed 00010000:00010000:2.0:1762167008.773234:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:3.0:1762167008.773235:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3598 committed 00000004:00080000:3.0:1762167008.773239:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3597 committed 00010000:00010000:2.0:1762167008.773240:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28800, rc 0) 00000004:00080000:3.0:1762167008.773242:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3610 committed 00000004:00080000:3.0:1762167008.773246:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3609 committed 00000004:00080000:3.0:1762167008.773248:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3596 committed 00000004:00080000:3.0:1762167008.773249:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3595 committed 00000004:00080000:3.0:1762167008.773250:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3608 committed 00000004:00080000:3.0:1762167008.773252:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3594 committed 00000004:00080000:3.0:1762167008.773254:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3607 committed 00000004:00080000:3.0:1762167008.773256:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3606 committed 00000004:00080000:3.0:1762167008.773257:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3593 committed 00000004:00080000:3.0:1762167008.773259:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3592 committed 00000004:00080000:3.0:1762167008.773260:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3605 committed 00000004:00080000:3.0:1762167008.773262:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3591 committed 00000004:00080000:3.0:1762167008.773263:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3604 committed 00000004:00080000:3.0:1762167008.773265:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3603 committed 00000004:00080000:3.0:1762167008.773267:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3590 committed 00000020:00080000:3.0:1762167008.773302:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee348287a80 refcount 2 committed 0 result 0 batchid 4294969185 00000020:00080000:3.0:1762167008.773306:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee350485480 00000020:00080000:3.0:1762167008.773311:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee348287180 00000020:00080000:3.0:1762167008.773314:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee3436b7200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee37fa07c00 00000100:00100000:2.0:1762167008.773316:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451902336:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 23909us (24071us total) trans 8589952972 rc 0/0 00000020:00080000:3.0:1762167008.773317:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].54 00000100:00100000:2.0:1762167008.773331:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19877 00000020:00080000:3.0:1762167008.773345:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969185 committed batchid 4294969184 00000100:00100000:2.0:1762167008.773392:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454479872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.773462:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.773509:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454480384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.773537:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454480000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.773544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1762167008.773576:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969184 00000100:00100000:1.0:1762167008.773583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.773596:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454479872 00000100:00100000:3.0:1762167008.773602:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454480384 00000100:00100000:2.0:1762167008.773604:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454479872 00000100:00100000:3.0:1762167008.773608:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454480384 00000100:00100000:1.0:1762167008.773611:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454480512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.773638:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.773670:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454480000 00000100:00100000:3.0:1762167008.773671:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454480512 00000100:00100000:2.0:1762167008.773677:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454480000 00000100:00100000:3.0:1762167008.773678:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454480512 00000100:00100000:1.0:1762167008.773694:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454480128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.773713:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17024 00000100:00100000:3.0:1762167008.773725:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3295:x1847765454479872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.773726:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17025 00000100:00100000:1.0:1762167008.773732:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.773741:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3295:x1847765454480384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.773756:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454480640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.773814:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.773835:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454481152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.773863:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.773881:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454481664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.773900:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454480256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.773907:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.773934:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454480128 00000100:00100000:1.0:1762167008.773938:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454480128 00000100:00100000:0.0:1762167008.773959:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.773966:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454480640 00000100:00100000:1.0:1762167008.773970:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454480640 00002000:00010000:3.0:1762167008.773981:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.773985:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00000100:00100000:0.0:1762167008.773988:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454480768:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167008.773989:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1762167008.773989:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454481152 00000100:00100000:1.0:1762167008.773995:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454481152 00002000:00010000:3.0:1762167008.773998:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000100:00100000:2.0:1762167008.773998:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454480384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 257us (454us total) trans 17179875861 rc 0/0 00002000:00010000:3.0:1762167008.774004:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.774010:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17025 00000100:00100000:1.0:1762167008.774026:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454481664 00000100:00100000:2.0:1762167008.774032:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454480256 00000100:00100000:1.0:1762167008.774032:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454481664 00000100:00100000:0.0:1762167008.774032:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.774039:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454480256 00000100:00100000:3.0:1762167008.774047:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454479872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 324us (584us total) trans 17179875862 rc 0/0 00000100:00100000:3.0:1762167008.774056:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17024 00000100:00100000:1.0:1762167008.774058:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454480768 00000100:00100000:1.0:1762167008.774063:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454480768 00000100:00100000:0.0:1762167008.774065:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454481280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.774072:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17026 00000100:00100000:3.0:1762167008.774080:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17027 00000100:00100000:2.0:1762167008.774085:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3296:x1847765454480512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.774095:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3296:x1847765454480000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.774100:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17028 00000100:00100000:0.0:1762167008.774101:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.774115:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3293:x1847765454480128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.774129:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454481792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.774161:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.774206:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454481024:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167008.774249:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.774253:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.774256:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.774258:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.774262:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.774262:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3296:x1847765454480512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (619us total) trans 17179875863 rc 0/0 00000100:00100000:0.0:1762167008.774269:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.774275:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17026 00000100:00100000:2.0:1762167008.774295:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454481280 00000100:00100000:0.0:1762167008.774298:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454481536:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167008.774300:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454481280 00000100:00100000:3.0:1762167008.774310:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3296:x1847765454480000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (727us total) trans 17179875864 rc 0/0 00000100:00100000:1.0:1762167008.774318:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3293:x1847765454480128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (588us total) trans 17179875865 rc 0/0 00000100:00100000:2.0:1762167008.774319:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454481792 00000100:00100000:2.0:1762167008.774324:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454481792 00000100:00100000:3.0:1762167008.774325:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17027 00000100:00100000:1.0:1762167008.774334:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17028 00000100:00100000:3.0:1762167008.774349:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454481024 00000100:00100000:0.0:1762167008.774355:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.774356:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454481024 00000100:00100000:2.0:1762167008.774356:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17029 00000100:00100000:1.0:1762167008.774366:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17030 00000100:00100000:2.0:1762167008.774381:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3293:x1847765454480640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.774395:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454481536 00000100:00100000:1.0:1762167008.774395:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454481152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.774402:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454481536 00000004:00080000:0.0:1762167008.774418:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240e300/2, rc 0, transno 17179875864 00000100:00100000:3.0:1762167008.774427:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17031 00000100:00100000:0.0:1762167008.774435:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454480000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.774441:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454481664:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167008.774455:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240c000/2, rc 0, transno 17179875863 00000100:00100000:0.0:1762167008.774461:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454480512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.774474:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1762167008.774482:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454480896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.774514:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167008.774518:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167008.774522:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.774526:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167008.774528:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.774531:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167008.774533:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454481408:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167008.774558:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.774563:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.774567:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167008.774569:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.774572:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.774578:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454480640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (763us total) trans 17179875866 rc 0/0 00000100:00100000:0.0:1762167008.774579:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.774594:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17029 00000100:00100000:2.0:1762167008.774614:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454480896 00000100:00100000:1.0:1762167008.774618:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454481152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (752us total) trans 21474843412 rc 0/0 00000100:00100000:2.0:1762167008.774619:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454480896 00000100:00100000:1.0:1762167008.774631:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17030 00000100:00100000:3.0:1762167008.774643:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454481664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (737us total) trans 21474843413 rc 0/0 00000100:00100000:2.0:1762167008.774645:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454481408 00000100:00100000:2.0:1762167008.774650:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454481408 00000100:00100000:1.0:1762167008.774654:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17032 00000100:00100000:3.0:1762167008.774662:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17031 00000100:00100000:1.0:1762167008.774667:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3294:x1847765454480256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.774675:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454482048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.774680:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17033 00000100:00100000:3.0:1762167008.774688:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17034 00000100:00100000:2.0:1762167008.774694:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3294:x1847765454480768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.774703:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454481280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.774711:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.774736:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1762167008.774743:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454481920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.774798:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167008.774833:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167008.774837:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.774840:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167008.774842:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.774845:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167008.774869:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb size from disk: 45050 -> 45050 00002000:00010000:2.0:1762167008.774874:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.774877:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167008.774880:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.774883:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167008.774892:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3294:x1847765454480256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (933us total) trans 17179875867 rc 0/0 00000100:00100000:1.0:1762167008.774900:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17032 00000100:00100000:1.0:1762167008.774918:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454482048 00000100:00100000:1.0:1762167008.774922:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454482048 00000004:00080000:0.0:1762167008.774929:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240e680/2, rc 0, transno 17179875867 00000100:00100000:2.0:1762167008.774937:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3294:x1847765454480768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 247us (908us total) trans 17179875868 rc 0/0 00000100:00100000:1.0:1762167008.774941:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454481920 00000100:00100000:0.0:1762167008.774945:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454480256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.774947:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454481280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 247us (848us total) trans 21474843414 rc 0/0 00000100:00100000:1.0:1762167008.774947:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454481920 00000100:00100000:2.0:1762167008.774948:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17033 00000100:00100000:3.0:1762167008.774962:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17034 00000004:00080000:0.0:1762167008.774970:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24732f100/2, rc 0, transno 17179875868 00000100:00100000:0.0:1762167008.774978:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454480768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167008.774980:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17035 00000100:00100000:1.0:1762167008.774992:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17036 00000100:00100000:2.0:1762167008.774996:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454481792:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167008.774998:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de00a80/2, rc 0, transno 21474843414 00000100:00100000:3.0:1762167008.775006:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17037 00000100:00100000:1.0:1762167008.775007:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454481024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.775015:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454481280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.775022:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454481536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.775098:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454482304:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167008.775135:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167008.775139:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.775142:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167008.775144:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.775147:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81b:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167008.775152:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167008.775153:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167008.775158:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.775163:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.775166:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167008.775169:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167008.775178:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.775183:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.775187:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167008.775192:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00000004:00080000:0.0:1762167008.775192:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03480/2, rc 0, transno 21474843415 00000100:00100000:2.0:1762167008.775193:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454481792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (1030us total) trans 21474843415 rc 0/0 00002000:00010000:3.0:1762167008.775199:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.775209:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17035 00000100:00100000:0.0:1762167008.775210:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454481792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.775216:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454481024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 212us (949us total) trans 21474843416 rc 0/0 00000100:00100000:1.0:1762167008.775226:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17036 00000100:00100000:0.0:1762167008.775226:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762167008.775230:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454482304 00000100:00100000:2.0:1762167008.775235:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454482304 00000100:00100000:0.0:1762167008.775239:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454482176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.775242:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454481536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (890us total) trans 21474843417 rc 0/0 00000100:00100000:3.0:1762167008.775252:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17037 00000100:00100000:2.0:1762167008.775260:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17038 00000100:00100000:2.0:1762167008.775273:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454480896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.775278:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167008.775282:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17039 00000100:00100000:3.0:1762167008.775296:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454481408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.775385:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454482176 00000100:00100000:1.0:1762167008.775391:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454482176 00000004:00080000:0.0:1762167008.775391:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de02a00/2, rc 0, transno 21474843416 00000100:00100000:0.0:1762167008.775403:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454481024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.775419:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17040 00000004:00080000:0.0:1762167008.775421:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de02680/2, rc 0, transno 21474843417 00000100:00100000:0.0:1762167008.775429:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454481536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.775432:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3296:x1847765454482048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167008.775437:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:2.0:1762167008.775443:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00000100:00100000:0.0:1762167008.775443:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00010000:2.0:1762167008.775446:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.775448:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.775450:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 185 -> 185 00002000:00010000:3.0:1762167008.775455:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167008.775459:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.775464:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167008.775464:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454482432:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167008.775471:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.775474:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167008.775486:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454480896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (971us total) trans 21474843418 rc 0/0 00000100:00100000:2.0:1762167008.775494:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17038 00000100:00100000:0.0:1762167008.775506:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167008.775513:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454482432 00000100:00100000:2.0:1762167008.775517:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454482432 00000100:00100000:3.0:1762167008.775524:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454481408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (948us total) trans 21474843419 rc 0/0 00000100:00100000:3.0:1762167008.775532:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17039 00000004:00080000:0.0:1762167008.775544:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03b80/2, rc 0, transno 21474843418 00000100:00100000:2.0:1762167008.775549:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17041 00000100:00100000:0.0:1762167008.775554:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454480896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167008.775558:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17042 00000100:00100000:2.0:1762167008.775564:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3296:x1847765454481920:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167008.775572:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03100/2, rc 0, transno 21474843419 00000100:00100000:3.0:1762167008.775574:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3294:x1847765454482304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167008.775580:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454481408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167008.775586:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3296:x1847765454482048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (872us total) trans 17179875869 rc 0/0 00000100:00100000:1.0:1762167008.775595:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17040 00000004:00080000:0.0:1762167008.775608:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243304e00/2, rc 0, transno 17179875869 00000100:00100000:0.0:1762167008.775614:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454482048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167008.775624:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17043 00000100:00100000:1.0:1762167008.775635:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454482176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.775667:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454482560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.775705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167008.775712:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167008.775717:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.775719:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167008.775722:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.775725:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167008.775725:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167008.775733:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.775737:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.775740:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.775743:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167008.775797:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3296:x1847765454481920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (998us total) trans 17179875870 rc 0/0 00000100:00100000:2.0:1762167008.775805:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17041 00000100:00100000:3.0:1762167008.775820:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3294:x1847765454482304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (669us total) trans 17179875871 rc 0/0 00000100:00100000:2.0:1762167008.775823:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454482560 00000100:00100000:2.0:1762167008.775829:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454482560 00000100:00100000:3.0:1762167008.775836:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17042 00000100:00100000:1.0:1762167008.775837:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454482176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (561us total) trans 21474843420 rc 0/0 00000100:00100000:1.0:1762167008.775847:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17043 00000100:00100000:2.0:1762167008.775857:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17044 00000004:00080000:0.0:1762167008.775859:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243306a00/2, rc 0, transno 17179875870 00000100:00100000:3.0:1762167008.775866:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17045 00000100:00100000:2.0:1762167008.775868:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454482432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167008.775869:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454481920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.775880:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454482560:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167008.775902:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de00380/2, rc 0, transno 21474843413 00000100:00100000:1.0:1762167008.775909:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454481664:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167008.775925:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de02d80/2, rc 0, transno 21474843412 00000100:00100000:1.0:1762167008.775929:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454481152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167008.775943:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240c380/2, rc 0, transno 17179875865 00000100:00100000:1.0:1762167008.775947:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454480128:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167008.775960:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24732fb80/2, rc 0, transno 17179875866 00000100:00100000:1.0:1762167008.775964:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454480640:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167008.775989:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167008.775993:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.775996:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167008.775998:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167008.776001:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167008.776014:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:3.0:1762167008.776018:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.776021:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.776024:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167008.776027:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167008.776051:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3296:x1847765454482432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (546us total) trans 21474843421 rc 0/0 00000100:00100000:2.0:1762167008.776060:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17044 00000100:00100000:3.0:1762167008.776067:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3296:x1847765454482560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (362us total) trans 21474843422 rc 0/0 00000100:00100000:3.0:1762167008.776076:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17045 00000004:00080000:0.0:1762167008.776092:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee359064380/2, rc 0, transno 21474843422 00000100:00100000:0.0:1762167008.776098:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454482560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167008.776114:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee359064e00/2, rc 0, transno 21474843421 00000100:00100000:0.0:1762167008.776117:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454482432:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167008.776119:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240ce00/2, rc 0, transno 17179875861 00000004:00080000:3.0:1762167008.776124:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242409c00/2, rc 0, transno 21474843420 00000100:00100000:2.0:1762167008.776127:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454480384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.776134:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454482176:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167008.776146:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240c700/2, rc 0, transno 17179875862 00000100:00100000:2.0:1762167008.776153:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454479872:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167008.776155:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242409880/2, rc 0, transno 17179875871 00000100:00100000:3.0:1762167008.776163:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454482304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167008.778871:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.778980:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451902464 00000100:00100000:0.0:1762167008.778990:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451902464 00000100:00100000:0.0:1762167008.779044:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17046 00000100:00100000:0.0:1762167008.779054:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56065:x1847765451902464:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.779069:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.779087:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ba6 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.779115:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d0afac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b28 expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.779124:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.779125:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167008.779128:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.779158:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d0afac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b28 expref: 22 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167008.779171:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d0afac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b28 expref: 22 pid: 6533 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1762167008.779184:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454482688:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167008.779260:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a300 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.780706:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454482688:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.780737:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.780756:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29400, rc 0) 00000100:00100000:0.0:1762167008.780840:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56065:x1847765451902464:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1786us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.780852:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.780858:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17046 00000100:00100000:2.0:1762167008.780908:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451902592 00000100:00100000:2.0:1762167008.780916:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451902592 00010000:00010000:2.0:1762167008.780947:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d0afac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b28 expref: 22 pid: 6533 timeout: 729 lvb_type: 1 00000100:00100000:2.0:1762167008.780979:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7539 00000100:00100000:2.0:1762167008.780987:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451902592:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.781000:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.781024:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d0afac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b28 expref: 22 pid: 6533 timeout: 729 lvb_type: 1 00010000:00010000:2.0:1762167008.781037:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d0afac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b28 expref: 22 pid: 6533 timeout: 729 lvb_type: 1 00010000:00010000:2.0:1762167008.781066:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1400/0xf915a5bdf3d0afac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b28 expref: 22 pid: 6533 timeout: 729 lvb_type: 1 00010000:00010000:2.0:1762167008.781078:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.781080:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.781086:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.781095:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.781125:0:29775:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 21 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.781138:0:29775:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454482816:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167008.781198:0:29775:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360731480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.782505:0:29775:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:29775:1847765454482816:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167008.782522:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.782571:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451902592:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1584us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.782581:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7539 00000100:00100000:1.0:1762167008.794497:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.794585:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451902720 00000100:00100000:0.0:1762167008.794595:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451902720 00002000:00100000:0.0:1762167008.794639:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->45055) req@ffff9ee346aa9880 x1847765451902720/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.794649:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa9880 with x1847765451902720 ext(40960->45055) 00002000:00010000:0.0:1762167008.794655:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aa9880 00000100:00100000:0.0:1762167008.794689:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2990 00000100:00100000:0.0:1762167008.794699:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451902720:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167008.794941:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451902720:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 242us (457us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167008.794950:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2990 00002000:00100000:0.0:1762167008.794958:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->45055) req@ffff9ee346aa9880 x1847765451902720/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/4536 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.794967:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa9880 with x1847765451902720 ext(40960->45055) 00002000:00010000:0.0:1762167008.794970:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aa9880 00000100:00100000:1.0:1762167008.797911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.797972:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451902848 00000100:00100000:0.0:1762167008.797981:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451902848 00002000:00100000:0.0:1762167008.798029:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (16384->81919) req@ffff9ee346aa8a80 x1847765451902848/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 504/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.798040:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa8a80 with x1847765451902848 ext(16384->81919) 00002000:00010000:0.0:1762167008.798046:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aa8a80 00000100:00100000:0.0:1762167008.798080:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2991 00000100:00100000:0.0:1762167008.798090:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451902848:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167008.799721:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451902848:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1624us (1810us total) trans 0 rc 61440/61440 00000100:00100000:0.0:1762167008.799735:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2991 00002000:00100000:0.0:1762167008.799746:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (16384->81919) req@ffff9ee346aa8a80 x1847765451902848/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 504/440 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 61440/61440 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.799756:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa8a80 with x1847765451902848 ext(16384->81919) 00002000:00010000:0.0:1762167008.799787:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aa8a80 00000100:00100000:1.0:1762167008.804428:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.804503:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451902976 00000100:00100000:0.0:1762167008.804515:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451902976 00002000:00100000:0.0:1762167008.804566:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->118783) req@ffff9ee346aab480 x1847765451902976/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.804579:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aab480 with x1847765451902976 ext(81920->118783) 00002000:00010000:0.0:1762167008.804584:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aab480 00000100:00100000:0.0:1762167008.804622:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2992 00000100:00100000:0.0:1762167008.804632:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451902976:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167008.806343:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451902976:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1704us (1917us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1762167008.806356:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2992 00002000:00100000:0.0:1762167008.806368:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->118783) req@ffff9ee346aab480 x1847765451902976/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/440 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 36864/36864 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.806389:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aab480 with x1847765451902976 ext(81920->118783) 00002000:00010000:0.0:1762167008.806396:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aab480 00000100:00100000:3.0:1762167008.808840:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.808886:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451903104 00000100:00100000:0.0:1762167008.808897:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451903104 00002000:00100000:0.0:1762167008.808943:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->94207) req@ffff9ee2443c8a80 x1847765451903104/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.808962:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c8a80 with x1847765451903104 ext(40960->94207) 00002000:00010000:0.0:1762167008.808968:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443c8a80 00000100:00100000:0.0:1762167008.809015:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2993 00000100:00100000:0.0:1762167008.809025:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451903104:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:0.0:1762167008.811333:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451903104:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 2300us (2492us total) trans 21474843423 rc 0/0 00000100:00100000:0.0:1762167008.811346:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2993 00002000:00100000:0.0:1762167008.811358:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (40960->94207) req@ffff9ee2443c8a80 x1847765451903104/t21474843423(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/448 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.811369:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c8a80 with x1847765451903104 ext(40960->94207) 00002000:00010000:0.0:1762167008.811392:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443c8a80 00000100:00100000:1.0:1762167008.815143:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.815250:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451903232 00000100:00100000:0.0:1762167008.815267:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451903232 00000100:00100000:0.0:1762167008.815339:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17047 00000100:00100000:0.0:1762167008.815350:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451903232:12345-192.168.203.35@tcp:16:fsx.0 00000100:00100000:1.0:1762167008.831347:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451903232:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 15982us (16198us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.831364:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17047 00000001:00080000:0.0:1762167008.831556:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843423 is committed 00000001:00080000:0.0:1762167008.831586:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843420 is committed 00000001:00080000:0.0:1762167008.831609:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843421 is committed 00000001:00080000:0.0:1762167008.831624:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843422 is committed 00000100:00100000:3.0:1762167008.833550:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.833788:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451903360 00000100:00100000:2.0:1762167008.833798:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451903360 00000100:00100000:2.0:1762167008.833860:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19878 00000100:00100000:2.0:1762167008.833871:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451903360:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167008.833902:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.833921:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b0d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bad expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.834002:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.834016:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.834026:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167008.834051:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00000004:00200000:2.0:1762167008.834055:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167008.834072:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167008.834093:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b0d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bad expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.834110:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bad expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.834118:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167008.834120:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167008.834124:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00000100:00100000:2.0:1762167008.834189:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451903360:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 315us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.834197:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19878 00000100:00100000:3.0:1762167008.837953:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.838054:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451903488 00000100:00100000:0.0:1762167008.838065:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451903488 00002000:00100000:0.0:1762167008.838114:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (118784->135167) req@ffff9ee37f797b80 x1847765451903488/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/0 e 0 to 0 dl 1762167019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.838126:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f797b80 with x1847765451903488 ext(118784->135167) 00002000:00010000:0.0:1762167008.838132:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f797b80 00000100:00100000:0.0:1762167008.838170:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2994 00000100:00100000:0.0:1762167008.838181:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451903488:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167008.838497:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451903488:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 317us (552us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1762167008.838505:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2994 00002000:00100000:0.0:1762167008.838513:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (118784->135167) req@ffff9ee37f797b80 x1847765451903488/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:39/0 lens 488/16824 e 0 to 0 dl 1762167019 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167008.838521:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f797b80 with x1847765451903488 ext(118784->135167) 00002000:00010000:0.0:1762167008.838525:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f797b80 00000100:00100000:1.0:1762167008.841838:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.841948:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451903744 00000100:00100000:2.0:1762167008.841961:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451903744 00000100:00100000:2.0:1762167008.842023:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7354 00000100:00100000:2.0:1762167008.842033:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451903744:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167008.842329:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451903744:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 297us (500us total) trans 8589952973 rc 0/0 00000100:00100000:2.0:1762167008.842337:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7354 00000100:00100000:3.0:1762167008.852623:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.852712:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904000 00000100:00100000:0.0:1762167008.852722:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904000 00000100:00100000:0.0:1762167008.852809:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19879 00000100:00100000:0.0:1762167008.852821:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56211:x1847765451904000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.852846:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.852865:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b0e7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bb4 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.852941:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b0ee lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.852954:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b0ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.852965:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b0ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.852984:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b0f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.852992:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.852998:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853121:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b0fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853127:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b0fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853132:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b0fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.853140:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00010000:00010000:0.0:1762167008.853211:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b0ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853216:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b0ee lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853220:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b0ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853223:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.853226:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b0ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853231:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b0ee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853239:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167008.853243:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.853247:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b0ee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853253:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b0ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853266:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853272:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b0f5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853277:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853282:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.853285:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853290:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b0f5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853296:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167008.853299:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.853301:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b0f5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853306:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b0f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.853358:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b0e7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bb4 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.853387:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b0fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bb4 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.853395:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167008.853397:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.853400:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d200, rc 0) 00000100:00100000:0.0:1762167008.853476:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56211:x1847765451904000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 657us (862us total) trans 8589952974 rc 0/0 00000100:00100000:0.0:1762167008.853483:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19879 00000100:00100000:3.0:1762167008.855723:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.855799:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904128 00000100:00100000:2.0:1762167008.855810:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904128 00000100:00100000:2.0:1762167008.855872:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 652 00000100:00100000:2.0:1762167008.855883:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451904128:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.855923:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.855946:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b0fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bb4 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.855964:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167008.855969:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.856022:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2360:x1847765451904128:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 142us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.856030:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 652 00000100:00100000:1.0:1762167008.856494:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.856694:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904384 00000100:00100000:2.0:1762167008.856699:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904384 00000100:00100000:2.0:1762167008.856738:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7355 00000100:00100000:2.0:1762167008.856747:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242a6c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56211:x1847765451904384:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167008.856990:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242a6c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56211:x1847765451904384:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 244us (497us total) trans 8589952975 rc 0/0 00000100:00100000:2.0:1762167008.856998:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7355 00000100:00100000:0.0:1762167008.859205:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.859320:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904640 00000100:00100000:3.0:1762167008.859328:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904640 00000100:00100000:3.0:1762167008.859392:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19880 00000100:00100000:3.0:1762167008.859403:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56211:x1847765451904640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167008.859423:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.859441:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b10a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bbb expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.859577:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b111 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.859592:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b111 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167008.859603:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b111 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167008.859613:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00010000:00010000:3.0:1762167008.859742:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b10a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bbb expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.859759:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b111 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bbb expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.859796:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:3.0:1762167008.859799:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167008.859803:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000100:00100000:3.0:1762167008.859851:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56211:x1847765451904640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 450us (653us total) trans 8589952976 rc 0/0 00000100:00100000:3.0:1762167008.859858:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19880 00000100:00100000:3.0:1762167008.862383:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.862507:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451904896 00000100:00100000:0.0:1762167008.862515:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451904896 00000100:00100000:0.0:1762167008.862568:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19881 00000100:00100000:0.0:1762167008.862578:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56211:x1847765451904896:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.862599:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.862616:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b11f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bc2 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.862702:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b126 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.862717:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bad expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.862725:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b126 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.862756:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bad expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.862809:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bad expref: 897 pid: 30817 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167008.862823:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454482944:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167008.862900:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.864722:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454482944:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.864758:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b126 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.864821:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.864865:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451905024 00000100:00100000:2.0:1762167008.864872:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451905024 00010000:00010000:2.0:1762167008.864898:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bad expref: 898 pid: 30817 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.864938:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7540 00000100:00100000:2.0:1762167008.864946:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451905024:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.864959:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.864965:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bad expref: 898 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.864977:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bad expref: 898 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.865010:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b0e0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bad expref: 898 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.865024:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167008.865028:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b126 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.865057:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b126 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.865064:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b126 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.865096:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.865150:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451905024:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 204us (331us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167008.865159:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b126 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167008.865164:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7540 00010000:00010000:0.0:1762167008.865173:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b126 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.865200:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00010000:00010000:0.0:1762167008.865357:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b11f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bc2 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.865389:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b126 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bc2 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.865981:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167008.865984:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167008.865987:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30da00, rc 0) 00000100:00100000:0.0:1762167008.866049:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56211:x1847765451904896:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3472us (3686us total) trans 8589952977 rc 0/0 00000100:00100000:0.0:1762167008.866065:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19881 00000100:00100000:3.0:1762167008.867638:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.867725:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451905152 00000100:00100000:2.0:1762167008.867734:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451905152 00000100:00100000:2.0:1762167008.867812:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7356 00000100:00100000:2.0:1762167008.867824:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56211:x1847765451905152:12345-192.168.203.35@tcp:33:lfs.0 00000100:00100000:2.0:1762167008.868176:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56211:x1847765451905152:12345-192.168.203.35@tcp:33:lfs.0 Request processed in 354us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.868185:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7356 00000100:00100000:1.0:1762167008.870126:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.870205:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451905408 00000100:00100000:2.0:1762167008.870212:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451905408 00000100:00100000:2.0:1762167008.870256:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7357 00000100:00100000:2.0:1762167008.870265:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56211:x1847765451905408:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167008.870491:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56211:x1847765451905408:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 226us (371us total) trans 8589952978 rc 0/0 00000100:00100000:2.0:1762167008.870499:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7357 00000100:00100000:3.0:1762167008.871945:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.871990:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451905664 00000100:00100000:0.0:1762167008.871997:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451905664 00000100:00100000:0.0:1762167008.872049:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19882 00000100:00100000:0.0:1762167008.872058:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56211:x1847765451905664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.872075:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.872078:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762167008.872102:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b126 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bc2 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.872124:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b111 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bbb expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.872225:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167008.872232:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.872246:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b134 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bc9 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.872325:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b13b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.872337:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b13b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.872346:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b13b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.872357:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00010000:00010000:0.0:1762167008.872483:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b134 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bc9 expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.872498:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b13b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bc9 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.872505:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167008.872507:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167008.872510:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167008.872561:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56211:x1847765451905664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 504us (620us total) trans 8589952979 rc 0/0 00000100:00100000:0.0:1762167008.872568:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19882 00000100:00100000:3.0:1762167008.874040:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.874079:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451905920 00000100:00100000:2.0:1762167008.874088:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451905920 00000100:00100000:2.0:1762167008.874131:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7358 00000100:00100000:2.0:1762167008.874141:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56211:x1847765451905920:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167008.874202:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b13b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bc9 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.874232:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.874244:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b9f expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.874253:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.874285:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b9f expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.874299:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b9f expref: 898 pid: 30817 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.874313:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454483072:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.874404:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2000 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.875909:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454483072:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.875935:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167008.876235:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.876453:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451906048 00000100:00100000:2.0:1762167008.876460:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451906048 00010000:00010000:2.0:1762167008.876496:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b9f expref: 899 pid: 30817 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.876536:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7541 00000100:00100000:2.0:1762167008.876545:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765451906048:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.876559:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.876566:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b9f expref: 899 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.876576:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b9f expref: 899 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.876596:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b0cb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b9f expref: 899 pid: 30817 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.876612:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167008.876617:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.876625:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.876632:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.876662:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.876712:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765451906048:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 167us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.876721:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7541 00010000:00010000:3.0:1762167008.877154:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.877164:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.877563:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.877571:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.877577:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.877583:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167008.877587:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.877594:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.877605:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:3.0:1762167008.877608:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762167008.877612:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.877618:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b149 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.877628:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:3.0:1762167008.877631:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167008.877636:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b13b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bc9 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167008.877813:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56211:x1847765451905920:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 3673us (3777us total) trans 8589952980 rc -22/-22 00000100:00100000:3.0:1762167008.877824:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7358 00000100:00100000:3.0:1762167008.879511:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.879598:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451906176 00000100:00100000:0.0:1762167008.879606:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451906176 00000100:00100000:0.0:1762167008.879666:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19883 00000100:00100000:0.0:1762167008.879676:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56211:x1847765451906176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.879699:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.879723:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b150 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bd0 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.879832:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b150 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd0 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.879847:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b150 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd0 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.879874:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167008.879877:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167008.879880:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c200, rc 0) 00000100:00100000:0.0:1762167008.879926:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56211:x1847765451906176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 252us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.879933:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19883 00000100:00100000:1.0:1762167008.882068:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.882212:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451906432 00000100:00100000:0.0:1762167008.882220:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451906432 00000100:00100000:0.0:1762167008.882272:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19884 00000100:00100000:0.0:1762167008.882282:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56211:x1847765451906432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.882301:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.882319:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b157 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bd7 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.882914:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.882929:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.882940:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.882950:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64e:0x0]: returning size 0 00010000:00010000:0.0:1762167008.882996:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b157 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd7 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.883015:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd7 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.883023:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64e:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167008.883026:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.883029:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c600, rc 0) 00000100:00100000:0.0:1762167008.883098:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56211:x1847765451906432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 817us (1037us total) trans 8589952981 rc 0/0 00000100:00100000:0.0:1762167008.883106:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19884 00000100:00100000:3.0:1762167008.887177:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.887234:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451906688 00000100:00100000:0.0:1762167008.887244:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451906688 00000100:00100000:0.0:1762167008.887309:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19885 00000100:00100000:0.0:1762167008.887319:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56211:x1847765451906688:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.887345:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.887381:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b16c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bde expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.887482:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b173 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.887494:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b173 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.887504:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b173 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.887517:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 0 00010000:00010000:0.0:1762167008.887652:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b16c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bde expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.887672:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b173 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bde expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.887680:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167008.887682:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167008.887686:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167008.887750:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56211:x1847765451906688:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 432us (584us total) trans 8589952982 rc 0/0 00000100:00100000:0.0:1762167008.887758:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19885 00000100:00100000:3.0:1762167008.891801:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.891925:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451906944 00000100:00100000:2.0:1762167008.891936:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451906944 00000100:00100000:2.0:1762167008.891992:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7359 00000100:00100000:2.0:1762167008.892004:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56211:x1847765451906944:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167008.892083:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b173 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bde expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.892123:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.892136:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b150 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd0 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.892150:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.892186:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b150 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd0 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.892199:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b150 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd0 expref: 902 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.892213:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454483200:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.892301:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2000 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.893901:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454483200:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.893926:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167008.894100:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.894150:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907072 00000100:00100000:2.0:1762167008.894158:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907072 00010000:00010000:2.0:1762167008.894189:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b150 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd0 expref: 903 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.894227:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7542 00000100:00100000:2.0:1762167008.894237:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:2361:x1847765451907072:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.894255:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.894262:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b150 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd0 expref: 903 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.894274:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b150 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd0 expref: 903 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.894294:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b150 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd0 expref: 903 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.894309:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167008.894314:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.894322:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.894329:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.894355:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167008.894410:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167008.894411:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2361:x1847765451907072:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 174us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.894426:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7542 00010000:00010000:3.0:1762167008.894436:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.894462:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.894474:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd7 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.894482:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167008.894515:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd7 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.894528:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd7 expref: 901 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:3.0:1762167008.894556:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454483328:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167008.894664:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.896019:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454483328:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.896043:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167008.896266:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.897118:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907200 00000100:00100000:2.0:1762167008.897126:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907200 00010000:00010000:2.0:1762167008.897162:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd7 expref: 902 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.897198:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7543 00000100:00100000:2.0:1762167008.897208:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2361:x1847765451907200:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.897221:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.897227:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd7 expref: 902 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.897244:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd7 expref: 902 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.897265:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b15e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bd7 expref: 902 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.897279:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64e:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:2.0:1762167008.897284:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.897292:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.897299:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.897326:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.897358:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167008.897384:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167008.897390:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:2361:x1847765451907200:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 182us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.897404:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7543 00000100:00100000:0.0:1762167008.898173:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454483456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.898226:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.898265:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a540 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.898444:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454483456 00000100:00100000:1.0:1762167008.898451:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454483456 00000100:00100000:1.0:1762167008.898495:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1762167008.898503:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454483456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.898586:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454483456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.898593:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1762167008.898664:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843422 gen 2 00000004:00080000:0.0:1762167008.898670:0:30820:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843411 committed transno 21474843422 00000004:00080000:0.0:1762167008.898687:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de02d80, transno 21474843412 00000004:00080000:0.0:1762167008.898709:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de00380, transno 21474843413 00000004:00080000:0.0:1762167008.898712:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de00a80, transno 21474843414 00000004:00080000:0.0:1762167008.898715:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03480, transno 21474843415 00000004:00080000:0.0:1762167008.898717:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de02a00, transno 21474843416 00000004:00080000:0.0:1762167008.898720:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de02680, transno 21474843417 00000004:00080000:0.0:1762167008.898722:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03b80, transno 21474843418 00000004:00080000:0.0:1762167008.898724:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03100, transno 21474843419 00000004:00080000:0.0:1762167008.898727:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242409c00, transno 21474843420 00000004:00080000:0.0:1762167008.898730:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee359064e00, transno 21474843421 00000004:00080000:0.0:1762167008.898733:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee359064380, transno 21474843422 00000100:00100000:0.0:1762167008.898739:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454483456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.898820:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454483584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.898846:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.898871:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a540 going to sleep for 11 seconds 00000004:00080000:2.0:1762167008.899122:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 11 done 00000100:00100000:1.0:1762167008.899178:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454483584 00000100:00100000:1.0:1762167008.899184:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454483584 00000100:00100000:1.0:1762167008.899219:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1762167008.899226:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454483584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.899293:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454483584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.899300:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1762167008.899467:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454483584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.899514:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454483712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.899537:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.899642:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2af00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.899686:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454483712 00000100:00100000:3.0:1762167008.899692:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454483712 00000100:00100000:3.0:1762167008.899723:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1762167008.899730:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454483712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.899806:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454483712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.899813:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1762167008.899982:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454483712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.900016:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454483840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.900040:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.900070:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2af00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.900123:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454483840 00000100:00100000:3.0:1762167008.900128:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454483840 00000100:00100000:3.0:1762167008.900163:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1762167008.900170:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454483840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.900231:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454483840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.900238:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1762167008.900279:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454483840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.900321:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454483968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.900344:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.900381:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.900417:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454483968 00000100:00100000:3.0:1762167008.900423:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454483968 00000100:00100000:3.0:1762167008.900448:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1762167008.900455:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454483968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.900510:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454483968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.900517:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1762167008.900611:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454483968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.900649:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee35047c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.900684:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167008.900706:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.900729:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454484096 00000100:00100000:3.0:1762167008.900734:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454484096 00000100:00100000:3.0:1762167008.900786:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1762167008.900794:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454484096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.900848:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454484096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.900855:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:1.0:1762167008.900910:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee35047c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.900948:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.900974:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.901001:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.901050:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454484224 00000100:00100000:3.0:1762167008.901053:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454484224 00000100:00100000:3.0:1762167008.901080:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1762167008.901087:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454484224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.901147:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454484224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 60us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.901153:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:1.0:1762167008.901216:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.901248:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.901269:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.901293:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.901338:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454484352 00000100:00100000:3.0:1762167008.901342:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454484352 00000100:00100000:3.0:1762167008.901381:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1762167008.901389:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454484352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.901444:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454484352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.901451:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:1.0:1762167008.901498:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.901522:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.901537:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.901556:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.901613:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454484480 00000100:00100000:3.0:1762167008.901618:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454484480 00000100:00100000:3.0:1762167008.901642:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1762167008.901648:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454484480:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.901701:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454484480:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.901707:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:1.0:1762167008.901850:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.901882:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.901904:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.901961:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.901987:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454484608 00000100:00100000:3.0:1762167008.901990:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454484608 00000100:00100000:3.0:1762167008.902009:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:3.0:1762167008.902013:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454484608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.902059:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454484608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 40us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.902066:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1762167008.902094:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.902126:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.902146:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.902163:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.902164:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454484736 00000100:00100000:3.0:1762167008.902168:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454484736 00000100:00100000:3.0:1762167008.902199:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1762167008.902205:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454484736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.902263:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454484736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.902272:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1762167008.902333:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.902358:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.902395:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.902417:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.902460:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454484864 00000100:00100000:3.0:1762167008.902464:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454484864 00000100:00100000:3.0:1762167008.902489:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1762167008.902495:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454484864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.902543:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454484864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 45us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.902550:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:1.0:1762167008.902583:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.902613:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.902632:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.902649:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.902651:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454484992 00000100:00100000:3.0:1762167008.902654:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454484992 00000100:00100000:3.0:1762167008.902679:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1762167008.902685:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454484992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.902732:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454484992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 46us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.902738:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1762167008.902794:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454484992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.902825:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.902845:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.902861:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.902865:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454485120 00000100:00100000:3.0:1762167008.902868:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454485120 00000100:00100000:3.0:1762167008.902899:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1762167008.902906:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454485120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.902961:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454485120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 55us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.902968:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1762167008.903052:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.903085:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.903107:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.903130:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.903144:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454485248 00000100:00100000:0.0:1762167008.903148:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454485248 00000100:00100000:0.0:1762167008.903179:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1762167008.903185:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454485248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.903234:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454485248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.903241:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:1.0:1762167008.903246:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.903278:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.903298:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.903315:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.903317:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454485376 00000100:00100000:0.0:1762167008.903320:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454485376 00000100:00100000:0.0:1762167008.903351:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1762167008.903357:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454485376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.903417:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454485376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.903423:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1762167008.903424:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.903456:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.903477:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.903495:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.903619:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454485504 00000100:00100000:3.0:1762167008.903623:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454485504 00000100:00100000:3.0:1762167008.903652:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1762167008.903658:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454485504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.903713:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454485504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.903719:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1762167008.903748:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.903813:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.903836:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.903855:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.903857:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454485632 00000100:00100000:3.0:1762167008.903861:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454485632 00000100:00100000:3.0:1762167008.903887:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1762167008.903894:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454485632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.903940:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454485632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 43us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.903947:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1762167008.904042:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.904074:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.904095:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.904119:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.904157:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454485760 00000100:00100000:3.0:1762167008.904161:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454485760 00000100:00100000:3.0:1762167008.904194:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1762167008.904201:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454485760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.904256:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454485760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.904263:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1762167008.904317:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.904345:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.904367:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.904409:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.904429:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454485888 00000100:00100000:0.0:1762167008.904434:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454485888 00000100:00100000:0.0:1762167008.904464:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1762167008.904472:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454485888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167008.904529:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454485888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.904537:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:1.0:1762167008.904562:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454485888:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:1.0:1762167008.904925:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].55, 1000 off67712 00000001:00080000:1.0:1762167008.904934:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952983 00000100:00100000:1.0:1762167008.905007:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454486016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.905034:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.905056:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.905070:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454486016 00000100:00100000:3.0:1762167008.905076:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454486016 00000100:00100000:3.0:1762167008.905108:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:3.0:1762167008.905115:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454486016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.905361:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454486016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 246us (325us total) trans 21474843424 rc 0/0 00000100:00100000:3.0:1762167008.905368:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1762167008.905426:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454486016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.905452:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454486144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167008.905476:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167008.905503:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.905564:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454486144 00000100:00100000:3.0:1762167008.905568:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454486144 00000100:00100000:3.0:1762167008.905598:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1762167008.905605:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:30820:x1847765454486144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167008.905820:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:30820:x1847765454486144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 215us (342us total) trans 17179875872 rc 0/0 00000100:00100000:3.0:1762167008.905827:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1762167008.906039:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454486144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1762167008.906138:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952984 00010000:00010000:1.0:1762167008.906168:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906178:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906184:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906190:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167008.906194:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906201:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906217:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64e:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:1.0:1762167008.906220:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167008.906224:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906229:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b188 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906249:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906254:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906259:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906264:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167008.906266:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906270:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906277:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167008.906279:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762167008.906281:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906290:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b181 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.906300:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167008.906302:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167008.906308:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b173 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bde expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.906399:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56211:x1847765451906944:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 14397us (14648us total) trans 8589952985 rc 0/0 00000100:00100000:1.0:1762167008.906408:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7359 00000020:00080000:1.0:1762167008.906412:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762167008.908202:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.908290:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907328 00000100:00100000:3.0:1762167008.908299:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907328 00000100:00100000:3.0:1762167008.908356:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19886 00000100:00100000:3.0:1762167008.908364:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56211:x1847765451907328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167008.908390:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167008.908413:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b18f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3be5 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.908476:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b18f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3be5 expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.908490:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b18f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3be5 expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.908509:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167008.908513:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167008.908516:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167008.908573:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56211:x1847765451907328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 209us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167008.908579:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19886 00000100:00100000:3.0:1762167008.910894:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.911064:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907584 00000100:00100000:1.0:1762167008.911073:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907584 00000100:00100000:1.0:1762167008.911121:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7360 00000100:00100000:1.0:1762167008.911130:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56211:x1847765451907584:12345-192.168.203.35@tcp:35:lfs.0 00000004:00080000:1.0:1762167008.911627:0:30820:0:(mdd_object.c:3965:mdd_close()) Object [0x200000404:0x64e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762167008.911731:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5502, 64 off444808 00000004:00080000:1.0:1762167008.911741:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629703978404ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167008.911801:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5494, 64 off443752 00000004:00080000:1.0:1762167008.911807:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629704044278ns, next at 630704042948ns, rc = 0 00000001:00080000:1.0:1762167008.911813:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952986 00010000:00010000:1.0:1762167008.911871:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.911886:0:30820:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.911898:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.911907:0:30820:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.911915:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.911921:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167008.911943:0:30820:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762167008.911980:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167008.911989:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.911997:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7ae00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167008.912001:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.912008:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.912019:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64e:0x0].0x0 (ffff9ee345a77700) 00010000:00010000:2.0:1762167008.912021:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762167008.912024:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.912028:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b196 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167008.912046:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167008.912047:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167008.912049:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167008.912067:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56211:x1847765451907584:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 936us (1179us total) trans 8589952987 rc 0/0 00000100:00100000:1.0:1762167008.912076:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7360 00000020:00080000:1.0:1762167008.912081:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762167008.913636:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.913730:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907840 00000100:00100000:0.0:1762167008.913739:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907840 00000100:00100000:0.0:1762167008.913828:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7361 00000100:00100000:0.0:1762167008.913840:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56211:x1847765451907840:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167008.914129:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56211:x1847765451907840:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 292us (498us total) trans 8589952988 rc 0/0 00000100:00100000:0.0:1762167008.914142:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7361 00000100:00100000:0.0:1762167008.925618:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.925972:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451907968 00000100:00100000:3.0:1762167008.925985:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451907968 00000100:00100000:2.0:1762167008.926154:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19887 00000100:00100000:2.0:1762167008.926166:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56212:x1847765451907968:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.926190:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.926209:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b19d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bec expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.926271:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1a4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926284:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1a4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926295:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1a4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926309:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926316:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926327:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926441:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926450:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926457:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167008.926490:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:2.0:1762167008.926494:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167008.926510:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926521:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926529:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1a4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926535:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1a4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926541:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926547:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167008.926551:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926557:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1a4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926571:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167008.926574:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167008.926578:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926583:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926594:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926599:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1ab lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926605:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926609:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167008.926611:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926616:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926622:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0f00) 00010000:00010000:2.0:1762167008.926625:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167008.926627:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1ab lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926632:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.926659:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b19d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bec expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.926671:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bec expref: 907 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.926678:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167008.926680:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167008.926682:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167008.927628:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56212:x1847765451907968:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1458us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.927638:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19887 00000100:00100000:3.0:1762167008.929864:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.929944:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451908224 00000100:00100000:2.0:1762167008.929954:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451908224 00000100:00100000:2.0:1762167008.930013:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19888 00000100:00100000:2.0:1762167008.930022:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56212:x1847765451908224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.930042:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.930062:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b1b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bf3 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.930161:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b1c0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.930174:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b1c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.930185:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b1c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167008.930195:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:2.0:1762167008.930317:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b1b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bf3 expref: 910 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.930335:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b1c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bf3 expref: 909 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.930343:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167008.930346:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762167008.930349:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:2.0:1762167008.930420:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56212:x1847765451908224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 398us (563us total) trans 8589952989 rc 0/0 00000100:00100000:2.0:1762167008.930428:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19888 00000100:00100000:1.0:1762167008.932361:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.932427:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451908480 00000100:00100000:2.0:1762167008.932435:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451908480 00000100:00100000:2.0:1762167008.932490:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19889 00000100:00100000:2.0:1762167008.932500:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56212:x1847765451908480:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.932524:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.932539:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b1ce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3bfa expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.932616:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1d5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.932630:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.932639:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167008.932651:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:2.0:1762167008.932758:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b1ce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bfa expref: 912 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.932811:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1d5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bfa expref: 911 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.932819:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167008.932822:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167008.932825:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167008.932893:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56212:x1847765451908480:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 393us (535us total) trans 8589952990 rc 0/0 00000100:00100000:2.0:1762167008.932902:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19889 00000100:00100000:0.0:1762167008.934875:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.934957:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451908608 00000100:00100000:2.0:1762167008.934965:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451908608 00000100:00100000:2.0:1762167008.935024:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 653 00000100:00100000:2.0:1762167008.935034:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56212:x1847765451908608:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762167008.935048:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.935069:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b1d5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bfa expref: 911 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.935085:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167008.935090:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.935139:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:56212:x1847765451908608:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 106us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.935147:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 653 00000100:00100000:3.0:1762167008.937446:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.937529:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451908864 00000100:00100000:0.0:1762167008.937539:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451908864 00000100:00100000:0.0:1762167008.937590:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7362 00000100:00100000:0.0:1762167008.937601:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:56212:x1847765451908864:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167008.937847:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56212:x1847765451908864:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 247us (407us total) trans 8589952991 rc 0/0 00000100:00100000:0.0:1762167008.937855:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7362 00000100:00100000:1.0:1762167008.941327:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.941426:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451909120 00000100:00100000:2.0:1762167008.941437:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451909120 00000100:00100000:2.0:1762167008.941495:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19890 00000100:00100000:2.0:1762167008.941505:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+911:56065:x1847765451909120:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167008.941528:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.941547:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b1e3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c01 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.941647:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.941673:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bec expref: 912 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.941681:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.941712:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bec expref: 912 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.941723:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bec expref: 912 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.941736:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454486272:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.941839:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.943411:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454486272:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.943436:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167008.943900:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.943960:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451909248 00000100:00100000:2.0:1762167008.943967:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451909248 00010000:00010000:2.0:1762167008.943998:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bec expref: 913 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.944041:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7544 00000100:00100000:2.0:1762167008.944051:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:2361:x1847765451909248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.944066:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.944073:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bec expref: 913 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.944085:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bec expref: 913 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.944107:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b1b2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bec expref: 913 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.944123:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167008.944128:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.944136:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.944143:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.944174:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.944224:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:2361:x1847765451909248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.944232:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7544 00010000:00010000:0.0:1762167008.944239:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.944249:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.944266:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:0.0:1762167008.944433:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b1e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c01 expref: 913 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.944449:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c01 expref: 912 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.944457:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167008.944460:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167008.944463:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:0.0:1762167008.944515:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56065:x1847765451909120:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 3011us (3196us total) trans 8589952992 rc 0/0 00000100:00100000:0.0:1762167008.944522:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19890 00000100:00100000:1.0:1762167008.945987:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.946060:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451909376 00000100:00100000:0.0:1762167008.946067:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451909376 00000100:00100000:0.0:1762167008.946119:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19891 00000100:00100000:0.0:1762167008.946126:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56065:x1847765451909376:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167008.946146:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.946163:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b1f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c08 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.946232:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.946243:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c01 expref: 913 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.946248:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.946273:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c01 expref: 913 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.946281:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c01 expref: 913 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167008.946291:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454486400:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167008.946358:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a300 going to sleep for 11 seconds 00000100:00100000:0.0:1762167008.947698:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454486400:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167008.947724:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167008.949130:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.949182:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451909504 00000100:00100000:2.0:1762167008.949190:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451909504 00010000:00010000:2.0:1762167008.949226:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c01 expref: 914 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.949277:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7545 00000100:00100000:2.0:1762167008.949286:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:2360:x1847765451909504:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.949300:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.949306:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c01 expref: 914 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.949318:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c01 expref: 914 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.949342:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b1ea lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c01 expref: 914 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.949356:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167008.949361:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.949382:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.949390:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.949419:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.949443:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.949454:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167008.949481:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:2360:x1847765451909504:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 195us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.949491:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7545 00000004:00200000:0.0:1762167008.949500:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:0.0:1762167008.949505:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.949526:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.949556:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b1f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c08 expref: 913 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.949572:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c08 expref: 912 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.949580:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167008.949583:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.949586:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d200, rc 0) 00000100:00100000:0.0:1762167008.949625:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56065:x1847765451909376:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 3498us (3647us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.949633:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19891 00000100:00100000:1.0:1762167008.953643:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.953806:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451909760 00000100:00100000:3.0:1762167008.953815:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451909760 00000100:00100000:3.0:1762167008.953867:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7363 00000100:00100000:3.0:1762167008.953878:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:56065:x1847765451909760:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:3.0:1762167008.954143:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56065:x1847765451909760:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 265us (506us total) trans 8589952993 rc 0/0 00000100:00100000:3.0:1762167008.954151:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7363 00000100:00100000:1.0:1762167008.963833:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167008.963869:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451909888 00000100:00100000:0.0:1762167008.963879:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451909888 00000100:00100000:0.0:1762167008.963937:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19892 00000100:00100000:0.0:1762167008.963948:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56213:x1847765451909888:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167008.963971:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167008.963990:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b206 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c0f expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.964057:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b20d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964070:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b20d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964081:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b20d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964095:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b214 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964102:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b214 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964108:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b214 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964204:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b21b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964213:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b21b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964220:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b21b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167008.964251:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:0.0:1762167008.964256:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167008.964272:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b21b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964282:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b21b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964290:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b20d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964295:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b20d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964299:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b20d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964303:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.964305:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b20d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964311:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b20d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964318:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167008.964320:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.964323:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b20d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964328:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b20d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964341:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b214 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964347:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b214 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964352:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b214 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964357:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167008.964360:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b214 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964365:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b214 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964386:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167008.964388:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167008.964391:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b214 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964396:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b214 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167008.964423:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b206 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c0f expref: 915 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.964436:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b21b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c0f expref: 914 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.964443:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167008.964445:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167008.964447:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167008.964503:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56213:x1847765451909888:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 557us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167008.964510:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19892 00000100:00100000:1.0:1762167008.966314:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.966584:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451910016 00000100:00100000:2.0:1762167008.966593:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451910016 00000100:00100000:2.0:1762167008.966661:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 654 00000100:00100000:2.0:1762167008.966672:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:2360:x1847765451910016:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.966687:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.966709:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b21b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c0f expref: 914 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.966726:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167008.966731:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.966809:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:2360:x1847765451910016:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 139us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.966817:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 654 00000100:00100000:3.0:1762167008.966920:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.966959:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451910272 00000100:00100000:2.0:1762167008.966964:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451910272 00000100:00100000:2.0:1762167008.967007:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19893 00000100:00100000:2.0:1762167008.967016:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+913:56213:x1847765451910272:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167008.967034:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167008.967048:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b222 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c16 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.967128:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.967137:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c08 expref: 914 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.967143:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.967168:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c08 expref: 914 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.967177:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c08 expref: 914 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.967186:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454486528:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.967247:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2000 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.968303:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454486528:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.968321:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167008.968630:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.968701:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451910400 00000100:00100000:2.0:1762167008.968707:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451910400 00010000:00010000:2.0:1762167008.968731:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c08 expref: 915 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.968794:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7546 00000100:00100000:2.0:1762167008.968803:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:2360:x1847765451910400:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.968814:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.968821:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c08 expref: 915 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.968831:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c08 expref: 915 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.968848:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b1ff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c08 expref: 915 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.968862:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167008.968866:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.968875:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.968881:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.968897:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167008.968933:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:2360:x1847765451910400:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 131us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.968941:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7546 00010000:00010000:1.0:1762167008.969351:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.969361:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167008.969391:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:1.0:1762167008.969533:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b222 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c16 expref: 915 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.969549:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c16 expref: 914 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.969557:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167008.969559:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762167008.969562:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:1.0:1762167008.969600:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56213:x1847765451910272:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2586us (2680us total) trans 8589952994 rc 0/0 00000100:00100000:1.0:1762167008.969607:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19893 00000100:00100000:2.0:1762167008.971249:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.971325:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451910528 00000100:00100000:1.0:1762167008.971333:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451910528 00000100:00100000:1.0:1762167008.971394:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19894 00000100:00100000:1.0:1762167008.971405:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56213:x1847765451910528:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167008.971426:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167008.971442:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b237 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c1d expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.971516:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.971530:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c16 expref: 915 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.971538:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.971576:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c16 expref: 915 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.971588:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c16 expref: 915 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1762167008.971602:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454486656:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.971678:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.973002:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454486656:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167008.973029:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167008.973056:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.973165:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451910656 00000100:00100000:2.0:1762167008.973176:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451910656 00010000:00010000:2.0:1762167008.973222:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c16 expref: 916 pid: 30819 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.973272:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7547 00000100:00100000:2.0:1762167008.973283:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:2360:x1847765451910656:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167008.973300:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167008.973309:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c16 expref: 916 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.973323:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c16 expref: 916 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.973353:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b229 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c16 expref: 916 pid: 30819 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167008.973382:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167008.973388:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.973399:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.973408:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167008.973445:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167008.973482:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.973494:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167008.973515:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:2360:x1847765451910656:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 232us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.973525:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7547 00000004:00200000:1.0:1762167008.973563:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:1.0:1762167008.973569:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167008.973594:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.973632:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b237 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c1d expref: 915 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.973652:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c1d expref: 914 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.973667:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167008.973670:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167008.973679:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a600, rc 0) 00000100:00100000:1.0:1762167008.973731:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56213:x1847765451910528:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2329us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.973739:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19894 00000100:00100000:3.0:1762167008.976154:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.976240:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451910912 00000100:00100000:2.0:1762167008.976246:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451910912 00000100:00100000:2.0:1762167008.976292:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7364 00000100:00100000:2.0:1762167008.976298:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:56213:x1847765451910912:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167008.976503:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56213:x1847765451910912:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 204us (354us total) trans 8589952995 rc 0/0 00000100:00100000:2.0:1762167008.976511:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7364 00000100:00100000:0.0:1762167008.977856:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.977914:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451911168 00000100:00100000:1.0:1762167008.977928:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451911168 00000100:00100000:1.0:1762167008.978037:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19895 00000100:00100000:1.0:1762167008.978048:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+915:56213:x1847765451911168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167008.978075:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167008.978079:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762167008.978107:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b1c0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3bf3 expref: 915 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.978127:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167008.978133:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167008.978147:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b245 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c24 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.978259:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b24c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.978273:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b24c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.978282:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b24c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167008.978295:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:1.0:1762167008.978455:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b245 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c24 expref: 917 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.978472:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b24c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c24 expref: 916 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.978480:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167008.978482:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167008.978484:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a000, rc 0) 00000100:00100000:1.0:1762167008.978556:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56213:x1847765451911168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 509us (705us total) trans 8589952996 rc 0/0 00000100:00100000:1.0:1762167008.978563:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19895 00000100:00100000:3.0:1762167008.979907:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167008.979937:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.979968:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451911296 00000100:00100000:1.0:1762167008.979978:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451911296 00000100:00100000:3.0:1762167008.979994:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.980019:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451911424 00000100:00100000:2.0:1762167008.980028:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451911424 00000100:00100000:1.0:1762167008.980038:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451911552 00000100:00100000:1.0:1762167008.980045:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451911552 00000100:00100000:2.0:1762167008.980080:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17048 00000100:00100000:2.0:1762167008.980097:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451911296:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167008.980101:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17049 00000100:00100000:1.0:1762167008.980118:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17050 00000100:00100000:3.0:1762167008.980123:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:2361:x1847765451911424:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167008.980139:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451911552:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167008.980146:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.980170:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 19 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.980172:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.980174:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.980213:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167008.980221:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167008.980228:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.980231:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0afba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b2f expref: 42 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167008.980235:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0afb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b36 expref: 19 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167008.980287:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.980287:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.980294:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.980295:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.980303:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.980310:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.980330:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 19 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.980336:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0afb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b36 expref: 19 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167008.980354:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 19 pid: 12402 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167008.980355:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0afb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b36 expref: 19 pid: 6535 timeout: 729 lvb_type: 1 00010000:00010000:3.0:1762167008.980381:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0afba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b2f expref: 42 pid: 6535 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167008.980402:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454486912:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.980405:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454486784:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167008.980428:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0afba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b2f expref: 42 pid: 6535 timeout: 729 lvb_type: 1 00000100:00100000:3.0:1762167008.980443:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454487040:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167008.980527:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167008.980530:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720f00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167008.980540:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167008.982568:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454486784:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.982603:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454486912:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167008.982604:0:33894:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167008.982617:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167008.982647:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.982675:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451911808 00000100:00100000:3.0:1762167008.982677:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167008.982688:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451911808 00000100:00100000:0.0:1762167008.982695:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454487040:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167008.982729:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451911680 00010000:00010000:0.0:1762167008.982732:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.982741:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0afb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b36 expref: 20 pid: 6535 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1762167008.982742:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451911680 00000100:00100000:3.0:1762167008.982749:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167008.982822:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 21 pid: 12402 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.982834:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451911936 00000100:00100000:2.0:1762167008.982842:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451911936 00000100:00100000:3.0:1762167008.982858:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7548 00010000:00010000:2.0:1762167008.982867:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0afba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b2f expref: 43 pid: 6535 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1762167008.982874:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7549 00000100:00100000:3.0:1762167008.982876:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451911808:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762167008.982892:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451911680:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167008.982904:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.982907:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1762167008.982927:0:5741:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00010000:00010000:3.0:1762167008.982931:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0afb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b36 expref: 21 pid: 6535 timeout: 729 lvb_type: 1 00002000:00010000:1.0:1762167008.982931:0:5741:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167008.982934:0:5741:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 185 -> 187 00010000:00010000:1.0:1762167008.982940:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 21 pid: 12402 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.982945:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0afb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b36 expref: 21 pid: 6535 timeout: 729 lvb_type: 1 00000100:00100000:2.0:1762167008.982948:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7550 00010000:00010000:1.0:1762167008.982968:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 21 pid: 12402 timeout: 729 lvb_type: 0 00000100:00100000:2.0:1762167008.982976:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+43:2359:x1847765451911936:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167008.982989:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0afb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b36 expref: 21 pid: 6535 timeout: 729 lvb_type: 1 00010000:00010000:2.0:1762167008.983004:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167008.983005:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b0d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ba6 expref: 20 pid: 12402 timeout: 729 lvb_type: 0 00010000:00010000:3.0:1762167008.983008:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.983013:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167008.983018:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.983019:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.983022:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167008.983025:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.983028:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983037:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0afba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b2f expref: 43 pid: 6535 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.983038:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167008.983064:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167008.983082:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0afba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b2f expref: 43 pid: 6535 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1762167008.983089:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167008.983118:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451911808:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 246us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.983118:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451911680:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 232us (444us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167008.983123:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0afba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b2f expref: 43 pid: 6535 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1762167008.983141:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7549 00010000:00010000:0.0:1762167008.983141:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983150:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167008.983159:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762167008.983162:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7548 00010000:00010000:2.0:1762167008.983168:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.983178:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983182:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.983203:0:33894:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.983215:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.983221:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983226:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167008.983236:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.983247:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.983248:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.983270:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7bc00 already unused, calling callback (ffffffffc1709320) 00000100:00100000:2.0:1762167008.983274:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+42:2359:x1847765451911936:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 307us (536us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167008.983279:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.983294:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167008.983301:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7550 00010000:00010000:0.0:1762167008.983302:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.983339:0:33894:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983343:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.983346:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.983367:0:33894:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167008.983387:0:33894:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167008.983390:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b268 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983391:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.983437:0:33894:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983448:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.983458:0:33894:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983459:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983496:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.983497:0:33894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b25a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.983510:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451911552:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3374us (3511us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167008.983534:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167008.983545:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167008.983549:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17050 00010000:00010000:2.0:1762167008.983560:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983578:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167008.983592:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b261 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167008.983610:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451911296:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3515us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167008.983619:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17048 00000100:00100000:2.0:1762167008.983648:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2361:x1847765451911424:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3530us (3707us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167008.983657:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17049 00000100:00100000:3.0:1762167008.985481:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167008.985549:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912192 00000100:00100000:1.0:1762167008.985558:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912192 00000100:00100000:1.0:1762167008.985610:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19896 00000100:00100000:1.0:1762167008.985620:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:56213:x1847765451912192:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167008.985669:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762167008.985690:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b23e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c1d expref: 916 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.985712:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b18f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3be5 expref: 915 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167008.985722:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167008.985726:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167008.985821:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.985834:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167008.985842:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:1.0:1762167008.986363:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5495, 88 off443840 00000004:00080000:1.0:1762167008.986382:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629778618940ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167008.986425:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5503, 88 off444896 00000004:00080000:1.0:1762167008.986431:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629778668147ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167008.986479:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5504, 88 off444984 00000004:00080000:1.0:1762167008.986491:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629778727890ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167008.986526:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5496, 88 off443928 00000004:00080000:1.0:1762167008.986532:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629778768997ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167008.986565:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5505, 88 off445072 00000004:00080000:1.0:1762167008.986568:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629778805765ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167008.986585:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5497, 88 off444016 00000004:00080000:1.0:1762167008.986588:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629778825155ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167008.986598:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5498, 88 off444104 00000004:00080000:1.0:1762167008.986600:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629778837945ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167008.986608:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5506, 88 off445160 00000004:00080000:1.0:1762167008.986611:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629778848343ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167008.986624:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5507, 88 off445248 00000004:00080000:1.0:1762167008.986626:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629778863293ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167008.986635:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5499, 88 off444192 00000004:00080000:1.0:1762167008.986638:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629778875462ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167008.986646:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5508, 88 off445336 00000004:00080000:1.0:1762167008.986648:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629778885744ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167008.986663:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5500, 88 off444280 00000004:00080000:1.0:1762167008.986670:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629778906864ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167008.986686:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5501, 88 off444368 00000004:00080000:1.0:1762167008.986690:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629778927477ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167008.986707:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5509, 88 off445424 00000004:00080000:1.0:1762167008.986711:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629778948174ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167008.986740:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5502, 88 off444456 00000004:00080000:1.0:1762167008.986745:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629778981959ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167008.986785:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5510, 88 off445512 00000004:00080000:1.0:1762167008.986790:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629779027313ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167008.986817:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5511, 88 off445600 00000004:00080000:1.0:1762167008.986821:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629779058835ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167008.986846:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5503, 88 off444544 00000004:00080000:1.0:1762167008.986851:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629779087929ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167008.986883:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5504, 88 off444632 00000004:00080000:1.0:1762167008.986887:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 629779124603ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167008.986905:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5512, 88 off445688 00000004:00080000:1.0:1762167008.986909:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 629779146035ns, next at 630703976179ns, rc = 0 00000001:00080000:2.0:1762167009.003884:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952992 is committed 00000004:00010000:1.0:1762167009.003907:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e49c0e75 reply state 000000007c6aac51 transno 8589952997 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167009.003916:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952997 is committed 00000100:00100000:1.0:1762167009.003923:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:2.0:1762167009.003924:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3624 committed 00000004:00080000:2.0:1762167009.003939:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3611 committed 00000004:00080000:2.0:1762167009.003950:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3610 committed 00000004:00080000:2.0:1762167009.003953:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3623 committed 00000004:00080000:2.0:1762167009.003955:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3622 committed 00000004:00080000:2.0:1762167009.003957:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3609 committed 00000004:00080000:2.0:1762167009.003960:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3621 committed 00000004:00080000:2.0:1762167009.003963:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3608 committed 00000004:00080000:2.0:1762167009.003965:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3607 committed 00000004:00080000:2.0:1762167009.003967:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3620 committed 00000004:00080000:2.0:1762167009.003972:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3606 committed 00000004:00080000:2.0:1762167009.003975:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3619 committed 00000004:00080000:2.0:1762167009.003978:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3618 committed 00000004:00080000:2.0:1762167009.003981:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3605 committed 00000004:00080000:2.0:1762167009.003984:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3604 committed 00000004:00080000:2.0:1762167009.003987:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3617 committed 00000004:00080000:2.0:1762167009.003990:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3603 committed 00000004:00080000:2.0:1762167009.003993:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3616 committed 00000004:00080000:2.0:1762167009.003995:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3615 committed 00000004:00080000:2.0:1762167009.003999:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3602 committed 00000004:00080000:2.0:1762167009.004011:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3601 committed 00000004:00080000:2.0:1762167009.004014:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3614 committed 00000020:00080000:2.0:1762167009.004028:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee36de2a540 refcount 2 committed 0 result 0 batchid 4294969186 00000020:00080000:2.0:1762167009.004032:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee243949f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36de2a180 00000020:00080000:2.0:1762167009.004034:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee243949800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee36de2a0c0 00000020:00080000:2.0:1762167009.004037:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee242555e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee243432000 00000020:00080000:2.0:1762167009.004039:0:30849:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].55 00000020:00080000:2.0:1762167009.004084:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969185 batchid updated 00010000:00080000:1.0:1762167009.004123:0:30819:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762167009.004185:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56213:x1847765451912192:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 18549us (18692us total) trans 8589952997 rc 0/0 00010000:00010000:2.0:1762167009.004187:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.004200:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167009.004202:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19896 00000100:00100000:0.0:1762167009.004208:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454487552:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167009.004211:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.004218:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.004222:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.004227:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454487296:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762167009.004229:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167009.004238:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454487168:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762167009.004253:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167009.004258:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167009.004263:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167009.004271:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167009.004275:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b26f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000020:00080000:3.0:1762167009.004281:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969186 committed batchid 4294969185 00000100:00100000:1.0:1762167009.004308:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.004315:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454487936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.004336:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454487552 00000100:00100000:1.0:1762167009.004341:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454487680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.004345:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454487552 00000100:00100000:0.0:1762167009.004350:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.004389:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454488576:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.004402:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454487168 00000100:00100000:2.0:1762167009.004407:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454487168 00000100:00100000:0.0:1762167009.004420:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.004445:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454487936 00000100:00100000:2.0:1762167009.004448:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454487936 00000100:00100000:1.0:1762167009.004456:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454488576 00000100:00100000:1.0:1762167009.004471:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454488576 00000100:00100000:0.0:1762167009.004473:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454489088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.004480:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17051 00000100:00100000:2.0:1762167009.004492:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3296:x1847765454487552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.004505:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.004520:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454489088 00000100:00100000:0.0:1762167009.004535:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1762167009.004540:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454489088 00000100:00100000:0.0:1762167009.004552:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454487424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.004589:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17052 00000100:00100000:0.0:1762167009.004589:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.004601:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3293:x1847765454487168:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.004608:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454488064:0@lo:2:osp-syn-1-0.0 00002000:00080000:1.0:1762167009.004625:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2078 count 1 00000100:00100000:0.0:1762167009.004635:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.004647:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454488448:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762167009.004653:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.004673:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae9b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab1 expref: 40 pid: 12402 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167009.004675:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762167009.004683:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.004685:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.004694:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.004694:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454488960:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167009.004699:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000020:00080000:3.0:1762167009.004705:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969185 cancel update log [0x200000bd0:0x1:0x0].54: rc = 0 00002000:00010000:2.0:1762167009.004708:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167009.004715:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167009.004717:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000020:00080000:3.0:1762167009.004719:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969185 00000100:00100000:0.0:1762167009.004724:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167009.004725:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00010000:00010000:1.0:1762167009.004733:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab1 expref: 40 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.004752:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab1 expref: 40 pid: 12402 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1762167009.004790:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454489216:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.004795:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454487424 00000100:00100000:0.0:1762167009.004800:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454487424 00000100:00100000:0.0:1762167009.004823:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454488064 00000100:00100000:2.0:1762167009.004825:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3296:x1847765454487552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 334us (555us total) trans 17179875873 rc 0/0 00000100:00100000:0.0:1762167009.004827:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454488064 00000100:00100000:2.0:1762167009.004837:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17051 00000100:00100000:0.0:1762167009.004864:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454488448 00000100:00100000:2.0:1762167009.004866:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454488960 00000100:00100000:0.0:1762167009.004869:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454488448 00000100:00100000:2.0:1762167009.004872:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454488960 00000100:00100000:1.0:1762167009.004881:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e780 going to sleep for 11 seconds 00000100:00100000:3.0:1762167009.004902:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17053 00000100:00100000:0.0:1762167009.004910:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17054 00000100:00100000:3.0:1762167009.004914:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454487936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.004922:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17055 00000100:00100000:0.0:1762167009.004926:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454488576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.004935:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454489088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.004947:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17056 00000100:00100000:1.0:1762167009.004972:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454487424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.005107:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454488576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 187us (685us total) trans 21474843425 rc 0/0 00000100:00100000:0.0:1762167009.005115:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17054 00000100:00100000:0.0:1762167009.005130:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17057 00000100:00100000:2.0:1762167009.005138:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454489088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (631us total) trans 21474843426 rc 0/0 00000100:00100000:0.0:1762167009.005141:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3296:x1847765454488064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.005153:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17055 00000100:00100000:2.0:1762167009.005174:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17058 00000100:00100000:2.0:1762167009.005183:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3296:x1847765454488448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.005217:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454487936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 306us (867us total) trans 21474843427 rc 0/0 00000100:00100000:3.0:1762167009.005225:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17053 00000100:00100000:3.0:1762167009.005245:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17059 00000100:00100000:3.0:1762167009.005254:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454488960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167009.005275:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167009.005278:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.005280:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167009.005282:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.005284:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.005313:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3296:x1847765454488064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (679us total) trans 17179875874 rc 0/0 00000100:00100000:0.0:1762167009.005318:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17057 00000100:00100000:2.0:1762167009.005384:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3296:x1847765454488448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (698us total) trans 17179875875 rc 0/0 00000100:00100000:1.0:1762167009.005387:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454487424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 412us (783us total) trans 21474843428 rc 0/0 00002000:00010000:3.0:1762167009.005390:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167009.005397:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00000100:00100000:2.0:1762167009.005403:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17058 00002000:00010000:3.0:1762167009.005404:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167009.005408:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167009.005410:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167009.005416:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17056 00000100:00100000:3.0:1762167009.005454:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454488960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (722us total) trans 21474843429 rc 0/0 00000100:00100000:3.0:1762167009.005462:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17059 00000100:00100000:1.0:1762167009.005482:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167009.005491:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550c700/2, rc 0, transno 21474843428 00000100:00100000:2.0:1762167009.005505:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454487424:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167009.005520:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317c380/2, rc 0, transno 17179875874 00000100:00100000:2.0:1762167009.005533:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454488064:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.005549:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b02300/2, rc 0, transno 17179875875 00000100:00100000:3.0:1762167009.005550:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.005557:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454488448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.005568:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454488192:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.005574:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550ce00/2, rc 0, transno 21474843429 00000100:00100000:3.0:1762167009.005582:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34317f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454487808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.005587:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454488960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.005587:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454487680 00000100:00100000:0.0:1762167009.005594:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454487680 00000004:00080000:2.0:1762167009.005605:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff82d80/2, rc 0, transno 21474843426 00000100:00100000:2.0:1762167009.005612:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454489088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.005623:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167009.005628:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317ce00/2, rc 0, transno 17179875873 00000100:00100000:2.0:1762167009.005635:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454487552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.005635:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454487296 00000100:00100000:0.0:1762167009.005641:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454487296 00000100:00100000:3.0:1762167009.005654:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454488320:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167009.005655:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550e300/2, rc 0, transno 21474843427 00000100:00100000:1.0:1762167009.005657:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454487808 00000100:00100000:1.0:1762167009.005664:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454487808 00000100:00100000:2.0:1762167009.005665:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454487936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.005672:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17060 00000004:00080000:2.0:1762167009.005680:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550d500/2, rc 0, transno 21474843425 00000100:00100000:0.0:1762167009.005683:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3293:x1847765454487680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.005689:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454488576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.005692:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.005796:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454489728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.005845:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454488320 00000100:00100000:1.0:1762167009.005850:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454488320 00000100:00100000:1.0:1762167009.005881:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17061 00000100:00100000:1.0:1762167009.005903:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454487296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1762167009.005931:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2075 count 1 00000100:00100000:2.0:1762167009.005949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.005956:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3293:x1847765454487680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 271us (469us total) trans 17179875876 rc 0/0 00000100:00100000:0.0:1762167009.005966:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17060 00010000:00010000:1.0:1762167009.005967:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.005975:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1762167009.005983:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454489728 00000100:00100000:2.0:1762167009.005986:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454489600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.005989:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454489728 00000100:00100000:0.0:1762167009.006013:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17062 00000100:00100000:2.0:1762167009.006020:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.006025:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3294:x1847765454487808:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762167009.006046:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 15 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.006068:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167009.006071:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167009.006075:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.006131:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 15 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.006143:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3294:x1847765454487808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (519us total) trans 17179875877 rc 0/0 00000100:00100000:0.0:1762167009.006151:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17062 00010000:00010000:1.0:1762167009.006156:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 15 pid: 7858 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167009.006162:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454489600 00000100:00100000:0.0:1762167009.006167:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454489600 00000100:00100000:1.0:1762167009.006171:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454489856:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.006183:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17063 00000100:00100000:0.0:1762167009.006189:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454488320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167009.006286:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167009.006289:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.006291:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167009.006294:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.006296:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.006334:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454488320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (647us total) trans 21474843430 rc 0/0 00000100:00100000:0.0:1762167009.006342:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17063 00000100:00100000:1.0:1762167009.006346:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.006362:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17064 00000100:00100000:0.0:1762167009.006384:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3296:x1847765454489728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.006421:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17065 00000100:00100000:1.0:1762167009.006433:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1847765454489600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167009.006476:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167009.006479:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.006481:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.006483:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.006486:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1762167009.006523:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3296:x1847765454489728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (575us total) trans 17179875878 rc 0/0 00000100:00100000:0.0:1762167009.006531:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17064 00000004:00080000:2.0:1762167009.006559:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346a2fb80/2, rc 0, transno 17179875878 00000100:00100000:3.0:1762167009.006562:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454488832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.006568:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454489728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.006602:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.006615:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3296:x1847765454489600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (593us total) trans 17179875879 rc 0/0 00000004:00080000:2.0:1762167009.006625:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346a2f480/2, rc 0, transno 17179875879 00000100:00100000:1.0:1762167009.006625:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17065 00000100:00100000:2.0:1762167009.006635:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454489600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.006637:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454489472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.006638:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454488832 00000100:00100000:0.0:1762167009.006644:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454488832 00000100:00100000:3.0:1762167009.006672:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.006677:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17066 00000100:00100000:0.0:1762167009.006685:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454488832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.006697:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454489472 00000100:00100000:1.0:1762167009.006702:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454489472 00000004:00080000:3.0:1762167009.006714:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317f800/2, rc 0, transno 17179875877 00000100:00100000:3.0:1762167009.006721:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454487808:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167009.006738:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550ea00/2, rc 0, transno 21474843430 00000100:00100000:2.0:1762167009.006744:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17067 00000100:00100000:3.0:1762167009.006747:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454488320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.006785:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1762167009.006794:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454489344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.006795:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3294:x1847765454489472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167009.006818:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167009.006825:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167009.006826:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.006844:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167009.006847:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.006850:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167009.006884:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.006904:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454488832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 218us (300us total) trans 21474843431 rc 0/0 00000100:00100000:0.0:1762167009.006912:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17066 00002000:00010000:2.0:1762167009.006922:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1762167009.006925:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550dc00/2, rc 0, transno 21474843431 00002000:00010000:2.0:1762167009.006927:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00000100:00100000:0.0:1762167009.006929:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454489344 00000100:00100000:1.0:1762167009.006934:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454488832:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167009.006935:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167009.006936:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454489344 00002000:00010000:2.0:1762167009.006944:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167009.006948:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.006969:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17068 00000100:00100000:0.0:1762167009.006980:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454489344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.006987:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.006993:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3294:x1847765454489472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (321us total) trans 17179875880 rc 0/0 00000004:00080000:1.0:1762167009.006998:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346a2c700/2, rc 0, transno 17179875880 00000100:00100000:2.0:1762167009.007005:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17067 00000100:00100000:1.0:1762167009.007008:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454489472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.007053:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.007081:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454488704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.007105:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.007133:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454488192 00000100:00100000:1.0:1762167009.007138:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454488192 00000100:00100000:0.0:1762167009.007144:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454489344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (319us total) trans 21474843432 rc 0/0 00000100:00100000:0.0:1762167009.007153:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17068 00000100:00100000:2.0:1762167009.007157:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454488704 00000100:00100000:2.0:1762167009.007163:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454488704 00000100:00100000:0.0:1762167009.007173:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17069 00000100:00100000:0.0:1762167009.007184:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3293:x1847765454488192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.007190:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17070 00000004:00080000:3.0:1762167009.007194:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317d500/2, rc 0, transno 17179875876 00000100:00100000:1.0:1762167009.007201:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3293:x1847765454488704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.007202:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454487680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.007234:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912320 00000100:00100000:3.0:1762167009.007238:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912320 00000100:00100000:3.0:1762167009.007288:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19897 00000100:00100000:3.0:1762167009.007298:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56213:x1847765451912320:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.007314:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.007335:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b284 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c2b expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167009.007339:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00080000:2.0:1762167009.007340:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762167009.007346:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3293:x1847765454488192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (290us total) trans 17179875881 rc 0/0 00002000:00010000:1.0:1762167009.007347:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167009.007355:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167009.007361:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167009.007365:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.007384:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17069 00010000:00010000:3.0:1762167009.007397:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b284 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c2b expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.007410:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3293:x1847765454488704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (302us total) trans 17179875882 rc 0/0 00010000:00010000:3.0:1762167009.007414:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b284 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c2b expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.007422:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17070 00010000:00010000:3.0:1762167009.007443:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167009.007447:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167009.007450:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000004:00080000:1.0:1762167009.007456:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff83800/2, rc 0, transno 21474843432 00000100:00100000:1.0:1762167009.007462:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454489344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.007496:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56213:x1847765451912320:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 200us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.007504:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19897 00000100:00100000:3.0:1762167009.007541:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454489216:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.007557:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.007624:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454489984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.007633:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454490112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.007654:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.007671:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.007717:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454489984 00000100:00100000:1.0:1762167009.007721:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454489984 00000100:00100000:0.0:1762167009.007738:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454490112 00000100:00100000:0.0:1762167009.007745:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454490112 00000100:00100000:1.0:1762167009.007748:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17071 00000100:00100000:1.0:1762167009.007757:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3293:x1847765454489984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.007796:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17072 00000100:00100000:0.0:1762167009.007805:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454490112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167009.007886:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.007890:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167009.007893:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167009.007895:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167009.007898:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167009.007924:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3293:x1847765454489984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (271us total) trans 21474843433 rc 0/0 00000100:00100000:1.0:1762167009.007932:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17071 00000004:00080000:3.0:1762167009.008030:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317f480/2, rc 0, transno 17179875881 00000100:00100000:3.0:1762167009.008036:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454488192:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167009.008047:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b01c00/2, rc 0, transno 17179875882 00000100:00100000:3.0:1762167009.008051:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454488704:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167009.008063:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34371aa00/2, rc 0, transno 21474843433 00000100:00100000:3.0:1762167009.008066:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454489984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.008090:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912448 00000100:00100000:3.0:1762167009.008094:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912448 00000100:00100000:1.0:1762167009.008107:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454489856:192.168.203.35@tcp:104: 00000100:00080000:3.0:1762167009.008115:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1762167009.008125:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.008136:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab1 expref: 41 pid: 12402 timeout: 729 lvb_type: 1 00000100:00100000:2.0:1762167009.008140:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.008170:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912576 00000100:00100000:1.0:1762167009.008176:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912576 00002000:00010000:0.0:1762167009.008204:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:0.0:1762167009.008208:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167008 -> 1762167008 00010000:00010000:1.0:1762167009.008212:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 16 pid: 7858 timeout: 729 lvb_type: 0 00002000:00010000:0.0:1762167009.008212:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00000100:00080000:2.0:1762167009.008214:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1762167009.008217:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.008223:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167009.008259:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454490112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 455us (587us total) trans 21474843434 rc 0/0 00000100:00100000:1.0:1762167009.008268:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7551 00000100:00100000:0.0:1762167009.008268:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17072 00000100:00100000:1.0:1762167009.008283:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2360:x1847765451912448:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167009.008285:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7552 00010000:00010000:1.0:1762167009.008297:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762167009.008299:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451912576:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167009.008307:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab1 expref: 41 pid: 12402 timeout: 729 lvb_type: 1 00010000:00010000:2.0:1762167009.008312:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.008321:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 16 pid: 7858 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167009.008326:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab1 expref: 41 pid: 12402 timeout: 729 lvb_type: 1 00010000:00010000:2.0:1762167009.008341:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 16 pid: 7858 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1762167009.008354:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ae9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ab1 expref: 41 pid: 12402 timeout: 729 lvb_type: 1 00010000:00010000:2.0:1762167009.008362:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0aace lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3945 expref: 16 pid: 7858 timeout: 729 lvb_type: 0 00010000:00010000:2.0:1762167009.008394:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.008395:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.008398:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.008399:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.008404:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.008405:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.008431:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.008431:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.008471:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167009.008479:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.008509:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2361:x1847765451912576:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 211us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.008509:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765451912448:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 227us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.008527:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7551 00000100:00100000:2.0:1762167009.008538:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7552 00010000:00010000:0.0:1762167009.008561:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.008570:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.008580:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.008588:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167009.008591:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee343719180/2, rc 0, transno 21474843434 00000100:00100000:1.0:1762167009.008600:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454490112:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762167009.008610:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762167009.008620:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167009.008625:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.008632:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.008636:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.008645:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.008655:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.008661:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b27d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.008678:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167009.008679:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167009.008681:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167009.008914:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.008921:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.008928:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.008935:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.008951:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762167009.008966:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1762167009.008972:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454487296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3082us (3422us total) trans 21474843435 rc 0/0 00010000:00010000:1.0:1762167009.008974:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.008985:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17061 00010000:00010000:1.0:1762167009.008989:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167009.008994:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.009003:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.009016:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.009025:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b276 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.009041:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167009.009043:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167009.009044:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1762167009.009066:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550f480/2, rc 0, transno 21474843435 00000100:00100000:1.0:1762167009.009072:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454487296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.009432:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.009438:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3293:x1847765454487168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4838us (5130us total) trans 17179875883 rc 0/0 00000100:00100000:3.0:1762167009.009446:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17052 00000004:00080000:0.0:1762167009.009474:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34317d180/2, rc 0, transno 17179875883 00000100:00100000:1.0:1762167009.009480:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912704 00000100:00100000:0.0:1762167009.009484:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34317d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454487168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.009488:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912704 00000100:00100000:1.0:1762167009.009541:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19898 00000100:00100000:1.0:1762167009.009551:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56213:x1847765451912704:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167009.009564:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167009.009578:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b28b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c32 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.009651:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b292 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.009664:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b292 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.009673:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b292 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167009.009699:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:1.0:1762167009.009704:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167009.009720:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b292 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.009742:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b28b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c32 expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.009756:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b292 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c32 expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.009786:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167009.009790:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167009.009793:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b400, rc 0) 00000100:00100000:1.0:1762167009.009828:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56213:x1847765451912704:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 279us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.009835:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19898 00000100:00100000:3.0:1762167009.011825:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.011879:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.011894:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912832 00000100:00100000:1.0:1762167009.011904:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912832 00000100:00100000:0.0:1762167009.011917:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451912960 00000100:00100000:0.0:1762167009.011925:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451912960 00000100:00100000:3.0:1762167009.011953:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.011970:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451913088 00000100:00100000:1.0:1762167009.011976:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451913088 00000100:00100000:0.0:1762167009.011980:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17073 00000100:00100000:0.0:1762167009.011993:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451912832:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:3.0:1762167009.011998:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17074 00000100:00100000:2.0:1762167009.012009:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17075 00010000:00010000:0.0:1762167009.012010:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167009.012015:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2361:x1847765451912960:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:2.0:1762167009.012027:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451913088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.012028:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.012031:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b299 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c39 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.012040:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.012044:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b2a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c40 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.012055:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b2a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c47 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167009.012055:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 131446, mtime: 0x690888e1, atime: 0x690888e0, ctime: 0x690888e1, blocks: 0xbb 00002000:00010000:3.0:1762167009.012065:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888e0, atime: 0x690888e0, ctime: 0x690888e0, blocks: 0x3 00010000:00010000:0.0:1762167009.012076:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1762167009.012079:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888e0, atime: 0x690888e0, ctime: 0x690888e0, blocks: 0x3 00010000:00010000:0.0:1762167009.012080:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.012087:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.012092:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.012093:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c39 expref: 18 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167009.012095:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.012100:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.012102:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b2a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c40 expref: 41 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167009.012108:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b2a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c47 expref: 18 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167009.012129:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c39 expref: 18 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167009.012136:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b2a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c40 expref: 41 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167009.012137:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b2a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c47 expref: 18 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167009.012146:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c400, rc 0) 00010000:00010000:2.0:1762167009.012163:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00010000:00010000:3.0:1762167009.012164:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:0.0:1762167009.012205:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451912832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 215us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.012215:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451913088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 191us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.012215:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17073 00000100:00100000:2.0:1762167009.012228:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17075 00000100:00100000:3.0:1762167009.012255:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2361:x1847765451912960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 245us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.012267:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17074 00000100:00100000:2.0:1762167009.038985:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.039054:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451913216 00000100:00100000:0.0:1762167009.039066:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451913216 00000100:00100000:0.0:1762167009.039144:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2995 00000100:00100000:0.0:1762167009.039155:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451913216:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167009.039193:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.039207:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.039210:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.039215:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.039229:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.041153:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.041171:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.041187:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.041194:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.041199:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.041215:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.041245:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.041253:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.041346:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451913216:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2184us (2360us total) trans 0 rc 131446/131446 00000100:00100000:0.0:1762167009.041356:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2995 00000100:00100000:2.0:1762167009.044666:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.044736:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451913344 00000100:00100000:0.0:1762167009.044747:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451913344 00000100:00100000:0.0:1762167009.044841:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2996 00000100:00100000:0.0:1762167009.044856:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+41:2359:x1847765451913344:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167009.044906:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 45050, mtime: 0x690888e0, atime: 0x690888d5, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:0.0:1762167009.044915:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.044930:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.044932:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.044937:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.044951:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167009.062617:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875884 is committed 00000001:00080000:3.0:1762167009.062641:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875881 is committed 00000001:00080000:3.0:1762167009.062678:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875882 is committed 00000001:00080000:3.0:1762167009.062788:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875883 is committed 00002000:00010000:0.0:1762167009.062814:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 45050 -> 135168 00002000:00010000:0.0:1762167009.062820:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:0.0:1762167009.062824:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00010000:00010000:0.0:1762167009.062836:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.062847:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.062856:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.062863:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.062869:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.062878:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.062896:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.062903:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.062995:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451913344:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 18141us (18340us total) trans 17179875884 rc 0/0 00000100:00100000:0.0:1762167009.063007:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2996 00000100:00100000:2.0:1762167009.065838:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.065889:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451913472 00000100:00100000:0.0:1762167009.065900:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451913472 00000100:00100000:0.0:1762167009.065976:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2997 00000100:00100000:0.0:1762167009.065987:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451913472:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167009.066037:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 45050, mtime: 0x690888e0, atime: 0x690888db, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:0.0:1762167009.066045:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.066057:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.066059:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.066064:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.066075:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167009.081585:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843436 is committed 00000001:00080000:0.0:1762167009.081606:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843435 is committed 00002000:00010000:2.0:1762167009.081795:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 45050 -> 135168 00002000:00010000:2.0:1762167009.081800:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.081803:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00010000:00010000:2.0:1762167009.081816:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.081827:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.081835:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.081841:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.081846:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.081854:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.081872:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.081878:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b2bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.081978:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451913472:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 15988us (16144us total) trans 21474843436 rc 0/0 00000100:00100000:2.0:1762167009.081990:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2997 00000100:00100000:1.0:1762167009.084953:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.085016:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451913600 00000100:00100000:2.0:1762167009.085026:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451913600 00000100:00100000:2.0:1762167009.085095:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2998 00000100:00100000:2.0:1762167009.085106:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451913600:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167009.085159:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 45050, mtime: 0x690888e0, atime: 0x690888db, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:2.0:1762167009.085168:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b2c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.085181:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.085183:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.085189:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.085204:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167009.101635:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875885 is committed 00002000:00010000:0.0:1762167009.101753:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 45050 -> 135168 00002000:00010000:0.0:1762167009.101758:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:0.0:1762167009.101783:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00010000:00010000:0.0:1762167009.101796:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.101807:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.101815:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.101821:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.101825:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.101835:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.101863:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b2c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.101870:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b2c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.101964:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451913600:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16856us (17016us total) trans 17179875885 rc 0/0 00000100:00100000:0.0:1762167009.101974:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2998 00000100:00100000:3.0:1762167009.104358:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.104416:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451913728 00000100:00100000:0.0:1762167009.104426:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451913728 00000100:00100000:0.0:1762167009.104496:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 2999 00000100:00100000:0.0:1762167009.104511:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451913728:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167009.104556:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 45050, mtime: 0x690888e0, atime: 0x690888dd, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:0.0:1762167009.104564:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.104574:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.104575:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.104580:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.104589:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167009.117379:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875886 is committed 00002000:00010000:0.0:1762167009.117499:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 45050 -> 135168 00002000:00010000:0.0:1762167009.117504:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:0.0:1762167009.117507:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00010000:00010000:0.0:1762167009.117519:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.117531:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.117551:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.117562:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.117567:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.117576:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.117593:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.117599:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.117705:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451913728:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13187us (13341us total) trans 17179875886 rc 0/0 00000100:00100000:0.0:1762167009.117719:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 2999 00000100:00100000:3.0:1762167009.120001:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.120051:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451913856 00000100:00100000:0.0:1762167009.120060:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451913856 00000100:00100000:0.0:1762167009.120126:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3000 00000100:00100000:0.0:1762167009.120135:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451913856:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167009.120178:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 45050, mtime: 0x690888e0, atime: 0x690888dd, ctime: 0x690888e0, blocks: 0x203 00010000:00010000:0.0:1762167009.120186:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b2d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.120203:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.120205:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.120210:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b2d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.120223:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b2d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167009.132176:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843437 is committed 00002000:00010000:2.0:1762167009.132296:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 45050 -> 135168 00002000:00010000:2.0:1762167009.132301:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.132303:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00010000:00010000:2.0:1762167009.132315:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b2d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.132326:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b2d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.132335:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b2d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.132342:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.132347:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b2d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.132356:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b2d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.132383:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b2d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.132391:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b2d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.132486:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451913856:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 12340us (12479us total) trans 21474843437 rc 0/0 00000100:00100000:2.0:1762167009.132498:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3000 00000100:00100000:1.0:1762167009.134492:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.134537:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451913984 00000100:00100000:2.0:1762167009.134558:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451913984 00000100:00100000:2.0:1762167009.134620:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3001 00000100:00100000:2.0:1762167009.134628:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451913984:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167009.134664:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 45050, mtime: 0x690888e0, atime: 0x690888de, ctime: 0x690888e0, blocks: 0x83 00010000:00010000:2.0:1762167009.134672:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b2d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.134689:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.134691:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.134696:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b2d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.134709:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b2d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167009.147366:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843438 is committed 00002000:00010000:2.0:1762167009.147466:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 45050 -> 135168 00002000:00010000:2.0:1762167009.147471:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.147474:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.147476:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 131 -> 515 00010000:00010000:2.0:1762167009.147487:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b2d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.147496:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b2d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.147502:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b2d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.147507:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.147511:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b2d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.147520:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b2d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.147538:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b2d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.147545:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b2d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.147634:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451913984:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13002us (13154us total) trans 21474843438 rc 0/0 00000100:00100000:2.0:1762167009.147646:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3001 00000100:00100000:3.0:1762167009.149856:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.149900:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451914112 00000100:00100000:2.0:1762167009.149910:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451914112 00000100:00100000:2.0:1762167009.149977:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3002 00000100:00100000:2.0:1762167009.149986:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451914112:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167009.150034:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 45050, mtime: 0x690888e0, atime: 0x690888de, ctime: 0x690888e0, blocks: 0x103 00010000:00010000:2.0:1762167009.150043:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b2df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.150057:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.150058:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.150062:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b2df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.150073:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b2df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167009.163682:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875887 is committed 00002000:00010000:0.0:1762167009.163686:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 45050 -> 135168 00002000:00010000:0.0:1762167009.163693:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:0.0:1762167009.163696:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:0.0:1762167009.163698:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 259 -> 515 00010000:00010000:0.0:1762167009.163710:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b2df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.163718:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b2df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.163728:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b2df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.163733:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.163736:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b2df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.163741:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b2df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.163754:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b2df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.163758:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b2df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.163883:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451914112:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13895us (14031us total) trans 17179875887 rc 0/0 00000100:00100000:0.0:1762167009.163892:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3002 00000100:00100000:1.0:1762167009.166757:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.167109:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451914240 00000100:00100000:0.0:1762167009.167119:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451914240 00000100:00100000:0.0:1762167009.167192:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3003 00000100:00100000:0.0:1762167009.167203:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451914240:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762167009.167238:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.167256:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.167264:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167009.167266:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167009.167269:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.167302:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.167317:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 17 pid: 6535 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167009.167332:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e472680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454490240:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.167423:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.168696:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e472680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454490240:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.168714:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.168989:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.169065:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451914368 00000100:00100000:0.0:1762167009.169072:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451914368 00010000:00010000:0.0:1762167009.169100:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 18 pid: 6535 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1762167009.169136:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7553 00000100:00100000:0.0:1762167009.169145:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451914368:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.169160:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.169181:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 18 pid: 6535 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167009.169194:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 18 pid: 6535 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167009.169216:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f2d1000/0xf915a5bdf3d0b0bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->45055) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b98 expref: 18 pid: 6535 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1762167009.169235:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.169237:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.169241:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.169250:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.169277:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167009.169309:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.169321:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451914368:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (330us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167009.169323:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.169337:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7553 00000001:00080000:1.0:1762167009.183142:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843439 is committed 00002000:00010000:2.0:1762167009.183252:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 131446 -> 135168 00002000:00010000:2.0:1762167009.183257:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.183260:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00010000:00010000:2.0:1762167009.183272:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.183283:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.183291:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.183298:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.183302:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.183310:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.183327:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.183333:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b2e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.183441:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451914240:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16236us (16688us total) trans 21474843439 rc 0/0 00000100:00100000:2.0:1762167009.183452:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3003 00000100:00100000:3.0:1762167009.192702:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.192814:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451914624 00000100:00100000:1.0:1762167009.192825:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451914624 00000100:00100000:1.0:1762167009.192886:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19899 00000100:00100000:1.0:1762167009.192896:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56213:x1847765451914624:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167009.192954:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167009.192983:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b292 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c32 expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.193003:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167009.193007:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167009.193261:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.193275:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.193283:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167009.193338:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589952998 00000004:00010000:1.0:1762167009.193364:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b5acd939 reply state 00000000f595233e transno 8589952999 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167009.193387:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167009.193466:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56213:x1847765451914624:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 572us (774us total) trans 8589952999 rc 0/0 00000100:00100000:1.0:1762167009.193472:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19899 00000020:00080000:1.0:1762167009.193478:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167009.194646:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.194659:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.194666:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.194671:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.194675:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.194682:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.194695:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167009.194697:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.194701:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.194707:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b2ed lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.194916:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.195001:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451914752 00000100:00100000:0.0:1762167009.195008:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451914752 00000100:00100000:0.0:1762167009.195061:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17076 00000100:00100000:0.0:1762167009.195072:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56213:x1847765451914752:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.195085:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.195101:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b2f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c4e expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167009.195127:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 135168, mtime: 0x690888e1, atime: 0x690888d5, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:0.0:1762167009.195143:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.195145:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.195150:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c4e expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.195163:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c4e expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.195172:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167009.195218:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56213:x1847765451914752:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 150us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.195224:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17076 00000100:00100000:3.0:1762167009.196246:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.196289:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.196328:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451914880 00000100:00100000:1.0:1762167009.196335:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451914880 00000100:00100000:2.0:1762167009.196357:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451915008 00000100:00100000:2.0:1762167009.196362:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451915008 00002000:00010000:1.0:1762167009.196387:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (131446->18446744073709551615) 00002000:00100000:1.0:1762167009.196393:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff80e00 with x1847765451914880 ext(131446->18446744073709551615) 00002000:00010000:2.0:1762167009.196394:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.196401:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff80380 with x1847765451915008 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167009.196405:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37ff80e00. 00002000:00010000:2.0:1762167009.196409:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff80380. 00000100:00100000:1.0:1762167009.196436:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3004 00000100:00100000:1.0:1762167009.196444:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451914880:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167009.196457:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3005 00000100:00100000:2.0:1762167009.196467:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451915008:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167009.196866:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.196871:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.196874:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167009.196876:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167009.196878:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 135168 -> 131446 00002000:00010000:2.0:1762167009.196879:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.196886:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.196891:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167009.196893:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.196896:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167009.196949:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451915008:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 482us (657us total) trans 21474843440 rc 0/0 00000100:00100000:1.0:1762167009.196952:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451914880:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 507us (716us total) trans 17179875888 rc 0/0 00000100:00100000:2.0:1762167009.196964:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3005 00002000:00010000:2.0:1762167009.196970:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00000100:00100000:1.0:1762167009.196973:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3004 00002000:00100000:2.0:1762167009.196975:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff80380 with x1847765451915008 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167009.196979:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (131446->18446744073709551615) 00002000:00100000:1.0:1762167009.196983:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff80e00 with x1847765451914880 ext(131446->18446744073709551615) 00002000:00010000:2.0:1762167009.196984:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff80380. 00002000:00010000:1.0:1762167009.196991:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37ff80e00. 00000100:00100000:2.0:1762167009.198494:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.198569:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451915136 00000100:00100000:1.0:1762167009.198577:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451915136 00000100:00100000:1.0:1762167009.198631:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19900 00000100:00100000:1.0:1762167009.198641:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56213:x1847765451915136:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167009.198661:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167009.198680:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b2fb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c55 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.198756:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b302 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.198805:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b302 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.198815:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b302 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167009.198842:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:1.0:1762167009.198846:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167009.198862:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b302 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.198888:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b2fb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c55 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.198906:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b302 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c55 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.198914:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167009.198916:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167009.198920:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b800, rc 0) 00000100:00100000:1.0:1762167009.198974:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56213:x1847765451915136:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 334us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.198981:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19900 00000100:00100000:3.0:1762167009.200882:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.200933:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451915392 00000100:00100000:2.0:1762167009.200941:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451915392 00000100:00100000:2.0:1762167009.200995:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19901 00000100:00100000:2.0:1762167009.201005:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56213:x1847765451915392:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167009.201049:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.201071:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b302 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c55 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.201088:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167009.201092:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167009.201288:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.201300:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.201313:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167009.201356:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953000 00000004:00010000:2.0:1762167009.201393:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c71b90c9 reply state 000000001b1a6215 transno 8589953001 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167009.201401:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167009.201478:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56213:x1847765451915392:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 474us (604us total) trans 8589953001 rc 0/0 00000100:00100000:2.0:1762167009.201485:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19901 00000020:00080000:2.0:1762167009.201489:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167009.202416:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.202428:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.202435:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.202442:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167009.202446:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.202453:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.202469:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167009.202472:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167009.202477:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.202482:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b309 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.202571:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.202741:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451915520 00000100:00100000:0.0:1762167009.202749:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451915520 00000100:00100000:0.0:1762167009.202826:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17077 00000100:00100000:0.0:1762167009.202836:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56213:x1847765451915520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.202981:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.203000:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b310 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c5c expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167009.203023:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 135168, mtime: 0x690888e1, atime: 0x690888db, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:0.0:1762167009.203038:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.203040:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.203047:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c5c expref: 18 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.203062:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c5c expref: 18 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.203072:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c200, rc 0) 00000100:00100000:0.0:1762167009.203119:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56213:x1847765451915520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 285us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.203129:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17077 00000100:00100000:3.0:1762167009.204575:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.204627:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.204682:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451915648 00000100:00100000:1.0:1762167009.204692:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451915648 00000100:00100000:2.0:1762167009.204710:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451915776 00000100:00100000:2.0:1762167009.204716:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451915776 00002000:00010000:1.0:1762167009.204725:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (131446->18446744073709551615) 00002000:00100000:1.0:1762167009.204730:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff81c00 with x1847765451915648 ext(131446->18446744073709551615) 00002000:00010000:1.0:1762167009.204741:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff81c00. 00002000:00010000:2.0:1762167009.204749:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.204754:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff83100 with x1847765451915776 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.204779:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37ff83100. 00000100:00100000:1.0:1762167009.204792:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3006 00000100:00100000:2.0:1762167009.204805:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3007 00000100:00100000:1.0:1762167009.204811:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451915648:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167009.204823:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451915776:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167009.205086:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.205089:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.205091:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167009.205093:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.205095:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.205113:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 135168 -> 131446 00002000:00010000:1.0:1762167009.205118:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.205120:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167009.205122:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.205124:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167009.205135:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451915776:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 320us (508us total) trans 17179875889 rc 0/0 00000100:00100000:2.0:1762167009.205140:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3007 00002000:00010000:2.0:1762167009.205143:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.205145:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff83100 with x1847765451915776 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.205149:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37ff83100. 00000100:00100000:1.0:1762167009.205157:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451915648:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 350us (586us total) trans 21474843441 rc 0/0 00000100:00100000:1.0:1762167009.205167:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3006 00002000:00010000:1.0:1762167009.205171:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (131446->18446744073709551615) 00002000:00100000:1.0:1762167009.205175:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37ff81c00 with x1847765451915648 ext(131446->18446744073709551615) 00002000:00010000:1.0:1762167009.205180:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37ff81c00. 00000100:00100000:1.0:1762167009.206973:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.207024:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451915904 00000100:00100000:2.0:1762167009.207033:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451915904 00000100:00100000:2.0:1762167009.207090:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19902 00000100:00100000:2.0:1762167009.207101:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56213:x1847765451915904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167009.207122:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167009.207140:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b317 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c63 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.207225:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b31e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.207237:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b31e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.207247:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b31e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167009.207274:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:2.0:1762167009.207278:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167009.207293:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b31e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.207316:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b317 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c63 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.207331:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b31e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c63 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.207339:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167009.207342:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167009.207345:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167009.207409:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56213:x1847765451915904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 311us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.207422:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19902 00000100:00100000:3.0:1762167009.209351:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.209408:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916160 00000100:00100000:2.0:1762167009.209416:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916160 00000100:00100000:2.0:1762167009.209472:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19903 00000100:00100000:2.0:1762167009.209482:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56213:x1847765451916160:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167009.209529:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.209556:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b31e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c63 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.209573:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167009.209578:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167009.209821:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.209835:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.209844:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167009.209899:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953002 00000004:00010000:2.0:1762167009.209925:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005090035f reply state 00000000f31487fd transno 8589953003 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167009.209933:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167009.210020:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56213:x1847765451916160:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 539us (675us total) trans 8589953003 rc 0/0 00000100:00100000:2.0:1762167009.210028:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19903 00000020:00080000:2.0:1762167009.210032:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167009.211170:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.211180:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.211186:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.211191:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.211194:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.211201:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.211213:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167009.211215:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.211218:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.211223:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b325 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.211454:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.211507:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916288 00000100:00100000:0.0:1762167009.211516:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916288 00000100:00100000:0.0:1762167009.211568:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17078 00000100:00100000:0.0:1762167009.211579:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:56213:x1847765451916288:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.211593:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.211611:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b32c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c6a expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167009.211633:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 135168, mtime: 0x690888e1, atime: 0x690888db, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:0.0:1762167009.211651:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.211654:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.211661:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b32c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c6a expref: 31 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.211678:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b32c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c6a expref: 31 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.211689:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c000, rc 0) 00000100:00100000:0.0:1762167009.211737:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56213:x1847765451916288:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 160us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.211745:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17078 00000100:00100000:3.0:1762167009.212884:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.212916:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.213013:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916416 00000100:00100000:1.0:1762167009.213020:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916416 00000100:00100000:2.0:1762167009.213030:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916544 00000100:00100000:2.0:1762167009.213037:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916544 00002000:00010000:1.0:1762167009.213050:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (131446->18446744073709551615) 00002000:00100000:1.0:1762167009.213056:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c2a00 with x1847765451916416 ext(131446->18446744073709551615) 00002000:00010000:2.0:1762167009.213059:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.213064:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c3480 with x1847765451916544 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167009.213066:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f8c2a00. 00002000:00010000:2.0:1762167009.213074:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f8c3480. 00000100:00100000:1.0:1762167009.213122:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3008 00000100:00100000:2.0:1762167009.213134:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3009 00000100:00100000:1.0:1762167009.213136:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451916416:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167009.213149:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451916544:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167009.213445:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.213449:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.213452:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167009.213455:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.213457:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.213494:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 135168 -> 131446 00002000:00010000:1.0:1762167009.213499:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.213502:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167009.213504:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.213506:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167009.213520:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451916544:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 375us (601us total) trans 21474843442 rc 0/0 00000100:00100000:2.0:1762167009.213528:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3009 00002000:00010000:2.0:1762167009.213532:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.213538:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c3480 with x1847765451916544 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167009.213538:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451916416:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 404us (655us total) trans 17179875890 rc 0/0 00002000:00010000:2.0:1762167009.213546:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f8c3480. 00000100:00100000:1.0:1762167009.213551:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3008 00002000:00010000:1.0:1762167009.213556:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (131446->18446744073709551615) 00002000:00100000:1.0:1762167009.213559:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f8c2a00 with x1847765451916416 ext(131446->18446744073709551615) 00002000:00010000:1.0:1762167009.213565:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37f8c2a00. 00000100:00100000:1.0:1762167009.215576:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.215643:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916672 00000100:00100000:2.0:1762167009.215650:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916672 00000100:00100000:2.0:1762167009.215735:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19904 00000100:00100000:2.0:1762167009.215745:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56213:x1847765451916672:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167009.215957:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167009.216359:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b333 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c71 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.216459:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b33a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.216473:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b33a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.216483:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b33a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167009.216510:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:2.0:1762167009.216515:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167009.216533:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b33a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.216559:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b333 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c71 expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.216576:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b33a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c71 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.216585:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167009.216587:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167009.216591:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167009.216653:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56213:x1847765451916672:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 906us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.216660:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19904 00000100:00100000:0.0:1762167009.218906:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.219064:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451916928 00000100:00100000:2.0:1762167009.219074:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451916928 00000100:00100000:2.0:1762167009.219124:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19905 00000100:00100000:2.0:1762167009.219136:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56213:x1847765451916928:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167009.219190:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.219214:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b33a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c71 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.219228:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167009.219231:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167009.219464:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.219478:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.219487:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167009.219539:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953004 00000004:00010000:2.0:1762167009.219563:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000038b53985 reply state 00000000484e49a4 transno 8589953005 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167009.219571:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167009.219649:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56213:x1847765451916928:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 516us (751us total) trans 8589953005 rc 0/0 00000100:00100000:2.0:1762167009.219657:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19905 00000020:00080000:2.0:1762167009.219662:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167009.220805:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.220819:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.220827:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.220835:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167009.220839:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167009.220844:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.220856:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.220870:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167009.220873:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167009.220878:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.220885:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b341 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167009.220904:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917056 00000100:00100000:1.0:1762167009.220913:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917056 00000100:00100000:1.0:1762167009.220961:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17079 00000100:00100000:1.0:1762167009.220972:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56213:x1847765451917056:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167009.220986:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167009.221003:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b348 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c78 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167009.221027:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 135168, mtime: 0x690888e1, atime: 0x690888dd, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:1.0:1762167009.221044:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.221046:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.221053:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c78 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.221067:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c78 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.221078:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ae00, rc 0) 00000100:00100000:1.0:1762167009.221124:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:56213:x1847765451917056:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.221131:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17079 00000100:00100000:3.0:1762167009.222726:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.222790:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.222863:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917184 00000100:00100000:2.0:1762167009.222867:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917312 00000100:00100000:1.0:1762167009.222871:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917184 00000100:00100000:2.0:1762167009.222874:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917312 00002000:00010000:2.0:1762167009.222907:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00010000:1.0:1762167009.222907:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (131446->18446744073709551615) 00002000:00100000:2.0:1762167009.222915:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348256680 with x1847765451917312 ext(0->18446744073709551615) 00002000:00100000:1.0:1762167009.222915:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348256d80 with x1847765451917184 ext(131446->18446744073709551615) 00002000:00010000:1.0:1762167009.222928:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee348256d80. 00002000:00010000:2.0:1762167009.222932:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348256680. 00000100:00100000:1.0:1762167009.222989:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3010 00000100:00100000:2.0:1762167009.223001:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3011 00000100:00100000:1.0:1762167009.223003:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451917184:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167009.223015:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451917312:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167009.223295:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 135168 -> 131446 00002000:00010000:2.0:1762167009.223299:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.223299:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.223302:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167009.223305:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167009.223306:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.223312:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167009.223313:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167009.223317:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.223319:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.223359:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451917312:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 345us (591us total) trans 21474843443 rc 0/0 00000100:00100000:1.0:1762167009.223360:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451917184:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 358us (636us total) trans 17179875891 rc 0/0 00000100:00100000:1.0:1762167009.223385:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3010 00002000:00010000:1.0:1762167009.223390:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (131446->18446744073709551615) 00000100:00100000:2.0:1762167009.223394:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3011 00002000:00100000:1.0:1762167009.223395:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348256d80 with x1847765451917184 ext(131446->18446744073709551615) 00002000:00010000:2.0:1762167009.223402:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00010000:1.0:1762167009.223404:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee348256d80. 00002000:00100000:2.0:1762167009.223407:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348256680 with x1847765451917312 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.223414:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348256680. 00000100:00100000:2.0:1762167009.225034:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.225091:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917440 00000100:00100000:3.0:1762167009.225099:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917440 00000100:00100000:3.0:1762167009.225155:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19906 00000100:00100000:3.0:1762167009.225165:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56213:x1847765451917440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.225186:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.225205:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b34f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c7f expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.225282:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b356 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.225296:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b356 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.225306:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b356 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167009.225335:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:3.0:1762167009.225339:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.225356:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b356 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.225397:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b34f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c7f expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.225416:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b356 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c7f expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.225425:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167009.225428:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.225431:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167009.225488:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56213:x1847765451917440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 324us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.225495:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19906 00000100:00100000:3.0:1762167009.227902:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.227982:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917696 00000100:00100000:2.0:1762167009.227991:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917696 00000100:00100000:2.0:1762167009.228056:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19907 00000100:00100000:2.0:1762167009.228065:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56213:x1847765451917696:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167009.228115:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.228140:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b356 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c7f expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.228158:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167009.228162:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167009.228379:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.228392:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.228401:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167009.228454:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953006 00000004:00010000:2.0:1762167009.228480:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006f256704 reply state 000000005efe48e4 transno 8589953007 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167009.228488:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167009.228577:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56213:x1847765451917696:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 512us (682us total) trans 8589953007 rc 0/0 00000100:00100000:2.0:1762167009.228587:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19907 00000020:00080000:2.0:1762167009.228593:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167009.229578:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.229592:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.229600:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.229606:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167009.229610:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.229617:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.229634:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167009.229637:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167009.229641:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.229647:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b35d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.230794:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.230862:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917824 00000100:00100000:1.0:1762167009.230871:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917824 00000100:00100000:1.0:1762167009.230914:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17080 00000100:00100000:1.0:1762167009.230921:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56213:x1847765451917824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167009.230935:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167009.230963:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b364 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c86 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167009.230989:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 135168, mtime: 0x690888e1, atime: 0x690888dd, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:1.0:1762167009.231012:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.231015:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.231022:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b364 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c86 expref: 22 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.231044:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b364 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c86 expref: 22 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.231057:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b600, rc 0) 00000100:00100000:1.0:1762167009.231178:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56213:x1847765451917824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 256us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.231185:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17080 00000100:00100000:2.0:1762167009.232829:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.232869:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.232904:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918080 00000100:00100000:3.0:1762167009.232912:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918080 00000100:00100000:1.0:1762167009.232949:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451917952 00000100:00100000:1.0:1762167009.232954:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451917952 00002000:00010000:3.0:1762167009.232955:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:3.0:1762167009.232962:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce4700 with x1847765451918080 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167009.232972:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (131446->18446744073709551615) 00002000:00010000:3.0:1762167009.232973:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce4700. 00002000:00100000:1.0:1762167009.232979:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5c00 with x1847765451917952 ext(131446->18446744073709551615) 00002000:00010000:1.0:1762167009.232987:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce5c00. 00000100:00100000:3.0:1762167009.233008:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3012 00000100:00100000:3.0:1762167009.233020:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451918080:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167009.233022:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3013 00000100:00100000:1.0:1762167009.233036:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451917952:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167009.233314:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167009.233318:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:3.0:1762167009.233322:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167009.233324:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:3.0:1762167009.233327:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.233330:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 135168 -> 131446 00002000:00010000:1.0:1762167009.233335:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.233338:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167009.233340:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.233343:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167009.233393:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451918080:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 376us (569us total) trans 17179875892 rc 0/0 00000100:00100000:3.0:1762167009.233402:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3012 00002000:00010000:3.0:1762167009.233405:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:3.0:1762167009.233408:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce4700 with x1847765451918080 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167009.233413:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce4700. 00000100:00100000:1.0:1762167009.233472:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451917952:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 439us (601us total) trans 21474843444 rc 0/0 00000100:00100000:1.0:1762167009.233480:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3013 00002000:00010000:1.0:1762167009.233483:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (131446->18446744073709551615) 00002000:00100000:1.0:1762167009.233486:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5c00 with x1847765451917952 ext(131446->18446744073709551615) 00002000:00010000:1.0:1762167009.233491:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce5c00. 00000100:00100000:2.0:1762167009.235082:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.235137:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918208 00000100:00100000:3.0:1762167009.235145:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918208 00000100:00100000:3.0:1762167009.235196:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19908 00000100:00100000:3.0:1762167009.235207:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56213:x1847765451918208:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.235228:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.235250:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b36b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c8d expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.235323:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b372 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.235337:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b372 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.235348:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b372 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167009.235386:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:3.0:1762167009.235391:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.235407:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b372 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.235432:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b36b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c8d expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.235448:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b372 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c8d expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.235456:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167009.235459:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.235463:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167009.235522:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56213:x1847765451918208:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 317us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.235530:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19908 00000100:00100000:0.0:1762167009.237509:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.237586:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918464 00000100:00100000:3.0:1762167009.237593:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918464 00000100:00100000:3.0:1762167009.237639:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19909 00000100:00100000:3.0:1762167009.237650:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56213:x1847765451918464:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.237699:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.237720:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b372 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c8d expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.237737:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167009.237742:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.237979:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.237991:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.237999:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762167009.238050:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953008 00000004:00010000:3.0:1762167009.238077:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ad26f5ee reply state 00000000be1e4c77 transno 8589953009 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.238086:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.238172:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56213:x1847765451918464:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 523us (668us total) trans 8589953009 rc 0/0 00000100:00100000:3.0:1762167009.238180:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19909 00000020:00080000:3.0:1762167009.238186:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167009.239232:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.239245:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.239254:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.239260:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167009.239264:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.239272:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.239284:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167009.239287:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167009.239291:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.239297:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b379 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167009.239449:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.239532:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918592 00000100:00100000:1.0:1762167009.239539:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918592 00000100:00100000:1.0:1762167009.239584:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17081 00000100:00100000:1.0:1762167009.239594:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56213:x1847765451918592:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167009.239607:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167009.239624:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b380 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c94 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167009.239645:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 135168, mtime: 0x690888e1, atime: 0x690888de, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:1.0:1762167009.239662:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.239664:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.239671:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b380 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c94 expref: 24 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.239684:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b380 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c94 expref: 24 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.239694:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b800, rc 0) 00000100:00100000:1.0:1762167009.239755:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56213:x1847765451918592:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 158us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.239791:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17081 00000100:00100000:2.0:1762167009.241280:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.241320:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.241347:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918720 00000100:00100000:1.0:1762167009.241355:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918720 00000100:00100000:3.0:1762167009.241378:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918848 00000100:00100000:3.0:1762167009.241385:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918848 00002000:00010000:1.0:1762167009.241393:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (131446->18446744073709551615) 00002000:00100000:1.0:1762167009.241398:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aaa300 with x1847765451918720 ext(131446->18446744073709551615) 00002000:00010000:3.0:1762167009.241406:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00010000:1.0:1762167009.241408:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aaa300. 00002000:00100000:3.0:1762167009.241411:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa9180 with x1847765451918848 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167009.241421:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee346aa9180. 00000100:00100000:1.0:1762167009.241436:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3014 00000100:00100000:1.0:1762167009.241445:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451918720:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167009.241454:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3015 00000100:00100000:3.0:1762167009.241464:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451918848:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167009.241701:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167009.241705:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:3.0:1762167009.241707:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167009.241710:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:3.0:1762167009.241712:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.241735:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 135168 -> 131446 00002000:00010000:1.0:1762167009.241740:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.241742:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167009.241745:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.241748:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167009.241792:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451918848:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 298us (440us total) trans 17179875893 rc 0/0 00000100:00100000:3.0:1762167009.241800:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3015 00002000:00010000:3.0:1762167009.241804:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00100000:3.0:1762167009.241807:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aa9180 with x1847765451918848 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167009.241813:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee346aa9180. 00000100:00100000:1.0:1762167009.241813:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451918720:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 367us (537us total) trans 21474843445 rc 0/0 00000100:00100000:1.0:1762167009.241825:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3014 00002000:00010000:1.0:1762167009.241829:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (131446->18446744073709551615) 00002000:00100000:1.0:1762167009.241832:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346aaa300 with x1847765451918720 ext(131446->18446744073709551615) 00002000:00010000:1.0:1762167009.241838:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346aaa300. 00000100:00100000:2.0:1762167009.243828:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.243931:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451918976 00000100:00100000:3.0:1762167009.243940:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451918976 00000100:00100000:3.0:1762167009.243993:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19910 00000100:00100000:3.0:1762167009.244002:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56213:x1847765451918976:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.244021:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.244039:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b387 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3c9b expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.244124:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b38e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.244136:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b38e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.244150:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b38e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167009.244175:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:3.0:1762167009.244178:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.244194:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b38e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.244216:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b387 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c9b expref: 905 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.244231:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b38e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c9b expref: 904 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.244251:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167009.244254:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.244257:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167009.244316:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56213:x1847765451918976:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 315us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.244323:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19910 00000100:00100000:0.0:1762167009.246153:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.246193:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919232 00000100:00100000:3.0:1762167009.246201:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919232 00000100:00100000:3.0:1762167009.246244:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19911 00000100:00100000:3.0:1762167009.246250:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56213:x1847765451919232:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.246288:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.246313:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b38e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c9b expref: 904 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.246333:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167009.246337:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.246577:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.246589:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.246597:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762167009.246649:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953010 00000004:00010000:3.0:1762167009.246676:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dcf6f6c7 reply state 000000005d8bf61d transno 8589953011 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.246684:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.246795:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56213:x1847765451919232:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 509us (694us total) trans 8589953011 rc 0/0 00000100:00100000:3.0:1762167009.246804:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19911 00000020:00080000:3.0:1762167009.246810:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167009.247680:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.247688:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.247693:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.247696:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167009.247699:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.247704:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.247718:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167009.247721:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167009.247725:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.247733:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b395 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167009.247915:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.247971:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919360 00000100:00100000:1.0:1762167009.247979:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919360 00000100:00100000:1.0:1762167009.248023:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17082 00000100:00100000:1.0:1762167009.248033:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:56213:x1847765451919360:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167009.248046:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167009.248063:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b39c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ca2 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167009.248086:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 135168, mtime: 0x690888e1, atime: 0x690888de, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:1.0:1762167009.248103:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.248105:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.248113:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b39c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca2 expref: 37 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.248133:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b39c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca2 expref: 37 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.248145:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00000100:00100000:1.0:1762167009.248186:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:56213:x1847765451919360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 154us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.248193:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17082 00000100:00100000:2.0:1762167009.249418:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.249453:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.249520:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919488 00000100:00100000:3.0:1762167009.249532:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919488 00000100:00100000:1.0:1762167009.249548:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919616 00000100:00100000:1.0:1762167009.249553:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919616 00002000:00010000:3.0:1762167009.249561:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (131446->18446744073709551615) 00002000:00100000:3.0:1762167009.249565:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242408000 with x1847765451919488 ext(131446->18446744073709551615) 00002000:00010000:1.0:1762167009.249571:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00010000:3.0:1762167009.249573:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242408000. 00002000:00100000:1.0:1762167009.249578:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242409c00 with x1847765451919616 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167009.249586:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242409c00. 00000100:00100000:3.0:1762167009.249599:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3016 00000100:00100000:3.0:1762167009.249611:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+37:2361:x1847765451919488:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167009.249616:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3017 00000100:00100000:1.0:1762167009.249627:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451919616:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167009.249890:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.249894:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167009.249897:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167009.249899:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167009.249901:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167009.249933:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 135168 -> 131446 00002000:00010000:3.0:1762167009.249938:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.249940:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167009.249942:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.249944:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167009.249952:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451919616:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 326us (497us total) trans 21474843446 rc 0/0 00000100:00100000:1.0:1762167009.249960:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3017 00002000:00010000:1.0:1762167009.249964:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00100000:1.0:1762167009.249967:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242409c00 with x1847765451919616 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167009.249973:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242409c00. 00000100:00100000:3.0:1762167009.249975:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2361:x1847765451919488:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 366us (558us total) trans 17179875894 rc 0/0 00000100:00100000:3.0:1762167009.249984:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3016 00002000:00010000:3.0:1762167009.249988:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (131446->18446744073709551615) 00002000:00100000:3.0:1762167009.249991:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242408000 with x1847765451919488 ext(131446->18446744073709551615) 00002000:00010000:3.0:1762167009.249998:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242408000. 00000100:00100000:2.0:1762167009.251389:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.251442:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451919744 00000100:00100000:3.0:1762167009.251449:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451919744 00000100:00100000:3.0:1762167009.251498:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19912 00000100:00100000:3.0:1762167009.251512:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56213:x1847765451919744:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.251530:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.251548:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b3a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ca9 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.251624:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.251638:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.251649:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167009.251674:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:3.0:1762167009.251678:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.251692:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.251718:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b3a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca9 expref: 907 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.251751:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca9 expref: 906 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.251794:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167009.251799:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.251802:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:3.0:1762167009.251860:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56213:x1847765451919744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 350us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.251868:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19912 00000100:00100000:0.0:1762167009.253925:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.254016:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920000 00000100:00100000:3.0:1762167009.254024:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920000 00000100:00100000:3.0:1762167009.254077:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19913 00000100:00100000:3.0:1762167009.254088:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56213:x1847765451920000:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.254137:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.254161:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca9 expref: 906 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.254179:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167009.254183:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.254429:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.254444:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.254454:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762167009.254503:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953012 00000004:00010000:3.0:1762167009.254528:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000089403266 reply state 0000000045ab51fc transno 8589953013 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.254537:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.254625:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56213:x1847765451920000:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 538us (708us total) trans 8589953013 rc 0/0 00000100:00100000:3.0:1762167009.254633:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19913 00000020:00080000:3.0:1762167009.254638:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167009.255724:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.255737:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.255744:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.255750:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167009.255754:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.255790:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.255804:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167009.255807:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167009.255812:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.255818:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b3b1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167009.256236:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.256290:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920128 00000100:00100000:1.0:1762167009.256299:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920128 00000100:00100000:1.0:1762167009.256353:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17083 00000100:00100000:1.0:1762167009.256362:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56213:x1847765451920128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167009.256389:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167009.256411:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b3b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3cb0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167009.256436:0:7858:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 135168, mtime: 0x690888e1, atime: 0x690888e0, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:1.0:1762167009.256455:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.256457:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.256465:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b3b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb0 expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.256481:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b3b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb0 expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.256492:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b400, rc 0) 00000100:00100000:1.0:1762167009.256547:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56213:x1847765451920128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 186us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.256554:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17083 00000100:00100000:2.0:1762167009.258502:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.258563:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920256 00000100:00100000:1.0:1762167009.258572:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920256 00000100:00100000:1.0:1762167009.258627:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17084 00000100:00100000:1.0:1762167009.258637:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:56213:x1847765451920256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167009.258652:0:7858:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167009.258669:0:7858:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3cb7 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.258711:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0af7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b1a expref: 39 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.258727:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b0b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b91 expref: 39 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.258736:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b0af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b8a expref: 39 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.258744:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b0a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b83 expref: 39 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.258752:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b0a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b7c expref: 39 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.258760:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b093 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b75 expref: 39 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.258800:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.258803:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.258808:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 9/0,0 mode: --/PW res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 39 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.258846:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b093 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b75 expref: 39 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.258872:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b093 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b75 expref: 39 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1762167009.258886:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454490368:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167009.258980:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b7c expref: 39 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.258990:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b7c expref: 39 pid: 12402 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1762167009.259000:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454490496:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167009.259033:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b83 expref: 39 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.259042:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b83 expref: 39 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1762167009.259051:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e447b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454490624:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167009.259080:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b0af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b8a expref: 39 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.259089:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b0af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b8a expref: 39 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1762167009.259103:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454490752:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167009.259131:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b0b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b91 expref: 39 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.259139:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b0b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b91 expref: 39 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1762167009.259148:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454490880:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167009.259169:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0af7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b1a expref: 39 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.259177:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0af7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b1a expref: 39 pid: 33894 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1762167009.259185:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454491008:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167009.259204:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e240 going to sleep for 11 seconds 00000100:00100000:1.0:1762167009.261266:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454490368:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167009.261277:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454490496:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167009.261491:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e447b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454490624:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.261721:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.261757:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454490752:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.261792:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920512 00000100:00100000:2.0:1762167009.261799:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920512 00010000:00010000:2.0:1762167009.261836:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b093 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b75 expref: 40 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.261878:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7554 00000100:00100000:2.0:1762167009.261888:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+40:2360:x1847765451920512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.261902:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.261925:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b093 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b75 expref: 40 pid: 6535 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.261937:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b093 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b75 expref: 40 pid: 6535 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.261965:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b093 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b75 expref: 40 pid: 6535 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.261981:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.262035:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765451920512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 148us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.262047:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7554 00000100:00100000:3.0:1762167009.262053:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.262079:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920384 00000100:00100000:2.0:1762167009.262084:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920384 00010000:00010000:2.0:1762167009.262099:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b7c expref: 39 pid: 12402 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.262122:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7555 00000100:00100000:2.0:1762167009.262132:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765451920384:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.262141:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.262152:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b7c expref: 39 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.262162:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b7c expref: 39 pid: 12402 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1762167009.262174:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167009.262178:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b0a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b7c expref: 39 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.262192:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167009.262204:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920768 00000100:00100000:1.0:1762167009.262208:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920768 00010000:00010000:1.0:1762167009.262224:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b0af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b8a expref: 39 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.262234:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+39:2360:x1847765451920384:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 103us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.262244:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7555 00000100:00100000:1.0:1762167009.262251:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7556 00000100:00100000:1.0:1762167009.262262:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765451920768:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167009.262272:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167009.262286:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b0af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b8a expref: 38 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1762167009.262286:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167009.262300:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b0af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b8a expref: 38 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.262311:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920640 00010000:00010000:1.0:1762167009.262317:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b0af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b8a expref: 38 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.262318:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920640 00010000:00010000:1.0:1762167009.262331:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167009.262348:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167009.262350:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b83 expref: 38 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1762167009.262364:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765451920768:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 103us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.262385:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7556 00000100:00100000:2.0:1762167009.262387:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451920896 00000100:00100000:2.0:1762167009.262394:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451920896 00000100:00100000:1.0:1762167009.262406:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7557 00010000:00010000:2.0:1762167009.262410:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b0b6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b91 expref: 38 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1762167009.262424:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2361:x1847765451920640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167009.262434:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762167009.262440:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7558 00010000:00010000:1.0:1762167009.262445:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b83 expref: 38 pid: 6535 timeout: 730 lvb_type: 1 00010000:00010000:1.0:1762167009.262465:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b83 expref: 38 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1762167009.262466:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+38:2360:x1847765451920896:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.262485:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167009.262486:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b0a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b83 expref: 38 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.262494:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454490880:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.262501:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b0b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b91 expref: 37 pid: 6535 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1762167009.262520:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b0b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b91 expref: 37 pid: 6535 timeout: 730 lvb_type: 1 00010000:00010000:1.0:1762167009.262531:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167009.262539:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f2d1a00/0xf915a5bdf3d0b0b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b91 expref: 37 pid: 6535 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1762167009.262551:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167009.262570:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451920640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 149us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.262582:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7557 00000100:00100000:0.0:1762167009.262584:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765451920896:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 121us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.262595:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7558 00000100:00100000:3.0:1762167009.262620:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7858:1847765454491008:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.262665:0:7858:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 34 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.262678:0:7858:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a200, rc 0) 00000100:00100000:2.0:1762167009.262718:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.262727:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:56213:x1847765451920256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 4092us (4232us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.262734:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17084 00000100:00100000:0.0:1762167009.262865:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921024 00000100:00100000:0.0:1762167009.262870:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921024 00010000:00010000:0.0:1762167009.262889:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0af7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b1a expref: 34 pid: 33894 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1762167009.262914:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7559 00000100:00100000:0.0:1762167009.262923:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451921024:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.262931:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.262941:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0af7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b1a expref: 34 pid: 33894 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1762167009.262951:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0af7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b1a expref: 34 pid: 33894 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1762167009.262965:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0af7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3b1a expref: 34 pid: 33894 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1762167009.262976:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.262978:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.262982:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.262992:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.263022:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.263033:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454491136:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167009.263085:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.264109:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454491136:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167009.264118:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167009.264135:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167009.264182:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451921024:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1260us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.264191:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7559 00000100:00100000:3.0:1762167009.264258:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921152 00000100:00100000:3.0:1762167009.264264:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921152 00000100:00100000:1.0:1762167009.264278:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:3.0:1762167009.264293:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (131446->18446744073709551615) 00002000:00100000:3.0:1762167009.264299:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359064380 with x1847765451921152 ext(131446->18446744073709551615) 00002000:00010000:3.0:1762167009.264308:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359064380. 00000100:00100000:3.0:1762167009.264336:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921280 00000100:00100000:2.0:1762167009.264406:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3018 00000100:00100000:3.0:1762167009.264414:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921280 00000100:00100000:2.0:1762167009.264419:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451921152:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167009.264432:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00100000:3.0:1762167009.264436:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243305f80 with x1847765451921280 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167009.264443:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee243305f80. 00000100:00100000:3.0:1762167009.264465:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3019 00000100:00100000:3.0:1762167009.264474:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451921280:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167009.264743:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 135168 -> 131446 00002000:00010000:3.0:1762167009.264746:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.264748:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.264754:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:2.0:1762167009.264754:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167009.264782:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.264786:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:3.0:1762167009.264804:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167009.264809:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:3.0:1762167009.264812:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167009.264825:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451921152:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 411us (710us total) trans 21474843447 rc 0/0 00000100:00100000:2.0:1762167009.264834:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3018 00002000:00010000:2.0:1762167009.264839:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (131446->18446744073709551615) 00002000:00100000:2.0:1762167009.264842:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359064380 with x1847765451921152 ext(131446->18446744073709551615) 00000100:00100000:3.0:1762167009.264849:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451921280:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 373us (568us total) trans 17179875895 rc 0/0 00002000:00010000:2.0:1762167009.264851:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359064380. 00000100:00100000:3.0:1762167009.264862:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3019 00002000:00010000:3.0:1762167009.264867:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00100000:3.0:1762167009.264870:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243305f80 with x1847765451921280 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167009.264876:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee243305f80. 00000100:00100000:1.0:1762167009.265896:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.265943:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921536 00000100:00100000:3.0:1762167009.265950:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921536 00000100:00100000:3.0:1762167009.265993:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19914 00000100:00100000:3.0:1762167009.266002:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56213:x1847765451921536:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.266079:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.266094:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.266109:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00010000:3.0:1762167009.266211:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009fab0093 reply state 00000000592f4e61 transno 8589953014 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.266220:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.266286:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56213:x1847765451921536:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 285us (394us total) trans 8589953014 rc 0/0 00000100:00100000:3.0:1762167009.266294:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19914 00000100:00100000:0.0:1762167009.267466:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167009.267489:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.267502:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167009.267512:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167009.267514:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.267523:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.267527:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.267535:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.267549:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167009.267553:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.267557:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.267563:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3c6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.267652:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921664 00000100:00100000:3.0:1762167009.267658:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921664 00000100:00100000:3.0:1762167009.267715:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921792 00000100:00100000:3.0:1762167009.267718:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921792 00000100:00100000:1.0:1762167009.267720:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17085 00000100:00100000:1.0:1762167009.267735:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451921664:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167009.267738:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17086 00000100:00100000:3.0:1762167009.267744:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451921792:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:3.0:1762167009.267909:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.267909:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:3.0:1762167009.267913:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167009.267913:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.267916:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167009.267916:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167008 -> 1762167009 00002000:00010000:3.0:1762167009.267919:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167009.267919:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.267922:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.267922:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 187 -> 187 00000100:00100000:1.0:1762167009.267960:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451921664:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 231us (498us total) trans 21474843448 rc 0/0 00000100:00100000:1.0:1762167009.267967:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17085 00000100:00100000:1.0:1762167009.268453:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.268485:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451921920 00000100:00100000:1.0:1762167009.268489:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451921920 00000100:00100000:2.0:1762167009.268510:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451921792:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 765us (1001us total) trans 17179875896 rc 0/0 00000100:00100000:2.0:1762167009.268518:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17086 00000100:00100000:1.0:1762167009.268524:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17087 00000100:00100000:1.0:1762167009.268530:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451921920:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167009.268622:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.268625:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167009.268627:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167009.268629:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167008 -> 1762167009 00002000:00010000:1.0:1762167009.268631:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167009.268667:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451921920:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 136us (214us total) trans 21474843449 rc 0/0 00000100:00100000:1.0:1762167009.268674:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17087 00000100:00100000:1.0:1762167009.269951:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.269992:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922176 00000100:00100000:2.0:1762167009.269998:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922176 00000100:00100000:2.0:1762167009.270034:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7365 00000100:00100000:2.0:1762167009.270039:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56213:x1847765451922176:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167009.270079:0:33886:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b24c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c24 expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.270112:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167009.270120:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b284 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c2b expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.270126:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167009.270149:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b284 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c2b expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.270157:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b284 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c2b expref: 908 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.270166:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de02d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454491264:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.270225:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.271329:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de02d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454491264:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.271349:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167009.271542:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.271601:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922304 00000100:00100000:0.0:1762167009.271606:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922304 00010000:00010000:0.0:1762167009.271632:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b284 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c2b expref: 909 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.271698:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7560 00000100:00100000:0.0:1762167009.271708:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:2361:x1847765451922304:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.271720:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.271726:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b284 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c2b expref: 909 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.271737:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b284 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c2b expref: 909 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.271754:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b284 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c2b expref: 909 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.271893:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167009.271899:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167009.271907:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167009.271914:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167009.271971:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167009.272015:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2361:x1847765451922304:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 308us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.272023:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7560 00010000:00010000:2.0:1762167009.272061:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167009.272068:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000040:00080000:2.0:1762167009.272626:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5505, 88 off444720 00000004:00080000:2.0:1762167009.272637:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630064873593ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.272704:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5513, 88 off445776 00000004:00080000:2.0:1762167009.272713:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630064950044ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.272796:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5514, 88 off445864 00000004:00080000:2.0:1762167009.272803:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630065040328ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.272839:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5506, 88 off444808 00000004:00080000:2.0:1762167009.272844:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630065081449ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.272939:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5515, 88 off445952 00000004:00080000:2.0:1762167009.272945:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630065181756ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.272975:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5507, 88 off444896 00000004:00080000:2.0:1762167009.272980:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630065217094ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.273018:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5508, 88 off444984 00000004:00080000:2.0:1762167009.273023:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630065260241ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.273040:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5516, 88 off446040 00000004:00080000:2.0:1762167009.273044:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630065281729ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.273079:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5517, 88 off446128 00000004:00080000:2.0:1762167009.273084:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630065320944ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.273099:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5509, 88 off445072 00000004:00080000:2.0:1762167009.273102:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630065339336ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.273126:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5518, 88 off446216 00000004:00080000:2.0:1762167009.273130:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630065366842ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.273145:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5510, 88 off445160 00000004:00080000:2.0:1762167009.273148:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630065385526ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.273171:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5511, 88 off445248 00000004:00080000:2.0:1762167009.273176:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630065413129ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.273200:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5519, 88 off446304 00000004:00080000:2.0:1762167009.273204:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630065440921ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.273220:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5512, 88 off445336 00000004:00080000:2.0:1762167009.273224:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630065461049ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.273246:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5520, 88 off446392 00000004:00080000:2.0:1762167009.273250:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630065487214ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.273278:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5521, 88 off446480 00000004:00080000:2.0:1762167009.273281:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630065518662ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.273296:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5513, 88 off445424 00000004:00080000:2.0:1762167009.273299:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630065536599ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.273322:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5514, 88 off445512 00000004:00080000:2.0:1762167009.273327:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630065564054ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.273344:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5522, 88 off446568 00000004:00080000:2.0:1762167009.273348:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630065585324ns, next at 630703976179ns, rc = 0 00000001:00080000:3.0:1762167009.288070:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952999 is committed 00000001:00080000:3.0:1762167009.288092:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953015 is committed 00000004:00080000:3.0:1762167009.288096:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3634 committed 00000004:00080000:3.0:1762167009.288110:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3621 committed 00000004:00080000:3.0:1762167009.288123:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3620 committed 00000004:00080000:3.0:1762167009.288126:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3633 committed 00000004:00080000:3.0:1762167009.288128:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3632 committed 00000004:00080000:3.0:1762167009.288131:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3619 committed 00000004:00080000:3.0:1762167009.288133:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3631 committed 00000004:00080000:3.0:1762167009.288135:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3618 committed 00000004:00080000:3.0:1762167009.288137:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3617 committed 00000004:00080000:3.0:1762167009.288139:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3630 committed 00000004:00080000:3.0:1762167009.288141:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3616 committed 00000004:00080000:3.0:1762167009.288142:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3629 committed 00000004:00080000:3.0:1762167009.288144:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3628 committed 00000004:00080000:3.0:1762167009.288146:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3615 committed 00000004:00080000:3.0:1762167009.288147:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3614 committed 00000004:00080000:3.0:1762167009.288149:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3627 committed 00000004:00080000:3.0:1762167009.288151:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3613 committed 00000004:00080000:3.0:1762167009.288152:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3626 committed 00000004:00080000:3.0:1762167009.288154:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3625 committed 00000004:00080000:3.0:1762167009.288156:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3612 committed 00000020:00080000:3.0:1762167009.288193:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969186 batchid updated 00000100:00100000:3.0:1762167009.288234:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454491392:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1762167009.288257:0:33886:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003a80b871 reply state 00000000d1a28412 transno 8589953015 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167009.288282:0:33886:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762167009.288297:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00000100:00100000:3.0:1762167009.288298:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.288298:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454491520:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762167009.288312:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167009.288326:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b24c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c24 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.288340:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.288347:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454491904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.288381:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.288383:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454492032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.288413:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1762167009.288417:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969186 00000100:00100000:2.0:1762167009.288444:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454491392 00000100:00100000:2.0:1762167009.288451:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454491392 00000100:00100000:2.0:1762167009.288490:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454491520 00000100:00100000:2.0:1762167009.288494:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454491520 00000100:00100000:2.0:1762167009.288512:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454491904 00000100:00100000:2.0:1762167009.288516:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454491904 00010000:00080000:0.0:1762167009.288531:0:33886:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762167009.288532:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454492032 00000100:00100000:2.0:1762167009.288537:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454492032 00000100:00100000:0.0:1762167009.288554:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56213:x1847765451922176:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 18510us (18603us total) trans 8589953015 rc 0/0 00000100:00100000:2.0:1762167009.288562:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17088 00000100:00100000:2.0:1762167009.288572:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765454491392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.288589:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7365 00000020:00080000:3.0:1762167009.288600:0:30853:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969186 cancel update log [0x200000bd0:0x1:0x0].55: rc = 0 00000020:00080000:3.0:1762167009.288615:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969186 00000100:00100000:3.0:1762167009.288638:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17089 00000100:00100000:3.0:1762167009.288647:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454491520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.288690:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454491648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.288750:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167009.288794:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.288794:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167009.288800:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.288800:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167009.288805:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.288805:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167009.288807:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167009.288808:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.288810:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167009.288811:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.288854:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454492160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.288869:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454491392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 295us (569us total) trans 17179875897 rc 0/0 00000100:00100000:3.0:1762167009.288872:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454491520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 226us (534us total) trans 17179875898 rc 0/0 00000100:00100000:2.0:1762167009.288879:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17088 00000100:00100000:3.0:1762167009.288887:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17089 00000100:00100000:3.0:1762167009.288903:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454491648 00000100:00100000:3.0:1762167009.288908:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454491648 00000100:00100000:0.0:1762167009.288911:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.288913:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17090 00000100:00100000:2.0:1762167009.288928:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454491904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.288937:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454492160 00000100:00100000:1.0:1762167009.288937:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454491776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.288942:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454492160 00000100:00100000:0.0:1762167009.288953:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454492672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.288964:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17091 00000100:00100000:3.0:1762167009.288974:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454492032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.288994:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.289018:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454491776 00000100:00100000:0.0:1762167009.289027:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454491776 00000100:00100000:1.0:1762167009.289038:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454492288:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167009.289039:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:2.0:1762167009.289046:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.289048:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167009.289052:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.289054:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167009.289072:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17092 00000100:00100000:1.0:1762167009.289085:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167009.289086:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:3.0:1762167009.289094:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00000100:00100000:0.0:1762167009.289095:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454491648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.289107:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454491904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (720us total) trans 17179875899 rc 0/0 00000100:00100000:1.0:1762167009.289109:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454492800:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167009.289110:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167009.289116:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.289120:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167009.289123:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17090 00000100:00100000:2.0:1762167009.289141:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454492288 00000100:00100000:2.0:1762167009.289145:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454492288 00000100:00100000:1.0:1762167009.289152:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.289156:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454492032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (740us total) trans 17179875900 rc 0/0 00000100:00100000:3.0:1762167009.289163:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17091 00000100:00100000:2.0:1762167009.289168:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454492800 00000100:00100000:2.0:1762167009.289170:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454492800 00000100:00100000:1.0:1762167009.289177:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454493312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.289183:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17093 00000100:00100000:3.0:1762167009.289193:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454492160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.289196:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17094 00000100:00100000:2.0:1762167009.289204:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454491776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.289226:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.289269:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454493312 00000100:00100000:1.0:1762167009.289275:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454493312 00000100:00100000:1.0:1762167009.289302:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17095 00000100:00100000:1.0:1762167009.289314:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454492288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167009.289377:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.289377:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167009.289382:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:3.0:1762167009.289383:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.289383:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.289396:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.289397:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167009.289397:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167009.289407:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.289407:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.289410:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167009.289415:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167009.289415:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167009.289417:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.289424:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167009.289461:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3293:x1847765454492160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 267us (559us total) trans 17179875903 rc 0/0 00000100:00100000:2.0:1762167009.289465:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454491776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 261us (473us total) trans 17179875902 rc 0/0 00000100:00100000:3.0:1762167009.289472:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17093 00000100:00100000:2.0:1762167009.289478:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17094 00002000:00010000:1.0:1762167009.289485:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.289491:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00000100:00100000:0.0:1762167009.289493:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454491648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 406us (742us total) trans 17179875901 rc 0/0 00002000:00010000:1.0:1762167009.289503:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167009.289505:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17096 00002000:00010000:1.0:1762167009.289517:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00000100:00100000:3.0:1762167009.289522:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17097 00000100:00100000:2.0:1762167009.289522:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454492800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167009.289525:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167009.289532:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454493312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.289540:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17092 00000100:00100000:1.0:1762167009.289586:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454492288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 272us (500us total) trans 17179875904 rc 0/0 00000100:00100000:1.0:1762167009.289608:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17095 00002000:00010000:2.0:1762167009.289648:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:3.0:1762167009.289649:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 131446 -> 131446 00000100:00100000:1.0:1762167009.289653:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454492544:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167009.289654:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.289655:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.289661:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167009.289661:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167009.289665:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.289665:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.289668:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167009.289669:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167009.289694:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.289702:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765454493312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (492us total) trans 21474843450 rc 0/0 00000100:00100000:3.0:1762167009.289711:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17097 00000100:00100000:2.0:1762167009.289712:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765454492800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (551us total) trans 21474843451 rc 0/0 00000100:00100000:2.0:1762167009.289722:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17096 00000100:00100000:1.0:1762167009.289722:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454493056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.289735:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454492544 00000100:00100000:3.0:1762167009.289741:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454492544 00000100:00100000:1.0:1762167009.289810:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.289814:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17098 00010000:00010000:0.0:1762167009.289823:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167009.289825:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765454492544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.289843:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454493056 00010000:00010000:0.0:1762167009.289848:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167009.289851:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454493056 00000100:00100000:1.0:1762167009.289853:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875883 gen 2 00000004:00080000:1.0:1762167009.289865:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b04700, transno 17179875835 00010000:00010000:0.0:1762167009.289871:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00000004:00080000:1.0:1762167009.289880:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b05880, transno 17179875836 00010000:00010000:0.0:1762167009.289883:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc2129310) 00000004:00080000:1.0:1762167009.289889:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b07800, transno 17179875837 00010000:00010000:0.0:1762167009.289892:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00000004:00080000:1.0:1762167009.289898:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b06a00, transno 17179875838 00000100:00100000:2.0:1762167009.289899:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17099 00000004:00080000:1.0:1762167009.289907:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b06680, transno 17179875839 00000100:00100000:2.0:1762167009.289917:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454493056:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167009.289917:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d0000, transno 17179875840 00000004:00080000:1.0:1762167009.289925:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b04e00, transno 17179875841 00010000:00010000:0.0:1762167009.289926:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00000004:00080000:1.0:1762167009.289930:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d0700, transno 17179875842 00000004:00080000:1.0:1762167009.289939:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242408e00, transno 17179875843 00000004:00080000:1.0:1762167009.289947:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240b100, transno 17179875844 00000004:00080000:1.0:1762167009.289953:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180380, transno 17179875845 00000004:00080000:1.0:1762167009.289958:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180000, transno 17179875846 00010000:00010000:0.0:1762167009.289960:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00000004:00080000:1.0:1762167009.289963:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180e00, transno 17179875847 00010000:00010000:0.0:1762167009.289966:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:1.0:1762167009.289973:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e447800, transno 17179875848 00010000:00010000:0.0:1762167009.289975:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00000004:00080000:1.0:1762167009.289984:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce7800, transno 17179875849 00010000:00010000:0.0:1762167009.289988:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b3cd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00000004:00080000:1.0:1762167009.289992:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce5f80, transno 17179875850 00000004:00080000:1.0:1762167009.290001:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243181180, transno 17179875851 00000004:00080000:1.0:1762167009.290010:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e444e00, transno 17179875852 00000004:00080000:1.0:1762167009.290021:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180a80, transno 17179875853 00002000:00010000:2.0:1762167009.290022:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.290027:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00000004:00080000:1.0:1762167009.290028:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e447480, transno 17179875854 00002000:00010000:2.0:1762167009.290029:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167009.290033:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.290033:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00000004:00080000:1.0:1762167009.290036:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875860 committed transno 17179875883 00002000:00010000:2.0:1762167009.290040:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167009.290042:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.290046:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.290050:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.290053:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:1.0:1762167009.290073:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240ce00, transno 17179875861 00000004:00080000:1.0:1762167009.290079:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240c700, transno 17179875862 00000100:00100000:2.0:1762167009.290083:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454493056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (320us total) trans 21474843453 rc 0/0 00000004:00080000:1.0:1762167009.290084:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240c000, transno 17179875863 00000004:00080000:1.0:1762167009.290092:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240e300, transno 17179875864 00000100:00100000:2.0:1762167009.290095:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17099 00000004:00080000:1.0:1762167009.290097:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240c380, transno 17179875865 00000100:00100000:3.0:1762167009.290101:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454492544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 275us (404us total) trans 21474843452 rc 0/0 00000004:00080000:1.0:1762167009.290103:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24732fb80, transno 17179875866 00000004:00080000:1.0:1762167009.290108:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240e680, transno 17179875867 00000100:00100000:3.0:1762167009.290113:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17098 00000004:00080000:1.0:1762167009.290114:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24732f100, transno 17179875868 00000004:00080000:1.0:1762167009.290120:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243304e00, transno 17179875869 00000004:00080000:1.0:1762167009.290124:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243306a00, transno 17179875870 00000004:00080000:1.0:1762167009.290128:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242409880, transno 17179875871 00000004:00080000:1.0:1762167009.290132:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875872 committed transno 17179875883 00000004:00080000:1.0:1762167009.290144:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317ce00, transno 17179875873 00000004:00080000:1.0:1762167009.290147:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317c380, transno 17179875874 00000004:00080000:1.0:1762167009.290150:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b02300, transno 17179875875 00000004:00080000:1.0:1762167009.290152:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317d500, transno 17179875876 00000004:00080000:1.0:1762167009.290155:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317f800, transno 17179875877 00000004:00080000:1.0:1762167009.290158:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346a2fb80, transno 17179875878 00000004:00080000:1.0:1762167009.290160:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346a2f480, transno 17179875879 00000004:00080000:1.0:1762167009.290163:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346a2c700, transno 17179875880 00000004:00080000:1.0:1762167009.290166:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317f480, transno 17179875881 00000004:00080000:1.0:1762167009.290171:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b01c00, transno 17179875882 00000004:00080000:1.0:1762167009.290174:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34317d180, transno 17179875883 00000100:00100000:1.0:1762167009.290182:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36de00380 x1847765454491520/t17179875898(17179875898) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167025 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762167009.290192:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de00380/2, rc 0, transno 17179875898 00000100:00100000:1.0:1762167009.290197:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454491520:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167009.290214:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de02680/2, rc 0, transno 17179875900 00000100:00100000:1.0:1762167009.290218:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454492032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.290238:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843435 gen 2 00000004:00080000:1.0:1762167009.290242:0:3296:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843424 committed transno 21474843435 00000004:00080000:1.0:1762167009.290259:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550d500, transno 21474843425 00000004:00080000:1.0:1762167009.290282:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37ff82d80, transno 21474843426 00000004:00080000:1.0:1762167009.290287:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550e300, transno 21474843427 00000004:00080000:1.0:1762167009.290291:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550c700, transno 21474843428 00000004:00080000:1.0:1762167009.290294:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550ce00, transno 21474843429 00000004:00080000:1.0:1762167009.290298:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550ea00, transno 21474843430 00000004:00080000:1.0:1762167009.290302:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550dc00, transno 21474843431 00000004:00080000:1.0:1762167009.290306:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37ff83800, transno 21474843432 00000004:00080000:1.0:1762167009.290309:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34371aa00, transno 21474843433 00000004:00080000:1.0:1762167009.290312:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee343719180, transno 21474843434 00000004:00080000:1.0:1762167009.290316:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550f480, transno 21474843435 00000100:00100000:1.0:1762167009.290322:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee243305880 x1847765454492544/t21474843452(21474843452) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167025 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762167009.290329:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243305880/2, rc 0, transno 21474843452 00000100:00100000:1.0:1762167009.290335:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454492544:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167009.290352:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f330e00/2, rc 0, transno 21474843453 00000100:00100000:1.0:1762167009.290355:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454493056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.290365:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1762167009.290384:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454492416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.290410:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.290442:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454492928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.290469:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.290470:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454492416 00000100:00100000:2.0:1762167009.290476:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454492416 00000100:00100000:1.0:1762167009.290510:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454492928 00000100:00100000:2.0:1762167009.290514:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17100 00000100:00100000:1.0:1762167009.290515:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454492928 00000100:00100000:2.0:1762167009.290527:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454492416:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167009.290539:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 6 in flight, 11 done 00000100:00100000:1.0:1762167009.290550:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17101 00000100:00100000:1.0:1762167009.290561:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454492928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.290608:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454493568:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.290610:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 10 in progress, 6 in flight, 40 done 00000100:00100000:0.0:1762167009.290646:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.290677:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00010000:2.0:1762167009.290679:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:2.0:1762167009.290684:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.290687:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.290689:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.290695:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 187 -> 187 00000100:00100000:0.0:1762167009.290701:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454493440:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167009.290708:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.290712:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.290716:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167009.290718:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.290721:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.290749:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454492416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (335us total) trans 21474843454 rc 0/0 00000100:00100000:0.0:1762167009.290756:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.290790:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17100 00000100:00100000:1.0:1762167009.290794:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454492928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 233us (323us total) trans 21474843455 rc 0/0 00000100:00100000:1.0:1762167009.290803:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17101 00000100:00100000:2.0:1762167009.290814:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454493568 00000100:00100000:2.0:1762167009.290818:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454493568 00000100:00100000:1.0:1762167009.290825:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454493440 00000100:00100000:1.0:1762167009.290829:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454493440 00000004:00080000:0.0:1762167009.290835:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243306300/2, rc 0, transno 21474843454 00000100:00100000:0.0:1762167009.290844:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454492416:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.290849:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17102 00000100:00100000:1.0:1762167009.290857:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17103 00000100:00100000:2.0:1762167009.290861:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454493568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.290870:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454493440:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167009.290870:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f331180/2, rc 0, transno 21474843455 00000100:00100000:0.0:1762167009.290880:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454492928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.290901:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de02a00/2, rc 0, transno 17179875899 00000100:00100000:3.0:1762167009.290909:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454491904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167009.290923:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de02d80/2, rc 0, transno 17179875897 00000100:00100000:3.0:1762167009.290928:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454491392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.290947:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.290987:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454493184:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167009.290997:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:2.0:1762167009.291002:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.291004:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167009.291006:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.291009:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167009.291012:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167009.291018:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167009.291019:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.291024:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167009.291026:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.291029:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:3.0:1762167009.291053:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de00a80/2, rc 0, transno 17179875901 00000100:00100000:2.0:1762167009.291055:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454493568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (408us total) trans 21474843456 rc 0/0 00000100:00100000:3.0:1762167009.291061:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454491648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.291067:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17102 00000100:00100000:1.0:1762167009.291071:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454493440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (317us total) trans 21474843457 rc 0/0 00000100:00100000:0.0:1762167009.291072:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454492672 00000004:00080000:3.0:1762167009.291076:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03b80/2, rc 0, transno 17179875903 00000100:00100000:0.0:1762167009.291078:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454492672 00000100:00100000:3.0:1762167009.291085:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454492160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.291085:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454493184 00000100:00100000:1.0:1762167009.291087:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17103 00000100:00100000:2.0:1762167009.291091:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454493184 00000100:00100000:3.0:1762167009.291102:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454493696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.291105:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17104 00000100:00100000:0.0:1762167009.291114:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454492672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.291130:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.291133:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17105 00000100:00100000:2.0:1762167009.291146:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454493696 00000100:00100000:1.0:1762167009.291147:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454493184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.291149:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762167009.291152:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454493696 00000100:00100000:3.0:1762167009.291159:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454493824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.291181:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17106 00000100:00100000:3.0:1762167009.291186:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.291193:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454493696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.291214:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454493824 00000100:00100000:3.0:1762167009.291219:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454493824 00000100:00100000:3.0:1762167009.291244:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17107 00000100:00100000:3.0:1762167009.291252:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454493824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167009.291273:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:1.0:1762167009.291277:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.291279:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167009.291282:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.291285:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167009.291323:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167009.291325:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3293:x1847765454493184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 182us (308us total) trans 21474843458 rc 0/0 00002000:00010000:0.0:1762167009.291329:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.291336:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167009.291339:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 131446 -> 131446 00000100:00100000:1.0:1762167009.291339:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17105 00002000:00010000:0.0:1762167009.291341:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.291346:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.291347:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167009.291352:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167009.291357:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.291359:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00000004:00080000:1.0:1762167009.291399:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d69180/2, rc 0, transno 21474843458 00000100:00100000:0.0:1762167009.291404:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454492672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 290us (453us total) trans 21474843459 rc 0/0 00000100:00100000:1.0:1762167009.291408:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454493184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.291415:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454493696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (282us total) trans 17179875905 rc 0/0 00000100:00100000:0.0:1762167009.291417:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17104 00000100:00100000:2.0:1762167009.291429:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17106 00000004:00080000:1.0:1762167009.291431:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348257100/2, rc 0, transno 17179875905 00000100:00100000:1.0:1762167009.291437:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454493696:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167009.291441:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167009.291445:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.291448:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167009.291451:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.291453:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:0.0:1762167009.291456:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccea00/2, rc 0, transno 21474843457 00000004:00080000:1.0:1762167009.291459:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f332300/2, rc 0, transno 21474843459 00000100:00100000:0.0:1762167009.291462:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454493440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.291468:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454492672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167009.291480:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccc000/2, rc 0, transno 21474843456 00000100:00100000:0.0:1762167009.291485:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454493568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.291486:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454493824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (301us total) trans 17179875906 rc 0/0 00000004:00080000:1.0:1762167009.291488:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348254000/2, rc 0, transno 17179875906 00000100:00100000:1.0:1762167009.291498:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454493824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.291499:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17107 00000004:00080000:3.0:1762167009.291535:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03480/2, rc 0, transno 17179875902 00000100:00100000:3.0:1762167009.291540:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454491776:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167009.291548:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03100/2, rc 0, transno 17179875904 00000100:00100000:3.0:1762167009.291550:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454492288:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167009.291558:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f331c00/2, rc 0, transno 21474843451 00000100:00100000:3.0:1762167009.291559:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454492800:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.291566:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d69c00/2, rc 0, transno 21474843450 00000100:00100000:3.0:1762167009.291569:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454493312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.292240:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.292288:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922432 00000100:00100000:3.0:1762167009.292293:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922432 00000100:00100000:3.0:1762167009.292385:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19915 00000100:00100000:3.0:1762167009.292393:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56213:x1847765451922432:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.292407:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.292426:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b3d4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3cbe expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.292475:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cbe expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.292489:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cbe expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.292507:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167009.292510:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167009.292514:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:3.0:1762167009.292566:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56213:x1847765451922432:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 173us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.292573:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19915 00000100:00100000:1.0:1762167009.294812:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.294854:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922688 00000100:00100000:0.0:1762167009.294863:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922688 00000100:00100000:0.0:1762167009.294915:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7366 00000100:00100000:0.0:1762167009.294925:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56213:x1847765451922688:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167009.295163:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56213:x1847765451922688:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 239us (356us total) trans 8589953016 rc 0/0 00000100:00100000:0.0:1762167009.295171:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7366 00000100:00100000:0.0:1762167009.306170:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.306227:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451922816 00000100:00100000:3.0:1762167009.306238:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451922816 00000100:00100000:3.0:1762167009.306296:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19916 00000100:00100000:3.0:1762167009.306308:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56214:x1847765451922816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.306334:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.306352:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b3db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3cc5 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.306439:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b3e2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306457:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306469:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306483:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b3e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306489:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306496:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306606:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306625:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306633:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167009.306666:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:3.0:1762167009.306670:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.306687:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306698:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306706:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306711:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b3e2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306717:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306723:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167009.306727:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306735:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b3e2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306746:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167009.306754:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167009.306759:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b3e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306813:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b3e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306826:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306832:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306838:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306843:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167009.306846:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306850:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306857:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23500) 00010000:00010000:3.0:1762167009.306860:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167009.306862:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b3e9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306868:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b3e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.306900:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b3db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cc5 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.306912:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cc5 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.306923:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167009.306926:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.306928:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167009.306985:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56214:x1847765451922816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 680us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.306992:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19916 00000100:00100000:1.0:1762167009.309037:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.309083:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923072 00000100:00100000:3.0:1762167009.309092:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923072 00000100:00100000:3.0:1762167009.309140:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19917 00000100:00100000:3.0:1762167009.309150:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56214:x1847765451923072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.309167:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.309181:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b3f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ccc expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.309256:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3fe lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.309308:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.309320:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167009.309329:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:3.0:1762167009.309458:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b3f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ccc expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.309474:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ccc expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.309482:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167009.309485:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167009.309488:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:3.0:1762167009.309539:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56214:x1847765451923072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 390us (509us total) trans 8589953017 rc 0/0 00000100:00100000:3.0:1762167009.309546:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19917 00000100:00100000:1.0:1762167009.311444:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.311531:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923328 00000100:00100000:3.0:1762167009.311546:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923328 00000100:00100000:3.0:1762167009.311608:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19918 00000100:00100000:3.0:1762167009.311618:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56214:x1847765451923328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.311659:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.311675:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b40c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3cd3 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.311822:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b413 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.311853:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b413 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167009.311864:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b413 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167009.311884:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:3.0:1762167009.312042:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b40c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cd3 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.312061:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b413 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cd3 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.312077:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:3.0:1762167009.312080:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167009.312083:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922a00, rc 0) 00000100:00100000:3.0:1762167009.312157:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56214:x1847765451923328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 533us (714us total) trans 8589953018 rc 0/0 00000100:00100000:3.0:1762167009.312164:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19918 00000100:00100000:0.0:1762167009.340049:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.340154:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923456 00000100:00100000:3.0:1762167009.340165:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923456 00000100:00100000:3.0:1762167009.340240:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3020 00000100:00100000:3.0:1762167009.340251:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451923456:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167009.340287:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b421 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.340302:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.340305:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.340311:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b421 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.340324:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b421 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.341946:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b421 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.341959:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b421 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.341971:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b421 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.341977:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167009.341981:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b421 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.341990:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b421 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.342006:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b421 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.342012:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b421 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.342076:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451923456:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1824us (2036us total) trans 0 rc 131446/131446 00000100:00100000:3.0:1762167009.342085:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3020 00000100:00100000:1.0:1762167009.344047:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.344087:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923584 00000100:00100000:3.0:1762167009.344096:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923584 00000100:00100000:3.0:1762167009.344164:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3021 00000100:00100000:3.0:1762167009.344172:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765451923584:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167009.344199:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.344213:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b2f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c4e expref: 35 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.344222:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.344224:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.344227:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.344259:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c4e expref: 35 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.344274:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b2f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c4e expref: 35 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.344289:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454493952:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167009.344362:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720300 going to sleep for 11 seconds 00000100:00100000:3.0:1762167009.345526:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454493952:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.345548:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.346226:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.346314:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923712 00000100:00100000:0.0:1762167009.346321:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923712 00010000:00010000:0.0:1762167009.346352:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b2f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c4e expref: 36 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.346401:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7561 00000100:00100000:0.0:1762167009.346411:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451923712:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.346428:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.346452:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b2f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c4e expref: 36 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.346465:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c4e expref: 36 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.346488:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b2f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c4e expref: 36 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.346503:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.346505:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.346509:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.346518:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.346544:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.346566:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.346577:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.346583:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451923712:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.346595:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7561 00010000:00010000:3.0:1762167009.348246:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.348267:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.348275:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.348282:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167009.348286:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.348295:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.348310:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.348316:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b428 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.348395:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765451923584:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4220us (4351us total) trans 0 rc 131446/131446 00000100:00100000:3.0:1762167009.348404:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3021 00000100:00100000:1.0:1762167009.351191:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.351251:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923840 00000100:00100000:3.0:1762167009.351261:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923840 00000100:00100000:3.0:1762167009.351334:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3022 00000100:00100000:3.0:1762167009.351345:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2358:x1847765451923840:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167009.351421:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.351441:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c5c expref: 30 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.351449:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.351451:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.351454:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.351500:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c5c expref: 30 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.351517:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c5c expref: 30 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.351532:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454494080:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167009.351613:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720300 going to sleep for 11 seconds 00000100:00100000:3.0:1762167009.353005:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454494080:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.353032:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.353074:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.353118:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451923968 00000100:00100000:0.0:1762167009.353124:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451923968 00010000:00010000:0.0:1762167009.353151:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c5c expref: 31 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.353189:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7562 00000100:00100000:0.0:1762167009.353198:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451923968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.353210:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.353232:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b310 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c5c expref: 31 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.353245:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c5c expref: 31 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.353265:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b310 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c5c expref: 31 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.353279:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.353281:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.353285:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.353294:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.353319:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167009.353361:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451923968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.353381:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7562 00010000:00010000:3.0:1762167009.353652:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.353665:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.355117:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.355130:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.355136:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.355140:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167009.355143:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.355148:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.355158:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.355162:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b42f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.355218:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451923840:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3874us (4033us total) trans 0 rc 131446/131446 00000100:00100000:3.0:1762167009.355226:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3022 00000100:00100000:1.0:1762167009.357669:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.357725:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924096 00000100:00100000:3.0:1762167009.357735:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924096 00000100:00100000:3.0:1762167009.357836:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3023 00000100:00100000:3.0:1762167009.357847:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451924096:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167009.357881:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.357898:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b32c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c6a expref: 34 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.357906:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.357908:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.357912:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.357946:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b32c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c6a expref: 34 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.357958:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b32c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c6a expref: 34 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.357973:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454494208:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167009.358057:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720300 going to sleep for 11 seconds 00000100:00100000:3.0:1762167009.359164:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454494208:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.359188:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.359335:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.359465:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924224 00000100:00100000:0.0:1762167009.359472:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924224 00010000:00010000:0.0:1762167009.359499:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b32c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c6a expref: 35 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.359535:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7563 00000100:00100000:0.0:1762167009.359555:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451924224:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.359569:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.359590:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b32c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c6a expref: 35 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.359601:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b32c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c6a expref: 35 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.359621:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b32c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c6a expref: 35 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.359635:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.359636:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.359639:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.359646:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.359670:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.359695:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.359705:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451924224:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 160us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.359721:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7563 00010000:00010000:3.0:1762167009.359722:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.361836:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.361852:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.361861:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.361867:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.361871:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.361879:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.361901:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.361908:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b436 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.362047:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451924096:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4199us (4382us total) trans 0 rc 131446/131446 00000100:00100000:2.0:1762167009.362057:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3023 00000100:00100000:1.0:1762167009.364639:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.364737:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924352 00000100:00100000:2.0:1762167009.364747:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924352 00000100:00100000:2.0:1762167009.364841:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3024 00000100:00100000:2.0:1762167009.364852:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451924352:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167009.364891:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.364912:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b348 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c78 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.364920:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.364923:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.364926:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.364970:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c78 expref: 33 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.364993:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b348 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c78 expref: 33 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.365008:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454494336:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.365088:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.367172:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454494336:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.367198:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.367267:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.367395:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924480 00000100:00100000:0.0:1762167009.367402:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924480 00010000:00010000:0.0:1762167009.367435:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b348 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c78 expref: 34 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.367477:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7564 00000100:00100000:0.0:1762167009.367487:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451924480:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.367500:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.367522:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b348 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c78 expref: 34 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.367535:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c78 expref: 34 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.367563:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b348 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c78 expref: 34 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.367577:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.367578:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.367582:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.367597:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.367625:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167009.367645:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.367653:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.367676:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451924480:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 190us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.367685:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7564 00010000:00010000:2.0:1762167009.369442:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.369460:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.369468:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.369475:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.369479:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.369488:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.369504:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.369511:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b43d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.369596:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451924352:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4743us (4964us total) trans 0 rc 131446/131446 00000100:00100000:2.0:1762167009.369606:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3024 00000100:00100000:1.0:1762167009.372120:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.372170:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924608 00000100:00100000:2.0:1762167009.372179:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924608 00000100:00100000:2.0:1762167009.372259:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3025 00000100:00100000:2.0:1762167009.372271:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451924608:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167009.372309:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.372327:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b364 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c86 expref: 29 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.372334:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.372337:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.372340:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.372388:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b364 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c86 expref: 29 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.372398:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b364 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c86 expref: 29 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.372409:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454494464:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.372475:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.374270:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454494464:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167009.374272:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167009.374299:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.374343:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924736 00000100:00100000:1.0:1762167009.374351:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924736 00010000:00010000:1.0:1762167009.374394:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b364 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c86 expref: 30 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167009.374435:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7565 00000100:00100000:1.0:1762167009.374452:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451924736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167009.374470:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167009.374492:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b364 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c86 expref: 30 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.374504:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b364 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c86 expref: 30 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.374528:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b364 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c86 expref: 30 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.374543:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.374545:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.374549:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.374558:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.374583:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167009.374607:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.374618:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.374636:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451924736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 191us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.374645:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7565 00010000:00010000:2.0:1762167009.375851:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.375866:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.375874:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.375886:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.375890:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.375899:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.375919:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.375925:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b444 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.376004:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451924608:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3733us (3887us total) trans 0 rc 131446/131446 00000100:00100000:2.0:1762167009.376014:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3025 00000100:00100000:1.0:1762167009.378185:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.378309:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924864 00000100:00100000:2.0:1762167009.378318:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924864 00000100:00100000:2.0:1762167009.378404:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3026 00000100:00100000:2.0:1762167009.378415:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451924864:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167009.378448:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.378467:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b380 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c94 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.378481:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.378483:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.378486:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.378518:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b380 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c94 expref: 28 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.378531:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b380 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c94 expref: 28 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.378545:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454494592:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.378623:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.379809:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454494592:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.379832:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.379992:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.380050:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451924992 00000100:00100000:2.0:1762167009.380056:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451924992 00010000:00010000:2.0:1762167009.380084:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b380 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c94 expref: 29 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.380114:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7566 00000100:00100000:2.0:1762167009.380123:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451924992:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.380135:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.380157:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b380 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c94 expref: 29 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.380168:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b380 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c94 expref: 29 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.380187:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b380 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c94 expref: 29 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.380201:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.380203:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.380207:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.380215:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.380248:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.380288:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451924992:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 167us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.380297:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7566 00010000:00010000:0.0:1762167009.380329:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.380340:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.381685:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.381700:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.381710:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.381716:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.381721:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.381729:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.381746:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.381753:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b44b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.381889:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451924864:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3473us (3708us total) trans 0 rc 131446/131446 00000100:00100000:0.0:1762167009.381899:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3026 00000100:00100000:1.0:1762167009.384071:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.384117:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925120 00000100:00100000:0.0:1762167009.384128:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925120 00000100:00100000:0.0:1762167009.384193:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3027 00000100:00100000:0.0:1762167009.384204:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451925120:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167009.384236:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.384252:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b39c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca2 expref: 32 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.384260:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167009.384262:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167009.384266:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.384300:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b39c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca2 expref: 32 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.384320:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca2 expref: 32 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.384334:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454494720:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.384420:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.387473:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454494720:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.387500:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.388011:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.388060:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925248 00000100:00100000:2.0:1762167009.388067:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925248 00010000:00010000:2.0:1762167009.388103:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca2 expref: 33 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.388146:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7567 00000100:00100000:2.0:1762167009.388156:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451925248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.388173:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.388192:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca2 expref: 33 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.388201:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b39c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca2 expref: 33 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.388218:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b39c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ca2 expref: 33 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.388229:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.388230:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.388233:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.388241:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.388273:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167009.388307:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.388318:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.388332:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451925248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 177us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.388338:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7567 00010000:00010000:0.0:1762167009.390939:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.390955:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.390962:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.390968:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.390972:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.390979:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.390993:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.391000:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b452 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.391084:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451925120:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6879us (7016us total) trans 0 rc 131446/131446 00000100:00100000:0.0:1762167009.391095:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3027 00000100:00100000:3.0:1762167009.393985:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.394031:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925376 00000100:00100000:0.0:1762167009.394042:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925376 00000100:00100000:0.0:1762167009.394120:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3028 00000100:00100000:0.0:1762167009.394131:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451925376:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167009.394166:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.394185:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b3b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb0 expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.394193:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167009.394195:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167009.394199:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.394233:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b3b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb0 expref: 27 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.394245:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b3b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb0 expref: 27 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.394265:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454494848:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.394360:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.395858:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454494848:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.395884:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.396066:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.396114:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925504 00000100:00100000:0.0:1762167009.396120:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925504 00010000:00010000:0.0:1762167009.396150:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b3b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb0 expref: 28 pid: 7858 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.396185:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7568 00000100:00100000:0.0:1762167009.396194:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451925504:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.396206:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.396224:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b3b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb0 expref: 28 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.396248:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b3b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb0 expref: 28 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.396270:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b3b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb0 expref: 28 pid: 7858 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.396287:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.396290:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.396294:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.396303:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.396330:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167009.396378:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.396386:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451925504:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 191us (321us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167009.396401:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.396403:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7568 00010000:00010000:1.0:1762167009.398078:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.398093:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.398110:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.398117:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167009.398121:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.398130:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.398146:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.398153:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b459 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.398238:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451925376:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4107us (4261us total) trans 0 rc 131446/131446 00000100:00100000:1.0:1762167009.398249:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3028 00000100:00100000:3.0:1762167009.406245:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.406654:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925632 00000100:00100000:0.0:1762167009.406665:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925632 00000100:00100000:0.0:1762167009.406740:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 655 00000100:00100000:0.0:1762167009.406752:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56214:x1847765451925632:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:0.0:1762167009.406794:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.406823:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b413 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cd3 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.406854:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:0.0:1762167009.406859:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167009.406922:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56214:x1847765451925632:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 171us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.406931:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 655 00000100:00100000:2.0:1762167009.408833:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.408895:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451925888 00000100:00100000:0.0:1762167009.408912:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451925888 00000100:00100000:0.0:1762167009.408987:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7367 00000100:00100000:0.0:1762167009.409000:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56214:x1847765451925888:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167009.409309:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56214:x1847765451925888:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 312us (482us total) trans 8589953019 rc 0/0 00000100:00100000:0.0:1762167009.409318:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7367 00000100:00100000:1.0:1762167009.411587:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.411684:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926144 00000100:00100000:3.0:1762167009.411695:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926144 00000100:00100000:3.0:1762167009.411755:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19919 00000100:00100000:3.0:1762167009.411801:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451926144:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167009.411826:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167009.411893:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b460 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3cda expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.412035:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.412055:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cc5 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.412063:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.412099:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cc5 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.412113:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cc5 expref: 897 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.412126:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2443c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454494976:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.412200:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.413435:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2443c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454494976:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.413458:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167009.413864:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.413917:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926272 00000100:00100000:0.0:1762167009.413924:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926272 00010000:00010000:0.0:1762167009.413952:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cc5 expref: 898 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.413992:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7569 00000100:00100000:0.0:1762167009.414003:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451926272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.414016:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.414023:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cc5 expref: 898 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.414034:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cc5 expref: 898 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.414055:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b3f0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cc5 expref: 898 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.414071:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:0.0:1762167009.414076:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.414085:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.414092:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.414118:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167009.414152:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167009.414157:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451926272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (295us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167009.414167:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167009.414169:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7569 00000004:00200000:2.0:1762167009.414191:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00010000:00010000:2.0:1762167009.414327:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b460 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cda expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.414342:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cda expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.414351:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:2.0:1762167009.414354:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167009.414357:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:2.0:1762167009.414406:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451926144:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2643us (2828us total) trans 8589953020 rc 0/0 00000100:00100000:2.0:1762167009.414414:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19919 00000100:00100000:1.0:1762167009.416122:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.416177:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926400 00000100:00100000:2.0:1762167009.416186:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926400 00000100:00100000:2.0:1762167009.416244:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19920 00000100:00100000:2.0:1762167009.416254:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451926400:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167009.416275:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167009.416292:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b475 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ce1 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.416377:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.416391:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cda expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.416399:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.416433:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cda expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.416445:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cda expref: 898 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.416458:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2443c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454495104:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.416534:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.418095:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2443c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454495104:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.418120:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167009.418331:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.418419:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926528 00000100:00100000:0.0:1762167009.418428:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926528 00010000:00010000:0.0:1762167009.418460:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cda expref: 899 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.418503:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7570 00000100:00100000:0.0:1762167009.418513:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2361:x1847765451926528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167009.418527:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.418540:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cda expref: 899 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.418553:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cda expref: 899 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.418573:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b467 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cda expref: 899 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.418585:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:0.0:1762167009.418588:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.418594:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.418603:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.418626:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167009.418662:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451926528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 152us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.418668:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7570 00010000:00010000:2.0:1762167009.418737:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.418745:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167009.418818:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:2.0:1762167009.418824:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167009.418845:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.418874:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b475 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce1 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.418888:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce1 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.418895:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:2.0:1762167009.418897:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167009.418899:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167009.418940:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451926400:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2688us (2826us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.418950:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19920 00000100:00100000:1.0:1762167009.420556:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.420632:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926656 00000100:00100000:3.0:1762167009.420638:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926656 00000100:00100000:3.0:1762167009.420692:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17108 00000100:00100000:3.0:1762167009.420702:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451926656:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167009.420717:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.420744:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b483 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ce8 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167009.420793:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 131446, mtime: 0x690888e1, atime: 0x690888de, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:3.0:1762167009.420812:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.420814:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.420822:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce8 expref: 27 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167009.420843:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce8 expref: 27 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167009.420856:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:3.0:1762167009.420908:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451926656:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 207us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.420915:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17108 00000100:00100000:3.0:1762167009.422901:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.423695:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926784 00000100:00100000:0.0:1762167009.423706:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926784 00000100:00100000:0.0:1762167009.423757:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17109 00000100:00100000:0.0:1762167009.423783:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451926784:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167009.423803:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.423821:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3cef expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.423870:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b483 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce8 expref: 28 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167009.423879:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.423881:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.423885:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.423919:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce8 expref: 28 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167009.423933:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce8 expref: 28 pid: 12402 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1762167009.423948:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454495232:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.424033:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.425330:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454495232:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.425358:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.425389:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167009.425394:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167009.425450:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56065:x1847765451926784:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1668us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.425456:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17109 00000100:00100000:2.0:1762167009.425558:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451926912 00000100:00100000:2.0:1762167009.425565:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451926912 00010000:00010000:2.0:1762167009.425592:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce8 expref: 28 pid: 12402 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.425629:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7571 00000100:00100000:2.0:1762167009.425638:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3482c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451926912:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.425651:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.425672:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce8 expref: 28 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.425683:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce8 expref: 28 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.425708:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b483 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce8 expref: 28 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.425723:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.425725:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.425731:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.425740:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.425809:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.425822:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2443c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454495360:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167009.425877:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.427178:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2443c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454495360:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167009.427198:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.427248:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3482c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451926912:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1610us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.427260:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7571 00000100:00100000:3.0:1762167009.427324:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.427489:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451927040 00000100:00100000:0.0:1762167009.427496:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451927040 00002000:00100000:0.0:1762167009.427532:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x81c:0x0] (24576->28671) req@ffff9ee2477d0700 x1847765451927040/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/0 e 0 to 0 dl 1762167020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.427552:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d0700 with x1847765451927040 ext(24576->28671) 00002000:00010000:0.0:1762167009.427557:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d0700 00000100:00100000:0.0:1762167009.427581:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3029 00000100:00100000:0.0:1762167009.427594:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451927040:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167009.427789:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451927040:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 196us (466us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167009.427797:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3029 00002000:00100000:0.0:1762167009.427804:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x81c:0x0] (24576->28671) req@ffff9ee2477d0700 x1847765451927040/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/4536 e 0 to 0 dl 1762167020 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.427819:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d0700 with x1847765451927040 ext(24576->28671) 00002000:00010000:0.0:1762167009.427822:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d0700 00000100:00100000:3.0:1762167009.429269:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.429330:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451927296 00000100:00100000:0.0:1762167009.429337:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451927296 00000100:00100000:0.0:1762167009.429392:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7368 00000100:00100000:0.0:1762167009.429404:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451927296:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167009.429624:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451927296:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 222us (361us total) trans 8589953021 rc 0/0 00000100:00100000:0.0:1762167009.429632:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7368 00000100:00100000:2.0:1762167009.430727:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.430841:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451927552 00000100:00100000:0.0:1762167009.430847:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451927552 00000100:00100000:0.0:1762167009.430885:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19921 00000100:00100000:0.0:1762167009.430894:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451927552:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167009.430910:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.430914:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762167009.430937:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0b47c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ce1 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.430957:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b3fe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ccc expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.430968:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b3d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cbe expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.430979:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23e00) 00010000:00010000:0.0:1762167009.430988:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167009.431001:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b491 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3cf6 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.431041:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b498 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.431053:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b498 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.431062:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b498 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:0.0:1762167009.431557:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5515, 88 off445600 00000004:00080000:0.0:1762167009.431566:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630223803038ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167009.431616:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5523, 88 off446656 00000004:00080000:0.0:1762167009.431620:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630223857618ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167009.431651:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5524, 88 off446744 00000004:00080000:0.0:1762167009.431654:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630223891855ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167009.431668:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5516, 88 off445688 00000004:00080000:0.0:1762167009.431672:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630223908912ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167009.431687:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5525, 88 off446832 00000004:00080000:0.0:1762167009.431691:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630223927955ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167009.431804:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5517, 88 off445776 00000004:00080000:0.0:1762167009.431809:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630224046622ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167009.431837:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5518, 88 off445864 00000004:00080000:0.0:1762167009.431841:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630224077950ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167009.431857:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5526, 88 off446920 00000004:00080000:0.0:1762167009.431862:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630224098755ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167009.431883:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5527, 88 off447008 00000004:00080000:0.0:1762167009.431887:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630224124782ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167009.431902:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5519, 88 off445952 00000004:00080000:0.0:1762167009.431905:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630224142808ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167009.431933:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5528, 88 off447096 00000004:00080000:0.0:1762167009.431937:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630224174055ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167009.431962:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5520, 88 off446040 00000004:00080000:0.0:1762167009.431967:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630224203812ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167009.431981:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5521, 88 off446128 00000004:00080000:0.0:1762167009.431984:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630224221875ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167009.432002:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5529, 88 off447184 00000004:00080000:0.0:1762167009.432005:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630224242667ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167009.432028:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5522, 88 off446216 00000004:00080000:0.0:1762167009.432032:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630224268920ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167009.432068:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5530, 88 off447272 00000004:00080000:0.0:1762167009.432071:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630224308728ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167009.432095:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5531, 88 off447360 00000004:00080000:0.0:1762167009.432100:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630224337206ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167009.432123:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5523, 88 off446304 00000004:00080000:0.0:1762167009.432126:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630224363826ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167009.432147:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5524, 88 off446392 00000004:00080000:0.0:1762167009.432151:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630224388470ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167009.432170:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5532, 88 off447448 00000004:00080000:0.0:1762167009.432173:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630224410860ns, next at 630703976179ns, rc = 0 00000001:00080000:3.0:1762167009.444540:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953022 is committed 00010000:00010000:0.0:1762167009.444551:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b498 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cf6 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762167009.444559:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3644 committed 00010000:00010000:0.0:1762167009.444574:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477eff00) 00010000:00010000:0.0:1762167009.444578:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:3.0:1762167009.444586:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3631 committed 00000004:00080000:3.0:1762167009.444601:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3630 committed 00010000:00010000:0.0:1762167009.444602:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b491 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cf6 expref: 897 pid: 30819 timeout: 0 lvb_type: 3 00000004:00080000:3.0:1762167009.444610:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3643 committed 00000004:00080000:3.0:1762167009.444620:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3642 committed 00000004:00080000:3.0:1762167009.444630:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3629 committed 00000004:00080000:3.0:1762167009.444636:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3641 committed 00000004:00080000:3.0:1762167009.444643:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3628 committed 00010000:00010000:0.0:1762167009.444643:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b498 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cf6 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762167009.444656:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3627 committed 00000004:00080000:3.0:1762167009.444667:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3640 committed 00000004:00080000:3.0:1762167009.444674:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3626 committed 00000004:00080000:3.0:1762167009.444678:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3639 committed 00000004:00080000:3.0:1762167009.444683:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3638 committed 00010000:00010000:0.0:1762167009.444688:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477eff00) 00000004:00080000:3.0:1762167009.444691:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3625 committed 00010000:00010000:0.0:1762167009.444695:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:3.0:1762167009.444699:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3624 committed 00010000:00010000:0.0:1762167009.444702:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000004:00080000:3.0:1762167009.444707:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3637 committed 00000004:00080000:3.0:1762167009.444714:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3623 committed 00000004:00080000:3.0:1762167009.444720:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3636 committed 00000004:00080000:3.0:1762167009.444724:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3635 committed 00000004:00080000:3.0:1762167009.444733:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3622 committed 00000100:00100000:0.0:1762167009.444845:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451927552:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 13937us (14107us total) trans 8589953022 rc 0/0 00000100:00100000:0.0:1762167009.444859:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19921 00000100:00100000:2.0:1762167009.444865:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454495744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.444884:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2443cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454495488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.444929:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.444975:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454496384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.444976:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454495744 00000100:00100000:3.0:1762167009.444979:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.444986:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454495744 00000100:00100000:1.0:1762167009.445025:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454495488 00000100:00100000:1.0:1762167009.445031:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454495488 00000100:00100000:2.0:1762167009.445039:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.445042:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17110 00000100:00100000:3.0:1762167009.445046:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454495616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.445058:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454495744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.445062:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454496384 00000100:00100000:1.0:1762167009.445067:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454496384 00002000:00010000:0.0:1762167009.445247:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167009.445251:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.445253:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.445255:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.445258:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.445348:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454496896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.445359:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17111 00000100:00100000:0.0:1762167009.445361:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3296:x1847765454495744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (367us total) trans 21474843460 rc 0/0 00000100:00100000:3.0:1762167009.445364:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.445385:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454495488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.445394:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17110 00000100:00100000:2.0:1762167009.445408:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454495872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.445437:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454496128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.445449:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.445488:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.445500:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454496256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.445541:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454496640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.445557:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167009.445561:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.445565:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167009.445569:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167009.445571:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167009.445574:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.445590:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454496768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.445599:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.445633:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454497152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.445636:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454495488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 252us (668us total) trans 17179875907 rc 0/0 00000100:00100000:0.0:1762167009.445636:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454495616 00000100:00100000:2.0:1762167009.445644:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.445645:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454495616 00000100:00100000:1.0:1762167009.445649:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17111 00000100:00100000:2.0:1762167009.445667:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454497408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.445669:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454495872 00000100:00100000:1.0:1762167009.445673:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454495872 00000100:00100000:0.0:1762167009.445682:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454496128 00000100:00100000:3.0:1762167009.445689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.445690:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454496128 00000100:00100000:1.0:1762167009.445699:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454496256 00000100:00100000:1.0:1762167009.445705:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454496256 00000100:00100000:2.0:1762167009.445708:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.445731:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454496640 00000100:00100000:1.0:1762167009.445734:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454496768 00000100:00100000:0.0:1762167009.445736:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454496640 00000100:00100000:1.0:1762167009.445739:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454496768 00000100:00100000:2.0:1762167009.445747:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1762167009.445754:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454496000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.445802:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454497152 00000100:00100000:1.0:1762167009.445806:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454497152 00000100:00100000:0.0:1762167009.445811:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454497408 00000100:00100000:0.0:1762167009.445816:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454497408 00000004:00080000:3.0:1762167009.445818:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2443cbb80/2, rc 0, transno 17179875907 00000100:00100000:2.0:1762167009.445821:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.445829:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17112 00000100:00100000:1.0:1762167009.445838:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454496384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.445843:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454496000 00000100:00100000:3.0:1762167009.445848:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2443cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454495488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.445850:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454496000 00000100:00100000:2.0:1762167009.445877:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454496512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.445910:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17113 00000100:00100000:2.0:1762167009.445917:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.445922:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454495616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.445935:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454497024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.445963:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.445991:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454496512 00000100:00100000:2.0:1762167009.445994:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454496512 00000100:00100000:1.0:1762167009.445994:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454496384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (957us total) trans 21474843461 rc 0/0 00000100:00100000:1.0:1762167009.446000:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17112 00000100:00100000:1.0:1762167009.446012:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454497024 00000100:00100000:2.0:1762167009.446015:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17114 00000100:00100000:1.0:1762167009.446015:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454497024 00000100:00100000:2.0:1762167009.446022:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454495872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.446030:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17115 00000100:00100000:1.0:1762167009.446038:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3295:x1847765454496128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167009.446071:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:0.0:1762167009.446076:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.446078:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.446082:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.446085:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 187 -> 187 00000100:00100000:3.0:1762167009.446095:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17116 00000100:00100000:3.0:1762167009.446114:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454496256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.446138:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454495616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 218us (1037us total) trans 21474843462 rc 0/0 00002000:00010000:2.0:1762167009.446147:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.446147:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167009.446148:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17113 00002000:00010000:2.0:1762167009.446155:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.446155:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.446158:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167009.446159:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.446162:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.446162:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.446164:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.446165:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.446171:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17117 00000100:00100000:0.0:1762167009.446185:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1847765454496640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.446200:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454495872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (755us total) trans 17179875908 rc 0/0 00000100:00100000:1.0:1762167009.446200:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3295:x1847765454496128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (717us total) trans 21474843463 rc 0/0 00000100:00100000:1.0:1762167009.446207:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17115 00000100:00100000:2.0:1762167009.446209:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17114 00000100:00100000:2.0:1762167009.446220:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17118 00000100:00100000:1.0:1762167009.446224:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17119 00000100:00100000:2.0:1762167009.446228:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454496768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.446230:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454497152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167009.446319:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167009.446323:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.446325:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167009.446328:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.446331:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.446382:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454496640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (781us total) trans 21474843464 rc 0/0 00000100:00100000:0.0:1762167009.446391:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17117 00000100:00100000:0.0:1762167009.446413:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17120 00000100:00100000:2.0:1762167009.446414:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454496768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (771us total) trans 17179875909 rc 0/0 00000100:00100000:1.0:1762167009.446415:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3295:x1847765454497152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (730us total) trans 21474843465 rc 0/0 00000100:00100000:2.0:1762167009.446427:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17118 00000100:00100000:0.0:1762167009.446428:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454497408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.446434:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17119 00000100:00100000:2.0:1762167009.446444:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17121 00000100:00100000:1.0:1762167009.446449:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17122 00000100:00100000:2.0:1762167009.446454:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454496000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.446455:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454496512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167009.446526:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167009.446531:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.446535:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167009.446538:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.446540:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167009.446595:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454496256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 486us (1038us total) trans 17179875910 rc 0/0 00000100:00100000:3.0:1762167009.446607:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17116 00002000:00010000:0.0:1762167009.446628:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:0.0:1762167009.446634:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.446638:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167009.446641:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.446644:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167009.446648:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17123 00000100:00100000:2.0:1762167009.446657:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454496000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (834us total) trans 17179875912 rc 0/0 00000100:00100000:1.0:1762167009.446657:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454496512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (747us total) trans 17179875911 rc 0/0 00000100:00100000:3.0:1762167009.446668:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454497024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.446669:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17121 00000100:00100000:1.0:1762167009.446681:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17122 00000100:00100000:0.0:1762167009.446687:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454497408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 263us (978us total) trans 21474843466 rc 0/0 00000100:00100000:0.0:1762167009.446698:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17120 00000004:00080000:2.0:1762167009.446728:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b04e00/2, rc 0, transno 17179875912 00000100:00100000:2.0:1762167009.446738:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454496000:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.446752:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc4e00/2, rc 0, transno 17179875911 00000100:00100000:2.0:1762167009.446757:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454496512:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.446818:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b06680/2, rc 0, transno 17179875908 00000100:00100000:2.0:1762167009.446825:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454495872:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.446848:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc4700/2, rc 0, transno 17179875910 00000100:00100000:2.0:1762167009.446853:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454496256:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167009.446859:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167009.446866:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00000004:00080000:2.0:1762167009.446866:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc5c00/2, rc 0, transno 17179875909 00002000:00010000:3.0:1762167009.446877:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167009.446883:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454496768:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167009.446885:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.446897:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:2.0:1762167009.446912:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258e00/2, rc 0, transno 21474843466 00000100:00100000:2.0:1762167009.446930:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454497408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.446950:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454497024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 287us (984us total) trans 17179875913 rc 0/0 00000004:00080000:2.0:1762167009.446961:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc6680/2, rc 0, transno 17179875913 00000100:00100000:3.0:1762167009.446962:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17123 00000100:00100000:2.0:1762167009.446978:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454497024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.447033:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454497536:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.447087:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.447107:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454497664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.447158:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.447160:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454497536 00000100:00100000:1.0:1762167009.447169:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454497536 00000100:00100000:2.0:1762167009.447212:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454497664 00000100:00100000:2.0:1762167009.447218:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454497664 00000100:00100000:1.0:1762167009.447231:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17124 00000004:00080000:3.0:1762167009.447234:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28000/2, rc 0, transno 21474843462 00000100:00100000:1.0:1762167009.447247:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454497536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.447261:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454495616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.447263:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17125 00000100:00100000:2.0:1762167009.447275:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3295:x1847765454497664:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167009.447445:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc2ad80/2, rc 0, transno 21474843463 00002000:00010000:1.0:1762167009.447448:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.447455:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00000100:00100000:3.0:1762167009.447457:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454496128:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167009.447461:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167009.447466:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454497664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (307us total) trans 17179875914 rc 0/0 00002000:00010000:1.0:1762167009.447468:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.447473:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.447474:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17125 00000004:00080000:3.0:1762167009.447481:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825a300/2, rc 0, transno 21474843464 00000100:00100000:3.0:1762167009.447493:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454496640:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.447520:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825b800/2, rc 0, transno 21474843465 00000100:00100000:3.0:1762167009.447528:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454497152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.447540:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454497536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 294us (447us total) trans 21474843467 rc 0/0 00000100:00100000:1.0:1762167009.447553:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17124 00000004:00080000:2.0:1762167009.447555:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34825a680/2, rc 0, transno 21474843467 00000100:00100000:2.0:1762167009.447561:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34825a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454497536:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.447569:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180a80/2, rc 0, transno 17179875914 00000100:00100000:3.0:1762167009.447579:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454497664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.447594:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1762167009.447600:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454497792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.447633:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.447674:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454497792 00000100:00100000:1.0:1762167009.447681:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454497792 00000100:00100000:3.0:1762167009.447694:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.447731:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee374ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454497280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.447738:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454496896 00000100:00100000:1.0:1762167009.447745:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454496896 00000100:00100000:2.0:1762167009.447753:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17126 00000100:00100000:2.0:1762167009.447795:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454497792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.447820:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17127 00000100:00100000:0.0:1762167009.447838:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454496896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.447847:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.447897:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454497280 00000100:00100000:1.0:1762167009.447904:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454497280 00000004:00080000:3.0:1762167009.447915:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28e00/2, rc 0, transno 21474843460 00000100:00100000:3.0:1762167009.447926:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454495744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.447949:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17128 00000004:00080000:3.0:1762167009.447957:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc2b800/2, rc 0, transno 21474843461 00002000:00010000:2.0:1762167009.447964:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167009.447969:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3296:x1847765454497280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167009.447971:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00000100:00100000:3.0:1762167009.447975:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454496384:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167009.447980:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167009.447995:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.448001:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1762167009.448046:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167009.448050:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.448053:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167009.448056:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00000100:00100000:2.0:1762167009.448062:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454497792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 297us (425us total) trans 17179875915 rc 0/0 00002000:00010000:0.0:1762167009.448062:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.448074:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17126 00000100:00100000:3.0:1762167009.448104:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1762167009.448123:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24732fb80/2, rc 0, transno 17179875915 00000100:00100000:3.0:1762167009.448125:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454497920:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167009.448130:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167009.448131:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454497792:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167009.448143:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00000100:00100000:0.0:1762167009.448143:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454496896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 300us (445us total) trans 21474843468 rc 0/0 00002000:00010000:1.0:1762167009.448150:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167009.448154:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00000100:00100000:0.0:1762167009.448159:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17127 00002000:00010000:1.0:1762167009.448160:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167009.448207:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3296:x1847765454497280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 248us (376us total) trans 17179875916 rc 0/0 00000100:00100000:3.0:1762167009.448216:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.448222:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17128 00000100:00100000:1.0:1762167009.448239:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454497920 00000100:00100000:1.0:1762167009.448243:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454497920 00000100:00100000:1.0:1762167009.448278:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17129 00000100:00100000:1.0:1762167009.448290:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454497920:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.448302:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348258a80/2, rc 0, transno 21474843468 00000100:00100000:3.0:1762167009.448310:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454496896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.448332:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee374ab1500/2, rc 0, transno 17179875916 00000100:00100000:3.0:1762167009.448338:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee374ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454497280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.448435:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3294:x1847765454497920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (225us total) trans 21474843469 rc 0/0 00000100:00100000:1.0:1762167009.448445:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17129 00000004:00080000:2.0:1762167009.448461:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243306a00/2, rc 0, transno 21474843469 00000100:00100000:2.0:1762167009.448466:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454497920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.449153:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.449189:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451927680 00000100:00100000:2.0:1762167009.449193:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451927680 00000100:00100000:2.0:1762167009.449224:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17130 00000100:00100000:2.0:1762167009.449229:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451927680:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167009.449237:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167009.449249:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3cfd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.449278:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b299 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c39 expref: 28 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167009.449287:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.449289:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.449294:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 28 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.449322:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c39 expref: 28 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167009.449335:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c39 expref: 28 pid: 6533 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.449346:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454498048:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.449427:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.450835:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454498048:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.450862:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 28 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.450881:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d400, rc 0) 00000100:00100000:2.0:1762167009.450932:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56065:x1847765451927680:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1701us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.450944:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17130 00000100:00100000:3.0:1762167009.451040:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.451083:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451927808 00000100:00100000:2.0:1762167009.451090:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451927808 00010000:00010000:2.0:1762167009.451112:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c39 expref: 28 pid: 6533 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.451146:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7572 00000100:00100000:2.0:1762167009.451157:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451927808:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.451173:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.451192:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c39 expref: 28 pid: 6533 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.451204:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c39 expref: 28 pid: 6533 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.451224:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b299 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c39 expref: 28 pid: 6533 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.451237:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.451239:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.451244:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.451254:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.451280:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.451293:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454498176:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167009.451350:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.452405:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454498176:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167009.452421:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.452458:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451927808:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1304us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.452473:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7572 00000100:00100000:3.0:1762167009.464588:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.464651:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451927936 00000100:00100000:0.0:1762167009.464659:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451927936 00002000:00100000:0.0:1762167009.464696:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->28671) req@ffff9ee242409880 x1847765451927936/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/0 e 0 to 0 dl 1762167020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.464708:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242409880 with x1847765451927936 ext(24576->28671) 00002000:00010000:0.0:1762167009.464713:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242409880 00000100:00100000:0.0:1762167009.464746:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3030 00000100:00100000:0.0:1762167009.464755:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451927936:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167009.465011:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451927936:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 256us (430us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167009.465019:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3030 00002000:00100000:0.0:1762167009.465027:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->28671) req@ffff9ee242409880 x1847765451927936/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/4536 e 0 to 0 dl 1762167020 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.465035:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242409880 with x1847765451927936 ext(24576->28671) 00002000:00010000:0.0:1762167009.465039:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242409880 00000100:00100000:1.0:1762167009.467356:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.467435:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928064 00000100:00100000:0.0:1762167009.467444:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928064 00002000:00100000:0.0:1762167009.467484:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->69631) req@ffff9ee348259500 x1847765451928064/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 504/0 e 0 to 0 dl 1762167020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.467496:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348259500 with x1847765451928064 ext(4096->69631) 00002000:00010000:0.0:1762167009.467502:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348259500 00000100:00100000:0.0:1762167009.467533:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3031 00000100:00100000:0.0:1762167009.467542:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451928064:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:0.0:1762167009.469033:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451928064:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1485us (1676us total) trans 0 rc 61440/61440 00000100:00100000:0.0:1762167009.469046:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3031 00002000:00100000:0.0:1762167009.469056:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->69631) req@ffff9ee348259500 x1847765451928064/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 504/440 e 0 to 0 dl 1762167020 ref 1 fl Complete:/600/0 rc 61440/61440 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.469066:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348259500 with x1847765451928064 ext(4096->69631) 00002000:00010000:0.0:1762167009.469070:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348259500 00000100:00100000:3.0:1762167009.471363:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.471473:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928192 00000100:00100000:0.0:1762167009.471483:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928192 00002000:00100000:0.0:1762167009.471530:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->40959) req@ffff9ee347b03480 x1847765451928192/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 16872/0 e 0 to 0 dl 1762167020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.471542:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b03480 with x1847765451928192 ext(24576->40959) 00002000:00010000:0.0:1762167009.471548:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b03480 00000100:00100000:0.0:1762167009.471581:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3032 00000100:00100000:0.0:1762167009.471591:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451928192:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:0.0:1762167009.472068:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451928192:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 477us (709us total) trans 21474843470 rc 0/0 00000100:00100000:0.0:1762167009.472076:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3032 00002000:00100000:0.0:1762167009.472084:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->40959) req@ffff9ee347b03480 x1847765451928192/t21474843470(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 16872/448 e 0 to 0 dl 1762167020 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.472093:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b03480 with x1847765451928192 ext(24576->40959) 00002000:00010000:0.0:1762167009.472097:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b03480 00000100:00100000:1.0:1762167009.473536:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.473642:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928320 00000100:00100000:2.0:1762167009.473650:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928320 00000100:00100000:2.0:1762167009.473706:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17131 00000100:00100000:2.0:1762167009.473717:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451928320:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167009.487935:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843470 is committed 00000001:00080000:1.0:1762167009.487956:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843468 is committed 00000001:00080000:1.0:1762167009.487973:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843469 is committed 00000100:00100000:2.0:1762167009.488052:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451928320:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 14331us (14517us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.488065:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17131 00000100:00100000:3.0:1762167009.489459:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.489545:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928448 00000100:00100000:0.0:1762167009.489556:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928448 00000100:00100000:0.0:1762167009.489605:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19922 00000100:00100000:0.0:1762167009.489616:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451928448:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167009.489638:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.489656:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d04 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.489735:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.489753:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.489784:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167009.489808:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131446 00000004:00200000:0.0:1762167009.489811:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167009.489826:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.489851:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d04 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.489869:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d04 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.489878:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477eff00) 00010000:00010000:0.0:1762167009.489881:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167009.489884:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ce00, rc 0) 00000100:00100000:0.0:1762167009.489924:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451928448:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 311us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.489930:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19922 00000100:00100000:3.0:1762167009.493936:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.493980:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928576 00000100:00100000:0.0:1762167009.493990:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928576 00002000:00100000:0.0:1762167009.494040:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (98304->135167) req@ffff9ee347b02300 x1847765451928576/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/0 e 0 to 0 dl 1762167020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.494052:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b02300 with x1847765451928576 ext(98304->135167) 00002000:00010000:0.0:1762167009.494058:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b02300 00000100:00100000:0.0:1762167009.494095:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3033 00000100:00100000:0.0:1762167009.494105:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451928576:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167009.495514:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451928576:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1406us (1580us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1762167009.495526:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3033 00002000:00100000:0.0:1762167009.495536:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (98304->135167) req@ffff9ee347b02300 x1847765451928576/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/440 e 0 to 0 dl 1762167020 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.495556:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b02300 with x1847765451928576 ext(98304->135167) 00002000:00010000:0.0:1762167009.495562:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b02300 00000100:00100000:3.0:1762167009.498850:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.498944:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928704 00000100:00100000:0.0:1762167009.498954:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928704 00002000:00100000:0.0:1762167009.499016:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->98303) req@ffff9ee34317d180 x1847765451928704/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/0 e 0 to 0 dl 1762167020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.499027:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317d180 with x1847765451928704 ext(69632->98303) 00002000:00010000:0.0:1762167009.499033:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34317d180 00000100:00100000:0.0:1762167009.499070:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3034 00000100:00100000:0.0:1762167009.499081:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451928704:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167009.500435:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451928704:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1349us (1585us total) trans 0 rc 28672/28672 00000100:00100000:0.0:1762167009.500447:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3034 00002000:00100000:0.0:1762167009.500457:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->98303) req@ffff9ee34317d180 x1847765451928704/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/440 e 0 to 0 dl 1762167020 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.500468:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317d180 with x1847765451928704 ext(69632->98303) 00002000:00010000:0.0:1762167009.500473:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34317d180 00000100:00100000:1.0:1762167009.506742:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.506818:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928832 00000100:00100000:0.0:1762167009.506829:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928832 00002000:00100000:0.0:1762167009.506879:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (172032->237567) req@ffff9ee348259880 x1847765451928832/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/0 e 0 to 0 dl 1762167020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.506890:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348259880 with x1847765451928832 ext(172032->237567) 00002000:00010000:0.0:1762167009.506895:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348259880 00000100:00100000:0.0:1762167009.506928:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3035 00000100:00100000:0.0:1762167009.506937:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451928832:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167009.508164:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451928832:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1223us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.508175:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3035 00002000:00100000:0.0:1762167009.508184:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (172032->237567) req@ffff9ee348259880 x1847765451928832/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/440 e 0 to 0 dl 1762167020 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.508194:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348259880 with x1847765451928832 ext(172032->237567) 00002000:00010000:0.0:1762167009.508200:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348259880 00000100:00100000:3.0:1762167009.511141:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.511216:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451928960 00000100:00100000:0.0:1762167009.511226:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451928960 00002000:00100000:0.0:1762167009.511268:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (237568->241663) req@ffff9ee34317ce00 x1847765451928960/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/0 e 0 to 0 dl 1762167020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.511279:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317ce00 with x1847765451928960 ext(237568->241663) 00002000:00010000:0.0:1762167009.511285:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34317ce00 00000100:00100000:0.0:1762167009.511320:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3036 00000100:00100000:0.0:1762167009.511330:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451928960:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167009.511554:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451928960:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 224us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.511562:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3036 00002000:00100000:0.0:1762167009.511570:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (237568->241663) req@ffff9ee34317ce00 x1847765451928960/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/440 e 0 to 0 dl 1762167020 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.511579:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34317ce00 with x1847765451928960 ext(237568->241663) 00002000:00010000:0.0:1762167009.511582:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34317ce00 00000100:00100000:1.0:1762167009.513575:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.513684:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929088 00000100:00100000:0.0:1762167009.513694:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929088 00002000:00100000:0.0:1762167009.513730:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (126976->262143) req@ffff9ee34825b480 x1847765451929088/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 504/0 e 0 to 0 dl 1762167020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.513740:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34825b480 with x1847765451929088 ext(126976->262143) 00002000:00010000:0.0:1762167009.513744:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34825b480 00000100:00100000:0.0:1762167009.513800:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3037 00000100:00100000:0.0:1762167009.513809:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451929088:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:0.0:1762167009.515836:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451929088:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 2020us (2259us total) trans 21474843471 rc 0/0 00000100:00100000:0.0:1762167009.515849:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3037 00002000:00100000:0.0:1762167009.515861:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (126976->262143) req@ffff9ee34825b480 x1847765451929088/t21474843471(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 504/448 e 0 to 0 dl 1762167020 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167009.515872:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34825b480 with x1847765451929088 ext(126976->262143) 00002000:00010000:0.0:1762167009.515877:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee34825b480 00000100:00100000:3.0:1762167009.517280:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.517344:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929216 00000100:00100000:2.0:1762167009.517351:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929216 00000100:00100000:2.0:1762167009.517409:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17132 00000100:00100000:2.0:1762167009.517420:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451929216:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167009.531532:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843471 is committed 00000100:00100000:0.0:1762167009.531643:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451929216:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 14219us (14363us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.531657:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17132 00000100:00100000:3.0:1762167009.535700:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.535925:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929472 00000100:00100000:0.0:1762167009.536066:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929472 00000100:00100000:0.0:1762167009.536134:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19923 00000100:00100000:0.0:1762167009.536144:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451929472:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167009.536196:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167009.536224:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4ad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d04 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.536258:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b498 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cf6 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.536269:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477eff00) 00010000:00010000:0.0:1762167009.536280:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167009.536581:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.536594:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.536604:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167009.536659:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953023 00000004:00010000:0.0:1762167009.536685:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a2dc291d reply state 00000000a51da15f transno 8589953024 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167009.536693:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167009.536910:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451929472:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 766us (1217us total) trans 8589953024 rc 0/0 00000100:00100000:0.0:1762167009.536923:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19923 00000020:00080000:0.0:1762167009.536930:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167009.538107:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.538120:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.538127:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.538133:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.538137:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.538144:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.538157:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477efb00) 00010000:00010000:2.0:1762167009.538160:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.538163:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.538168:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4b4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167009.538387:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.538445:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929600 00000100:00100000:0.0:1762167009.538455:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929600 00000100:00100000:0.0:1762167009.538503:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19924 00000100:00100000:0.0:1762167009.538513:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451929600:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167009.538536:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.538553:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b4bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d0b expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.538600:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b4bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d0b expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.538613:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b4bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d0b expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.538630:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.538633:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167009.538636:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c400, rc 0) 00000100:00100000:0.0:1762167009.538684:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451929600:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 172us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.538691:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19924 00000100:00100000:1.0:1762167009.540225:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.540282:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929728 00000100:00100000:0.0:1762167009.540289:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929728 00000100:00100000:0.0:1762167009.540339:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17133 00000100:00100000:0.0:1762167009.540349:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56065:x1847765451929728:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167009.540362:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.540389:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d12 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.540415:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b2a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c40 expref: 32 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167009.540428:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.540430:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.540434:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 32 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.540466:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b2a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c40 expref: 32 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167009.540481:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b2a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c40 expref: 32 pid: 12402 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1762167009.540496:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454498304:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.540569:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.541888:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454498304:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.541914:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 32 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.541930:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c600, rc 0) 00000100:00100000:0.0:1762167009.541992:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56065:x1847765451929728:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1643us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.542001:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17133 00000100:00100000:3.0:1762167009.542070:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.542188:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929856 00000100:00100000:2.0:1762167009.542199:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929856 00010000:00010000:2.0:1762167009.542228:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b2a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c40 expref: 32 pid: 12402 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.542260:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7573 00000100:00100000:2.0:1762167009.542267:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451929856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.542280:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.542300:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b2a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c40 expref: 32 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.542313:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b2a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c40 expref: 32 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.542338:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b2a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c40 expref: 32 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.542351:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.542353:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.542360:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 31 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.542384:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 31 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.542411:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 31 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.542422:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454498432:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167009.542483:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.544249:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6549:1847765454498432:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167009.544268:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.544313:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34317f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451929856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2044us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.544324:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7573 00000100:00100000:3.0:1762167009.544494:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.544581:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451929984 00000100:00100000:0.0:1762167009.544590:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451929984 00000100:00100000:0.0:1762167009.544639:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17134 00000100:00100000:0.0:1762167009.544648:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56065:x1847765451929984:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167009.544664:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.544681:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d19 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.544706:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b2a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c47 expref: 18 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167009.544714:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.544716:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.544720:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.544753:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b2a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c47 expref: 18 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167009.544793:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b2a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c47 expref: 18 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1762167009.544807:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454498560:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.544871:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.546034:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454498560:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.546058:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.546078:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167009.546125:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56065:x1847765451929984:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1478us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.546133:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17134 00000100:00100000:3.0:1762167009.546343:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.546399:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451930112 00000100:00100000:2.0:1762167009.546411:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451930112 00010000:00010000:2.0:1762167009.546437:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b2a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c47 expref: 18 pid: 6535 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.546474:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7574 00000100:00100000:2.0:1762167009.546485:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451930112:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.546497:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.546517:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b2a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c47 expref: 18 pid: 6535 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.546530:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b2a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c47 expref: 18 pid: 6535 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.546552:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b2a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3c47 expref: 18 pid: 6535 timeout: 730 lvb_type: 1 00010000:00010000:2.0:1762167009.546565:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.546567:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.546571:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.546580:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.546628:0:6549:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.546640:0:6549:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454498688:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167009.546702:0:6549:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.548047:0:6549:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6549:1847765454498688:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167009.548049:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167009.548063:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.548109:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451930112:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1625us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.548112:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451930240 00000100:00100000:0.0:1762167009.548120:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451930240 00000100:00100000:2.0:1762167009.548121:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7574 00002000:00010000:0.0:1762167009.548154:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (131389->18446744073709551615) 00002000:00100000:0.0:1762167009.548159:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e447480 with x1847765451930240 ext(131389->18446744073709551615) 00002000:00010000:0.0:1762167009.548169:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e447480. 00000100:00100000:0.0:1762167009.548199:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3038 00000100:00100000:0.0:1762167009.548208:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451930240:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167009.548458:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.548497:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451930368 00000100:00100000:2.0:1762167009.548502:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451930368 00002000:00010000:2.0:1762167009.548545:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.548549:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34825ad80 with x1847765451930368 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.548557:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee34825ad80. 00000100:00100000:2.0:1762167009.548590:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3039 00000100:00100000:2.0:1762167009.548599:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451930368:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:2.0:1762167009.548782:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.548786:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.548788:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 131446 -> 131389 00002000:00010000:2.0:1762167009.548790:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.548795:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.548796:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.548801:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.548802:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167009.548809:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.548812:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 187 -> 423 00000100:00100000:2.0:1762167009.548840:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34825ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451930368:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 243us (382us total) trans 17179875917 rc 0/0 00000100:00100000:0.0:1762167009.548847:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451930240:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 637us (795us total) trans 21474843472 rc 0/0 00000100:00100000:2.0:1762167009.548853:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3039 00002000:00010000:2.0:1762167009.548857:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.548860:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee34825ad80 with x1847765451930368 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.548865:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee34825ad80. 00000100:00100000:0.0:1762167009.548873:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3038 00002000:00010000:0.0:1762167009.548878:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (131389->18446744073709551615) 00002000:00100000:0.0:1762167009.548881:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e447480 with x1847765451930240 ext(131389->18446744073709551615) 00002000:00010000:0.0:1762167009.548887:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e447480. 00000100:00100000:1.0:1762167009.548995:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.549061:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451930496 00000100:00100000:2.0:1762167009.549071:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451930496 00002000:00010000:2.0:1762167009.549085:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.549089:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f402300 with x1847765451930496 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.549095:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f402300. 00000100:00100000:2.0:1762167009.549122:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3040 00000100:00100000:2.0:1762167009.549130:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451930496:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:2.0:1762167009.549242:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.549246:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.549249:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.549251:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.549253:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.549286:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451930496:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 157us (292us total) trans 21474843473 rc 0/0 00000100:00100000:2.0:1762167009.549294:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3040 00002000:00010000:2.0:1762167009.549297:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.549301:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f402300 with x1847765451930496 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.549306:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f402300. 00000100:00100000:1.0:1762167009.550932:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.551020:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451930624 00000100:00100000:0.0:1762167009.551029:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451930624 00000100:00100000:0.0:1762167009.551075:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19925 00000100:00100000:0.0:1762167009.551085:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451930624:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167009.551101:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.551119:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b4d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d20 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.551193:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.551207:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.551217:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167009.551241:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 131389 00000004:00200000:0.0:1762167009.551245:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167009.551259:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.551282:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b4d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d20 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.551299:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d20 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.551307:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.551310:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167009.551314:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c000, rc 0) 00000100:00100000:0.0:1762167009.551387:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451930624:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 303us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.551397:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19925 00000100:00100000:1.0:1762167009.560342:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.560415:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451930880 00000100:00100000:0.0:1762167009.560425:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451930880 00000100:00100000:0.0:1762167009.560484:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7369 00000100:00100000:0.0:1762167009.560496:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451930880:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167009.560888:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451930880:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 394us (555us total) trans 8589953025 rc 0/0 00000100:00100000:0.0:1762167009.560897:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7369 00000100:00100000:3.0:1762167009.571499:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.571821:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451931008 00000100:00100000:0.0:1762167009.571833:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451931008 00000100:00100000:0.0:1762167009.571901:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19926 00000100:00100000:0.0:1762167009.571912:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56215:x1847765451931008:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.571936:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.571956:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b4de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d27 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.572024:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b4e5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572037:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572048:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572062:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b4ec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572069:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b4ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572076:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b4ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572192:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572200:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572207:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167009.572256:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:0.0:1762167009.572260:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167009.572277:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572290:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572298:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572303:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b4e5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572309:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572315:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167009.572319:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572326:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572337:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167009.572341:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167009.572345:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b4e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572351:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b4e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572378:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b4ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572384:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b4ec lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572389:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b4ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572394:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167009.572397:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b4ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572403:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b4ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572410:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2477eff00) 00010000:00010000:0.0:1762167009.572413:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167009.572415:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b4ec lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572421:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b4ec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.572452:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b4de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d27 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.572463:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d27 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.572471:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.572472:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167009.572474:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ce00, rc 0) 00000100:00100000:0.0:1762167009.572539:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56215:x1847765451931008:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 629us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.572548:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19926 00000100:00100000:1.0:1762167009.574567:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.574674:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451931136 00000100:00100000:2.0:1762167009.574684:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451931136 00000100:00100000:2.0:1762167009.574753:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 656 00000100:00100000:2.0:1762167009.574787:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f400a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2359:x1847765451931136:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.574807:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.574833:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b4f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d27 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.574854:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:2.0:1762167009.574859:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.574914:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f400a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2359:x1847765451931136:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 148us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.574923:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 656 00000100:00100000:3.0:1762167009.575088:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.575137:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451931392 00000100:00100000:0.0:1762167009.575144:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451931392 00000100:00100000:0.0:1762167009.575179:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19927 00000100:00100000:0.0:1762167009.575193:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56215:x1847765451931392:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.575209:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.575222:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d2e expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.575321:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.575340:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d20 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.575349:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.575393:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d20 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.575407:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d20 expref: 895 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.575422:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454498816:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.575627:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.576707:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454498816:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.576730:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167009.577128:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.577212:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451931520 00000100:00100000:2.0:1762167009.577219:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451931520 00010000:00010000:2.0:1762167009.577248:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d20 expref: 896 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.577287:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7575 00000100:00100000:2.0:1762167009.577302:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451931520:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.577325:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.577332:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d20 expref: 896 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.577348:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d20 expref: 896 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.577377:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b4d7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d20 expref: 896 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.577395:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:2.0:1762167009.577400:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.577408:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.577416:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.577448:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.577496:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451931520:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 199us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.577504:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7575 00010000:00010000:0.0:1762167009.577563:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.577571:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167009.577588:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00010000:00010000:0.0:1762167009.577745:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b4fa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d2e expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.577821:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d2e expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.577830:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.577833:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167009.577835:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29c00, rc 0) 00000100:00100000:0.0:1762167009.577877:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56215:x1847765451931392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2690us (2789us total) trans 8589953026 rc 0/0 00000100:00100000:0.0:1762167009.577888:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19927 00000100:00100000:1.0:1762167009.580888:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.580940:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451931648 00000100:00100000:0.0:1762167009.580951:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451931648 00000100:00100000:0.0:1762167009.581011:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19928 00000100:00100000:0.0:1762167009.581022:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56215:x1847765451931648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.581043:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.581061:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b50f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d35 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.581135:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.581150:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d2e expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.581159:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.581192:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d2e expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.581205:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d2e expref: 896 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.581218:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454498944:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.581310:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a300 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.583109:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454498944:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.583135:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167009.583299:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.583382:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451931776 00000100:00100000:2.0:1762167009.583390:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451931776 00010000:00010000:2.0:1762167009.583421:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d2e expref: 897 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.583460:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7576 00000100:00100000:2.0:1762167009.583470:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451931776:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.583482:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.583488:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d2e expref: 897 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.583498:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d2e expref: 897 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.583518:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0b501 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d2e expref: 897 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.583534:0:6549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:2.0:1762167009.583538:0:6549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.583546:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.583557:0:6549:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167009.583589:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.583640:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451931776:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.583648:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7576 00010000:00010000:1.0:1762167009.583808:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167009.583815:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167009.583865:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:1.0:1762167009.583870:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167009.583888:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167009.583919:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0b50f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d35 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.583937:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d35 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.583943:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:1.0:1762167009.583946:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167009.583949:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28600, rc 0) 00000100:00100000:1.0:1762167009.583975:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56215:x1847765451931648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2956us (3098us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.583982:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19928 00000100:00100000:1.0:1762167009.585722:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.585870:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932032 00000100:00100000:0.0:1762167009.585877:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932032 00000100:00100000:0.0:1762167009.585917:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19929 00000100:00100000:0.0:1762167009.585925:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56215:x1847765451932032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.585942:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.585961:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b51d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d3c expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.586043:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b524 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.586056:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b524 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167009.586066:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b524 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167009.586076:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00010000:00010000:0.0:1762167009.586205:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0b51d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d3c expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.586222:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b524 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d3c expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.586231:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.586234:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167009.586237:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29000, rc 0) 00000100:00100000:0.0:1762167009.586288:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56215:x1847765451932032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 364us (572us total) trans 8589953027 rc 0/0 00000100:00100000:0.0:1762167009.586304:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19929 00000100:00100000:3.0:1762167009.588144:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.588185:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.588211:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.588245:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932160 00000100:00100000:1.0:1762167009.588255:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932160 00000100:00100000:0.0:1762167009.588262:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932288 00000100:00100000:0.0:1762167009.588269:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932288 00000100:00100000:2.0:1762167009.588279:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932416 00000100:00100000:2.0:1762167009.588286:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932416 00000100:00100000:1.0:1762167009.588324:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17135 00000100:00100000:1.0:1762167009.588338:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451932160:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167009.588393:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.588412:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 20 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.588420:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167009.588423:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167009.588426:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.588457:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17136 00010000:00010000:1.0:1762167009.588462:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 20 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.588470:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17137 00000100:00100000:0.0:1762167009.588473:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451932288:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167009.588488:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451932416:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167009.588492:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 20 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167009.588509:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.588511:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454499072:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.588517:0:7858:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.588534:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 32 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.588548:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167009.588550:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167009.588553:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.588577:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 32 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.588587:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 32 pid: 6532 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.588599:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454499200:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167009.588603:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00010000:00010000:3.0:1762167009.588623:0:7858:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 20 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.588628:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a300 going to sleep for 11 seconds 00010000:00010000:3.0:1762167009.588636:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.588638:0:7858:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.588642:0:7858:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.588671:0:7858:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 20 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.588681:0:7858:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 20 pid: 6532 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.588693:0:7858:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454499328:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167009.588723:0:7858:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.590165:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454499072:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.590191:0:33892:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.590232:0:7858:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7858:1847765454499328:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.590247:0:7858:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.590296:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6532:1847765454499200:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.590312:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.590571:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.590603:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.590637:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.590823:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932800 00000100:00100000:2.0:1762167009.590830:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932800 00010000:00010000:2.0:1762167009.590860:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 21 pid: 6532 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.590884:0:6549:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932544 00000100:00100000:2.0:1762167009.590887:0:6549:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932544 00010000:00010000:2.0:1762167009.590900:0:6549:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 33 pid: 6532 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.590922:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7577 00000100:00100000:2.0:1762167009.590930:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451932800:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.590943:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.590963:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 21 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.590975:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 21 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.591004:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b4c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d19 expref: 21 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.591019:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.591021:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.591026:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.591034:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.591055:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.591097:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451932800:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 167us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.591106:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7577 00000100:00100000:2.0:1762167009.591171:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7578 00000100:00100000:2.0:1762167009.591178:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451932544:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.591188:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.591201:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 33 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.591210:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 33 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.591225:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b4c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d12 expref: 33 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.591234:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.591236:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.591239:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.591246:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.591262:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.591289:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451932544:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 111us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.591297:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7578 00010000:00010000:0.0:1762167009.591356:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.591379:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.591406:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.591416:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.591425:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.591430:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932672 00010000:00010000:0.0:1762167009.591435:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29400 already unused, calling callback (ffffffffc1709320) 00000100:00100000:1.0:1762167009.591437:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932672 00010000:00010000:0.0:1762167009.591443:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.591454:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.591468:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1762167009.591476:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (151552->201219) req@ffff9ee24550dc00 x1847765451932672/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/0 e 0 to 0 dl 1762167020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1762167009.591477:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b539 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1762167009.591501:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24550dc00 with x1847765451932672 ext(151552->201219) 00010000:00010000:1.0:1762167009.591509:0:21530:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 20 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.591523:0:21530:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 20 pid: 6532 timeout: 730 lvb_type: 0 00002000:00010000:1.0:1762167009.591530:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee24550dc00 00010000:00010000:3.0:1762167009.591544:0:7858:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.591553:0:7858:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.591563:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451932288:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3094us (3375us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167009.591571:0:7858:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.591575:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17136 00010000:00010000:3.0:1762167009.591585:0:7858:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.591591:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 25 00010000:00010000:3.0:1762167009.591593:0:7858:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.591600:0:7858:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922200 already unused, calling callback (ffffffffc1709320) 00000100:00100000:1.0:1762167009.591600:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451932672:12345-192.168.203.35@tcp:4:fsx.0 00010000:00010000:3.0:1762167009.591604:0:7858:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.591610:0:7858:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.591620:0:7858:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.591626:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b540 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.591751:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451932416:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3268us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.591758:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17137 00000100:00100000:3.0:1762167009.593599:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451932672:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 1993us (2954us total) trans 21474843474 rc 0/0 00000100:00100000:3.0:1762167009.593610:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 25 00002000:00100000:3.0:1762167009.593620:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (151552->201219) req@ffff9ee24550dc00 x1847765451932672/t21474843474(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:40/0 lens 488/448 e 0 to 0 dl 1762167020 ref 1 fl Complete:H/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167009.593630:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24550dc00 with x1847765451932672 ext(151552->201219) 00010000:00010000:3.0:1762167009.593640:0:21530:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 21 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.593655:0:21530:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 21 pid: 6532 timeout: 730 lvb_type: 0 00002000:00010000:3.0:1762167009.593668:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee24550dc00 00000100:00100000:0.0:1762167009.595346:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.595396:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451932928 00000100:00100000:3.0:1762167009.595405:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451932928 00010000:00010000:3.0:1762167009.595443:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 21 pid: 6532 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.595493:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7579 00000100:00100000:3.0:1762167009.595503:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451932928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167009.595518:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1762167009.595534:0:7415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 131389 -> 201220 00010000:00010000:3.0:1762167009.595541:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 21 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.595554:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 21 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.595576:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b49f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cfd expref: 21 pid: 6532 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.595590:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.595592:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.595597:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.595609:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.595648:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167009.595693:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451932928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 191us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.595701:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7579 00010000:00010000:0.0:1762167009.596140:0:33892:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.596153:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.596178:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.596187:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.596195:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.596202:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.596206:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.596214:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.596233:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.596240:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b532 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.596302:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451932160:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 7969us (8167us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.596313:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17135 00000100:00100000:0.0:1762167009.598685:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.598959:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933184 00000100:00100000:3.0:1762167009.598969:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933184 00000100:00100000:3.0:1762167009.599023:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19930 00000100:00100000:3.0:1762167009.599034:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56215:x1847765451933184:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.599086:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762167009.599111:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0b516 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d35 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.599134:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b4bb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d0b expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.599144:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.599149:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.599176:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.599188:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.599204:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000040:00080000:3.0:1762167009.599822:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5525, 88 off446480 00000004:00080000:3.0:1762167009.599832:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630392068317ns, next at 630704042948ns, rc = 0 00000040:00080000:3.0:1762167009.599900:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5533, 88 off447536 00000004:00080000:3.0:1762167009.599906:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630392143060ns, next at 630703976179ns, rc = 0 00000040:00080000:3.0:1762167009.599955:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5534, 88 off447624 00000004:00080000:3.0:1762167009.599961:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630392197797ns, next at 630703976179ns, rc = 0 00000040:00080000:3.0:1762167009.599993:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5526, 88 off446568 00000004:00080000:3.0:1762167009.599999:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630392236012ns, next at 630704042948ns, rc = 0 00000040:00080000:3.0:1762167009.600018:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5535, 88 off447712 00000004:00080000:3.0:1762167009.600023:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630392260147ns, next at 630703976179ns, rc = 0 00000040:00080000:3.0:1762167009.600060:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5527, 88 off446656 00000004:00080000:3.0:1762167009.600066:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630392302757ns, next at 630704042948ns, rc = 0 00000040:00080000:3.0:1762167009.600115:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5528, 88 off446744 00000004:00080000:3.0:1762167009.600121:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630392357836ns, next at 630704042948ns, rc = 0 00000040:00080000:3.0:1762167009.600147:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5536, 88 off447800 00000004:00080000:3.0:1762167009.600151:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630392388576ns, next at 630703976179ns, rc = 0 00000040:00080000:3.0:1762167009.600179:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5537, 88 off447888 00000004:00080000:3.0:1762167009.600184:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630392421612ns, next at 630703976179ns, rc = 0 00000040:00080000:3.0:1762167009.600202:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5529, 88 off446832 00000004:00080000:3.0:1762167009.600206:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630392443110ns, next at 630704042948ns, rc = 0 00000040:00080000:3.0:1762167009.600220:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5538, 88 off447976 00000004:00080000:3.0:1762167009.600224:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630392461261ns, next at 630703976179ns, rc = 0 00000040:00080000:3.0:1762167009.600254:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5530, 88 off446920 00000004:00080000:3.0:1762167009.600259:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630392496318ns, next at 630704042948ns, rc = 0 00000040:00080000:3.0:1762167009.600287:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5531, 88 off447008 00000004:00080000:3.0:1762167009.600292:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630392528991ns, next at 630704042948ns, rc = 0 00000040:00080000:3.0:1762167009.600319:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5539, 88 off448064 00000004:00080000:3.0:1762167009.600324:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630392561270ns, next at 630703976179ns, rc = 0 00000040:00080000:3.0:1762167009.600355:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5532, 88 off447096 00000004:00080000:3.0:1762167009.600360:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630392597360ns, next at 630704042948ns, rc = 0 00000040:00080000:3.0:1762167009.600397:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5540, 88 off448152 00000004:00080000:3.0:1762167009.600401:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630392638477ns, next at 630703976179ns, rc = 0 00000040:00080000:3.0:1762167009.600417:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5541, 88 off448240 00000004:00080000:3.0:1762167009.600421:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630392658307ns, next at 630703976179ns, rc = 0 00000040:00080000:3.0:1762167009.600436:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5533, 88 off447184 00000004:00080000:3.0:1762167009.600440:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630392677260ns, next at 630704042948ns, rc = 0 00000040:00080000:3.0:1762167009.600456:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5534, 88 off447272 00000004:00080000:3.0:1762167009.600460:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630392697212ns, next at 630704042948ns, rc = 0 00000040:00080000:3.0:1762167009.600476:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5542, 88 off448328 00000004:00080000:3.0:1762167009.600479:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630392716776ns, next at 630703976179ns, rc = 0 00000001:00080000:2.0:1762167009.617518:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953027 is committed 00000001:00080000:2.0:1762167009.617555:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953028 is committed 00000004:00010000:0.0:1762167009.617561:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dc69f4e7 reply state 000000003cafd4c9 transno 8589953028 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00080000:2.0:1762167009.617562:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3654 committed 00000100:00100000:0.0:1762167009.617577:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:2.0:1762167009.617631:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3641 committed 00000004:00080000:2.0:1762167009.617683:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3640 committed 00010000:00080000:0.0:1762167009.617702:0:30817:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762167009.617722:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56215:x1847765451933184:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 18686us (19039us total) trans 8589953028 rc 0/0 00000100:00100000:0.0:1762167009.617733:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19930 00010000:00010000:0.0:1762167009.617802:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.617811:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.617819:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.617826:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167009.617831:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.617852:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.617871:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.617875:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167009.617881:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.617889:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b547 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.617919:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454499456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.617974:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.618012:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454499968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.618014:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454499456 00000100:00100000:0.0:1762167009.618023:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454499456 00000100:00100000:3.0:1762167009.618036:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.618061:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1762167009.618066:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454499968 00000100:00100000:3.0:1762167009.618071:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454499840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.618072:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454499968 00000100:00100000:3.0:1762167009.618104:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.618104:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17138 00000100:00100000:0.0:1762167009.618117:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454499456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.618128:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454500352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.618151:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.618182:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454499584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.618209:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.618228:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454500096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.618248:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.618275:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1762167009.618283:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454499712:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.618311:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3653 committed 00000100:00100000:3.0:1762167009.618313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167009.618318:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3652 committed 00002000:00010000:0.0:1762167009.618322:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:2.0:1762167009.618323:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3639 committed 00002000:00010000:0.0:1762167009.618328:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00000004:00080000:2.0:1762167009.618331:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3651 committed 00002000:00010000:0.0:1762167009.618332:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:2.0:1762167009.618335:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3638 committed 00002000:00010000:0.0:1762167009.618337:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000004:00080000:2.0:1762167009.618341:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3637 committed 00000100:00100000:3.0:1762167009.618342:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454500224:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167009.618343:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:2.0:1762167009.618348:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3650 committed 00000004:00080000:2.0:1762167009.618353:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3636 committed 00000004:00080000:2.0:1762167009.618357:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3649 committed 00000004:00080000:2.0:1762167009.618360:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3648 committed 00000004:00080000:2.0:1762167009.618378:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3635 committed 00000004:00080000:2.0:1762167009.618383:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3634 committed 00000004:00080000:2.0:1762167009.618387:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3647 committed 00000004:00080000:2.0:1762167009.618394:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3633 committed 00000004:00080000:2.0:1762167009.618400:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3646 committed 00000100:00100000:3.0:1762167009.618403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167009.618406:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3645 committed 00000100:00100000:0.0:1762167009.618412:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3294:x1847765454499456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 295us (435us total) trans 17179875918 rc 0/0 00000004:00080000:2.0:1762167009.618418:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3632 committed 00000100:00100000:0.0:1762167009.618424:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17138 00000100:00100000:3.0:1762167009.618429:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454500608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.618446:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454499840 00000100:00100000:0.0:1762167009.618452:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454499840 00000100:00100000:3.0:1762167009.618464:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.618473:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454500352 00000100:00100000:0.0:1762167009.618479:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454500352 00000100:00100000:3.0:1762167009.618485:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454501120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.618498:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454499584 00000100:00100000:0.0:1762167009.618502:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454499584 00000100:00100000:3.0:1762167009.618513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.618521:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454500096 00000100:00100000:3.0:1762167009.618528:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1762167009.618534:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454500736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.618551:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.618564:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454501248:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.618585:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.618597:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454499712 00000100:00100000:2.0:1762167009.618603:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454499712 00000100:00100000:3.0:1762167009.618615:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454500224 00000100:00100000:3.0:1762167009.618620:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454500224 00000100:00100000:2.0:1762167009.618625:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454500608 00000100:00100000:2.0:1762167009.618630:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454500608 00000100:00100000:3.0:1762167009.618645:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454501120 00000100:00100000:3.0:1762167009.618650:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454501120 00000100:00100000:2.0:1762167009.618653:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454500736 00000100:00100000:2.0:1762167009.618657:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454500736 00000100:00100000:3.0:1762167009.618671:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454501248 00000100:00100000:3.0:1762167009.618676:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454501248 00000100:00100000:2.0:1762167009.618682:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17139 00000100:00100000:2.0:1762167009.618694:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3294:x1847765454499968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.618700:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17140 00000100:00100000:3.0:1762167009.618710:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3294:x1847765454499840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167009.618880:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167009.618884:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.618887:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167009.618890:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.618892:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.618900:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3294:x1847765454499968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (863us total) trans 17179875919 rc 0/0 00000100:00100000:2.0:1762167009.618909:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17139 00000100:00100000:2.0:1762167009.618931:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17141 00000100:00100000:3.0:1762167009.618932:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454499840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (827us total) trans 17179875920 rc 0/0 00000100:00100000:2.0:1762167009.618942:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454500352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.618946:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17140 00000100:00100000:3.0:1762167009.618965:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17142 00000100:00100000:3.0:1762167009.618974:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454499584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.619047:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454500096 00002000:00010000:2.0:1762167009.619052:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.619057:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.619060:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167009.619063:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.619066:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.619076:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17143 00000100:00100000:0.0:1762167009.619086:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3295:x1847765454499712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.619101:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3294:x1847765454500352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (946us total) trans 17179875921 rc 0/0 00000100:00100000:2.0:1762167009.619109:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17141 00000100:00100000:2.0:1762167009.619132:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17144 00000100:00100000:3.0:1762167009.619134:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454499584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (920us total) trans 17179875922 rc 0/0 00000100:00100000:2.0:1762167009.619145:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454500224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.619146:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17142 00000100:00100000:3.0:1762167009.619168:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17145 00000100:00100000:3.0:1762167009.619177:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765454500608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.619245:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454499712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (931us total) trans 17179875923 rc 0/0 00000100:00100000:0.0:1762167009.619253:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17143 00000100:00100000:0.0:1762167009.619274:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17146 00002000:00010000:2.0:1762167009.619284:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167009.619285:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765454501120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167009.619290:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.619295:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167009.619297:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.619300:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167009.619334:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454500608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (871us total) trans 21474843475 rc 0/0 00000100:00100000:3.0:1762167009.619340:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17145 00000100:00100000:3.0:1762167009.619353:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17147 00000100:00100000:3.0:1762167009.619359:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765454500736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167009.619484:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167009.619487:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.619490:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167009.619491:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.619494:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167009.619519:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454500736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (966us total) trans 21474843476 rc 0/0 00000100:00100000:3.0:1762167009.619526:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17147 00000100:00100000:3.0:1762167009.619539:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17148 00000100:00100000:3.0:1762167009.619545:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765454501248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.619643:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454501248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (1056us total) trans 21474843477 rc 0/0 00000100:00100000:3.0:1762167009.619649:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17148 00000100:00100000:3.0:1762167009.619660:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17149 00000100:00100000:3.0:1762167009.619666:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454500096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.619752:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3295:x1847765454500096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1503us total) trans 17179875925 rc 0/0 00000100:00100000:3.0:1762167009.619758:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17149 00000100:00100000:3.0:1762167009.619822:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454500864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.619852:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.619875:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454501376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.619897:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.619932:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1762167009.619938:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454500480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.619962:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.619980:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454500992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.620005:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454500224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 863us (1603us total) trans 17179875924 rc 0/0 00000100:00100000:3.0:1762167009.620011:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.620019:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17144 00000100:00100000:3.0:1762167009.620041:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454500864 00000100:00100000:3.0:1762167009.620047:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454500864 00000100:00100000:3.0:1762167009.620070:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17150 00000100:00100000:3.0:1762167009.620077:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454500864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.620167:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454501376 00000100:00100000:2.0:1762167009.620171:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454501376 00000100:00100000:2.0:1762167009.620197:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454500480 00000100:00100000:2.0:1762167009.620200:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454500480 00000100:00100000:2.0:1762167009.620215:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454500992 00000100:00100000:2.0:1762167009.620218:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454500992 00000100:00100000:3.0:1762167009.620225:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454500864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (371us total) trans 21474843478 rc 0/0 00000100:00100000:3.0:1762167009.620233:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17150 00000100:00100000:2.0:1762167009.620247:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17151 00000100:00100000:2.0:1762167009.620256:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454501376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167009.620339:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167009.620344:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.620346:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167009.620348:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.620350:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.620401:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454501120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1120us (1888us total) trans 21474843479 rc 0/0 00000100:00100000:0.0:1762167009.620409:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17146 00002000:00010000:2.0:1762167009.620410:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 131446 -> 131446 00002000:00010000:2.0:1762167009.620418:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.620421:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167009.620424:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00000100:00100000:0.0:1762167009.620425:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17152 00002000:00010000:2.0:1762167009.620429:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167009.620436:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454500480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.620452:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17153 00000100:00100000:2.0:1762167009.620465:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454501376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (564us total) trans 21474843480 rc 0/0 00000100:00100000:1.0:1762167009.620467:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454500992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.620493:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17151 00000100:00100000:0.0:1762167009.620572:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454500480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (608us total) trans 21474843481 rc 0/0 00000100:00100000:0.0:1762167009.620579:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17152 00002000:00010000:1.0:1762167009.620611:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.620615:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.620618:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167009.620621:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.620623:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167009.620652:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454500992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (643us total) trans 21474843482 rc 0/0 00000100:00100000:1.0:1762167009.620659:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17153 00000004:00080000:2.0:1762167009.620881:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345730700/2, rc 0, transno 17179875920 00000100:00100000:2.0:1762167009.620888:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454499840:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.620897:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345732d80/2, rc 0, transno 17179875921 00000100:00100000:2.0:1762167009.620899:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454500352:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.620907:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550f480/2, rc 0, transno 17179875918 00000100:00100000:2.0:1762167009.620910:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454499456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.620916:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345732680/2, rc 0, transno 17179875919 00000100:00100000:2.0:1762167009.620919:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454499968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.620996:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454501632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.621020:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.621045:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843469 gen 2 00000004:00080000:2.0:1762167009.621049:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d69c00, transno 21474843450 00000004:00080000:2.0:1762167009.621059:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f331c00, transno 21474843451 00000004:00080000:2.0:1762167009.621063:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243305880, transno 21474843452 00000004:00080000:2.0:1762167009.621066:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f330e00, transno 21474843453 00000004:00080000:2.0:1762167009.621069:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243306300, transno 21474843454 00000004:00080000:2.0:1762167009.621073:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f331180, transno 21474843455 00000004:00080000:2.0:1762167009.621077:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccc000, transno 21474843456 00000004:00080000:2.0:1762167009.621079:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccea00, transno 21474843457 00000004:00080000:2.0:1762167009.621081:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d69180, transno 21474843458 00000004:00080000:2.0:1762167009.621084:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f332300, transno 21474843459 00000004:00080000:2.0:1762167009.621086:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28e00, transno 21474843460 00000004:00080000:2.0:1762167009.621088:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc2b800, transno 21474843461 00000004:00080000:2.0:1762167009.621091:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28000, transno 21474843462 00000004:00080000:2.0:1762167009.621094:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc2ad80, transno 21474843463 00000004:00080000:2.0:1762167009.621096:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825a300, transno 21474843464 00000004:00080000:2.0:1762167009.621099:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825b800, transno 21474843465 00000004:00080000:2.0:1762167009.621102:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258e00, transno 21474843466 00000004:00080000:2.0:1762167009.621104:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34825a680, transno 21474843467 00000004:00080000:2.0:1762167009.621106:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348258a80, transno 21474843468 00000004:00080000:2.0:1762167009.621109:0:3295:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243306a00, transno 21474843469 00000100:00100000:2.0:1762167009.621115:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37fb12680 x1847765454500736/t21474843476(21474843476) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167025 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762167009.621124:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb12680/2, rc 0, transno 21474843476 00000100:00100000:2.0:1762167009.621128:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454500736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.621140:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454501504:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.621236:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb11880/2, rc 0, transno 21474843477 00000100:00100000:2.0:1762167009.621242:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454501248:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167009.621395:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 23 in progress, 6 in flight, 5 done 00000004:00080000:1.0:1762167009.621514:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 6 in flight, 15 done 00000004:00080000:2.0:1762167009.621553:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb10700/2, rc 0, transno 21474843479 00000100:00100000:2.0:1762167009.621561:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454501120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.621563:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454501760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.621573:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167009.621577:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb11180/2, rc 0, transno 21474843475 00000100:00100000:2.0:1762167009.621583:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454500608:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167009.621597:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550f800/2, rc 0, transno 17179875923 00000100:00100000:2.0:1762167009.621601:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454499712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.621606:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762167009.621608:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.621615:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454501888:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167009.621621:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345731f80/2, rc 0, transno 17179875924 00000100:00100000:2.0:1762167009.621626:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454500224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.621642:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550c000/2, rc 0, transno 17179875922 00000100:00100000:0.0:1762167009.621646:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.621651:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454499584:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.622149:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345731180/2, rc 0, transno 17179875925 00000100:00100000:2.0:1762167009.622155:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454500096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.622188:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454501632 00000100:00100000:1.0:1762167009.622195:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454501632 00000100:00100000:0.0:1762167009.622202:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454501504 00000100:00100000:0.0:1762167009.622209:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454501504 00000100:00100000:1.0:1762167009.622232:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454501760 00000100:00100000:0.0:1762167009.622236:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454501888 00000100:00100000:1.0:1762167009.622237:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454501760 00000100:00100000:0.0:1762167009.622242:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454501888 00000100:00100000:1.0:1762167009.622267:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17154 00000100:00100000:1.0:1762167009.622279:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3295:x1847765454501632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.622362:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17155 00000100:00100000:3.0:1762167009.622380:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3294:x1847765454501504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167009.622429:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.622435:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.622438:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167009.622440:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.622443:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1762167009.622497:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3295:x1847765454501632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (1463us total) trans 17179875926 rc 0/0 00000100:00100000:1.0:1762167009.622506:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17154 00000100:00100000:3.0:1762167009.622511:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3294:x1847765454501504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (939us total) trans 17179875927 rc 0/0 00000100:00100000:3.0:1762167009.622518:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17155 00000100:00100000:1.0:1762167009.622529:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17156 00000100:00100000:3.0:1762167009.622537:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17157 00000100:00100000:1.0:1762167009.622541:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454501760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.622549:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454501888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.622701:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454501888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 155us (1057us total) trans 21474843483 rc 0/0 00000100:00100000:3.0:1762167009.622707:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17157 00000004:00080000:3.0:1762167009.622740:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb10e00/2, rc 0, transno 21474843481 00000100:00100000:3.0:1762167009.622744:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454500480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.622751:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb13800/2, rc 0, transno 21474843482 00000100:00100000:3.0:1762167009.622753:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454500992:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.622785:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb11c00/2, rc 0, transno 21474843478 00000100:00100000:3.0:1762167009.622790:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454500864:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.622803:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242ce9f80/2, rc 0, transno 21474843480 00000100:00100000:3.0:1762167009.622808:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454501376:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.622828:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242ceaa00/2, rc 0, transno 21474843483 00000100:00100000:3.0:1762167009.622831:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454501888:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167009.622838:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee245188380/2, rc 0, transno 17179875927 00000100:00100000:3.0:1762167009.622840:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454501504:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167009.622909:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee245189180/2, rc 0, transno 17179875926 00000100:00100000:2.0:1762167009.622914:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454501632:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167009.622926:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.622931:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.622933:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167009.622936:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.622938:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167009.622984:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454501760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 446us (1378us total) trans 21474843484 rc 0/0 00000100:00100000:1.0:1762167009.622992:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17156 00000004:00080000:2.0:1762167009.622997:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242ce8380/2, rc 0, transno 21474843484 00000100:00100000:2.0:1762167009.623002:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454501760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.623102:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.623161:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933312 00000100:00100000:0.0:1762167009.623167:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933312 00000100:00100000:0.0:1762167009.623209:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19931 00000100:00100000:0.0:1762167009.623216:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56215:x1847765451933312:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.623230:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.623249:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b54e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d43 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.623298:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b54e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d43 expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.623318:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b54e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d43 expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.623336:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.623339:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167009.623342:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ce00, rc 0) 00000100:00100000:0.0:1762167009.623401:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56215:x1847765451933312:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 184us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.623408:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19931 00000100:00100000:2.0:1762167009.626270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.626434:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933440 00000100:00100000:0.0:1762167009.626444:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933440 00000100:00100000:0.0:1762167009.626507:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19932 00000100:00100000:0.0:1762167009.626517:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56215:x1847765451933440:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.626537:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.626556:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b555 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d4a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.626636:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b55c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.626649:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b55c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.626659:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b55c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167009.626684:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:0.0:1762167009.626688:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167009.626704:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b55c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.626729:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b555 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d4a expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.626748:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b55c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d4a expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.626757:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.626760:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167009.626870:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30cc00, rc 0) 00000100:00100000:0.0:1762167009.626931:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56215:x1847765451933440:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 415us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.626942:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19932 00000100:00100000:3.0:1762167009.628733:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.628839:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.628884:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.628963:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933568 00000100:00100000:2.0:1762167009.628964:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933824 00000100:00100000:0.0:1762167009.628965:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933696 00000100:00100000:1.0:1762167009.628972:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933568 00000100:00100000:2.0:1762167009.628973:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933824 00000100:00100000:0.0:1762167009.628973:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933696 00000100:00100000:0.0:1762167009.629039:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17158 00000100:00100000:0.0:1762167009.629047:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451933824:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.629061:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.629080:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b563 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d5f expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.629090:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17159 00000100:00100000:1.0:1762167009.629103:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17160 00000100:00100000:3.0:1762167009.629105:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451933696:12345-192.168.203.35@tcp:101:lfs.0 00002000:00010000:0.0:1762167009.629105:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888e1, atime: 0x690888e1, ctime: 0x690888e1, blocks: 0x3 00000100:00100000:1.0:1762167009.629117:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451933568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.629120:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167009.629127:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.629128:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.629132:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.629139:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b56a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d51 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.629142:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d5f expref: 21 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167009.629146:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b571 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d58 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167009.629161:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 201220, mtime: 0x690888e1, atime: 0x690888e1, ctime: 0x690888e1, blocks: 0x1a7 00010000:00010000:0.0:1762167009.629175:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d5f expref: 22 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.629176:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.629179:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1762167009.629182:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888e1, atime: 0x690888e1, ctime: 0x690888e1, blocks: 0x3 00010000:00010000:1.0:1762167009.629189:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b56a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d51 expref: 22 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167009.629195:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30da00, rc 0) 00010000:00010000:3.0:1762167009.629198:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.629203:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.629204:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b56a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d51 expref: 22 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167009.629212:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d58 expref: 32 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167009.629216:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7bc00, rc 0) 00010000:00010000:3.0:1762167009.629231:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d58 expref: 32 pid: 12402 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167009.629252:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451933824:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 205us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.629260:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17158 00000100:00100000:1.0:1762167009.629299:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451933568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 186us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.629306:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17160 00010000:00010000:3.0:1762167009.629485:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167009.629721:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451933696:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 621us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.629729:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17159 00000100:00100000:3.0:1762167009.657271:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.657389:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451933952 00000100:00100000:1.0:1762167009.657400:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451933952 00000100:00100000:1.0:1762167009.657516:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3041 00000100:00100000:1.0:1762167009.657527:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451933952:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167009.657563:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b578 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.657577:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.657580:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.657593:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b578 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.657607:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b578 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.659905:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b578 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.659926:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b578 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.659936:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b578 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.659944:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.659949:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b578 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.659958:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b578 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.659977:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b578 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.659985:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b578 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.660058:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451933952:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2530us (2793us total) trans 0 rc 201220/201220 00000100:00100000:0.0:1762167009.660066:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3041 00000100:00100000:2.0:1762167009.662796:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.662861:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934080 00000100:00100000:0.0:1762167009.662871:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934080 00000100:00100000:0.0:1762167009.662936:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3042 00000100:00100000:0.0:1762167009.662948:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451934080:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167009.662996:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 131446, mtime: 0x690888e1, atime: 0x690888d5, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:0.0:1762167009.663005:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b57f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.663022:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.663025:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.663030:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b57f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.663043:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b57f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167009.685235:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875928 is committed 00000001:00080000:3.0:1762167009.685255:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875923 is committed 00000001:00080000:3.0:1762167009.685267:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875926 is committed 00000001:00080000:3.0:1762167009.685311:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875927 is committed 00002000:00010000:0.0:1762167009.685375:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 131446 -> 204800 00010000:00010000:0.0:1762167009.685394:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b57f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.685406:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b57f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.685415:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b57f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.685422:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.685426:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b57f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.685434:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b57f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.685451:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b57f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.685458:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b57f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.685547:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451934080:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 22599us (22756us total) trans 17179875928 rc 0/0 00000100:00100000:0.0:1762167009.685556:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3042 00000100:00100000:3.0:1762167009.687932:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.687976:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934208 00000100:00100000:0.0:1762167009.687986:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934208 00000100:00100000:0.0:1762167009.688052:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3043 00000100:00100000:0.0:1762167009.688061:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451934208:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167009.688114:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 131446, mtime: 0x690888e1, atime: 0x690888db, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:0.0:1762167009.688123:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b586 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.688136:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.688138:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.688144:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.688157:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167009.703289:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843485 is committed 00000001:00080000:1.0:1762167009.703313:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843481 is committed 00000001:00080000:1.0:1762167009.703334:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843484 is committed 00002000:00010000:3.0:1762167009.703433:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 131446 -> 204800 00010000:00010000:3.0:1762167009.703448:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.703460:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b586 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.703468:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b586 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.703475:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167009.703480:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b586 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.703489:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b586 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.703507:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b586 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.703514:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b586 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.703610:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451934208:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 15544us (15680us total) trans 21474843485 rc 0/0 00000100:00100000:3.0:1762167009.703622:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3043 00010000:00010000:2.0:1762167009.703884:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762167009.706307:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.706362:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934336 00000100:00100000:3.0:1762167009.706385:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934336 00000100:00100000:3.0:1762167009.706462:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3044 00000100:00100000:3.0:1762167009.706484:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee373e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451934336:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167009.706537:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 131446, mtime: 0x690888e1, atime: 0x690888db, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:3.0:1762167009.706546:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b58d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.706559:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.706561:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.706566:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b58d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.706579:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b58d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167009.719934:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875929 is committed 00002000:00010000:0.0:1762167009.720089:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 131446 -> 204800 00010000:00010000:0.0:1762167009.720106:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b58d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.720116:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b58d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.720124:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b58d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.720132:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167009.720136:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b58d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.720145:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b58d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.720163:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b58d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.720171:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b58d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.720273:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee373e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451934336:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13788us (13969us total) trans 17179875929 rc 0/0 00000100:00100000:0.0:1762167009.720284:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3044 00000100:00100000:2.0:1762167009.722895:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.722972:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934464 00000100:00100000:0.0:1762167009.722981:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934464 00000100:00100000:0.0:1762167009.723050:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3045 00000100:00100000:0.0:1762167009.723060:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451934464:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167009.723105:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 131446, mtime: 0x690888e1, atime: 0x690888dd, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:0.0:1762167009.723114:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b594 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.723127:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.723130:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.723136:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.723149:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167009.736435:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875930 is committed 00002000:00010000:3.0:1762167009.736581:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 131446 -> 204800 00002000:00010000:3.0:1762167009.736585:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:3.0:1762167009.736588:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00010000:00010000:3.0:1762167009.736600:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.736611:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.736620:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.736626:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167009.736631:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.736639:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b594 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.736657:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b594 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.736662:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b594 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.736758:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451934464:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13695us (13866us total) trans 17179875930 rc 0/0 00000100:00100000:3.0:1762167009.736803:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3045 00000100:00100000:2.0:1762167009.739728:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.739811:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934592 00000100:00100000:3.0:1762167009.739824:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934592 00000100:00100000:3.0:1762167009.739907:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3046 00000100:00100000:3.0:1762167009.739918:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451934592:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167009.739971:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 131446, mtime: 0x690888e1, atime: 0x690888dd, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:3.0:1762167009.739979:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b59b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.739995:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.739997:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.740001:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b59b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.740011:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b59b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167009.753231:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843486 is committed 00002000:00010000:2.0:1762167009.753379:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 131446 -> 204800 00002000:00010000:2.0:1762167009.753384:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.753387:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00010000:00010000:2.0:1762167009.753400:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b59b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.753411:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b59b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.753420:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.753428:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.753432:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.753447:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.753465:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b59b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.753472:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b59b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.753567:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451934592:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13648us (13845us total) trans 21474843486 rc 0/0 00000100:00100000:2.0:1762167009.753577:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3046 00000100:00100000:0.0:1762167009.755850:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.755914:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934720 00000100:00100000:2.0:1762167009.755928:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934720 00000100:00100000:2.0:1762167009.755993:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3047 00000100:00100000:2.0:1762167009.756004:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451934720:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:2.0:1762167009.756037:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.756055:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 17 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.756062:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.756064:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.756067:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.756102:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 17 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.756117:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 17 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.756130:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454502016:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.756196:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.757249:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454502016:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.757269:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.757460:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.757567:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934848 00000100:00100000:3.0:1762167009.757574:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934848 00010000:00010000:3.0:1762167009.757601:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 18 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.757634:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7580 00000100:00100000:3.0:1762167009.757642:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451934848:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167009.757655:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.757674:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 18 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.757686:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 18 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.757705:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b48a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->28671) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cef expref: 18 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.757718:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.757720:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.757724:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.757733:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.757787:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167009.757824:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451934848:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 181us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.757831:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7580 00010000:00010000:2.0:1762167009.757847:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.757858:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167009.770050:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843487 is committed 00002000:00010000:2.0:1762167009.770184:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 131446 -> 204800 00002000:00010000:2.0:1762167009.770187:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.770189:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00010000:00010000:2.0:1762167009.770200:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.770208:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.770218:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.770223:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.770226:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.770231:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.770244:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.770248:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b5a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.770337:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451934720:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14330us (14490us total) trans 21474843487 rc 0/0 00000100:00100000:2.0:1762167009.770348:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3047 00000100:00100000:1.0:1762167009.773011:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.773060:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451934976 00000100:00100000:2.0:1762167009.773070:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451934976 00000100:00100000:2.0:1762167009.773135:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3048 00000100:00100000:2.0:1762167009.773144:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451934976:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167009.773184:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 131446, mtime: 0x690888e1, atime: 0x690888de, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:2.0:1762167009.773190:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0b5a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.773204:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.773206:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.773210:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0b5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.773219:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0b5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167009.784655:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875931 is committed 00002000:00010000:3.0:1762167009.784833:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 131446 -> 204800 00002000:00010000:3.0:1762167009.784838:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:3.0:1762167009.784841:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00010000:00010000:3.0:1762167009.784854:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0b5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.784864:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0b5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.784872:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0b5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.784879:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167009.784884:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0b5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.784893:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0b5a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.784911:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0b5a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.784918:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0b5a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.785018:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451934976:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 11870us (12011us total) trans 17179875931 rc 0/0 00000100:00100000:3.0:1762167009.785028:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3048 00000100:00100000:0.0:1762167009.787606:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.787674:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935104 00000100:00100000:3.0:1762167009.787694:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935104 00000100:00100000:3.0:1762167009.787793:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3049 00000100:00100000:3.0:1762167009.787807:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451935104:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167009.787858:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 131446, mtime: 0x690888e1, atime: 0x690888e0, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:3.0:1762167009.787866:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.787877:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.787880:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.787884:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.787897:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167009.799968:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843488 is committed 00002000:00010000:2.0:1762167009.800112:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 131446 -> 204800 00002000:00010000:2.0:1762167009.800117:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.800120:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00010000:00010000:2.0:1762167009.800131:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.800140:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.800146:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.800150:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.800153:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.800158:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.800171:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.800177:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.800253:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451935104:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 12447us (12651us total) trans 21474843488 rc 0/0 00000100:00100000:2.0:1762167009.800260:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3049 00000100:00100000:0.0:1762167009.808730:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.808808:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935360 00000100:00100000:3.0:1762167009.808816:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935360 00000100:00100000:3.0:1762167009.808872:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19933 00000100:00100000:3.0:1762167009.808883:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56215:x1847765451935360:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.808936:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.808963:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b55c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d4a expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.808982:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.808986:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.809188:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.809202:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.809208:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762167009.809251:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953029 00000004:00010000:3.0:1762167009.809275:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000052ab20b3 reply state 00000000d987c1aa transno 8589953030 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.809283:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.809382:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56215:x1847765451935360:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 483us (641us total) trans 8589953030 rc 0/0 00000100:00100000:3.0:1762167009.809388:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19933 00000020:00080000:3.0:1762167009.809393:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167009.810265:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.810276:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.810284:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.810290:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.810294:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.810301:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.810312:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:2.0:1762167009.810314:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.810318:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.810325:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b5b7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167009.810471:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.810523:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935488 00000100:00100000:3.0:1762167009.810575:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935488 00000100:00100000:3.0:1762167009.810619:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17161 00000100:00100000:3.0:1762167009.810627:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56215:x1847765451935488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.810639:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.810656:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b5be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d66 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167009.810677:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 204800, mtime: 0x690888e1, atime: 0x690888d5, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:3.0:1762167009.810694:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.810696:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.810704:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b5be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d66 expref: 23 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.810723:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b5be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d66 expref: 23 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.810732:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167009.810810:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56215:x1847765451935488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 183us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.810817:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17161 00000100:00100000:0.0:1762167009.811911:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.811975:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.812034:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935744 00000100:00100000:2.0:1762167009.812041:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935616 00000100:00100000:1.0:1762167009.812041:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935744 00000100:00100000:2.0:1762167009.812048:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935616 00002000:00010000:2.0:1762167009.812070:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (201220->18446744073709551615) 00002000:00010000:1.0:1762167009.812070:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.812076:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e473480 with x1847765451935616 ext(201220->18446744073709551615) 00002000:00100000:1.0:1762167009.812077:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e470700 with x1847765451935744 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.812088:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e473480. 00002000:00010000:1.0:1762167009.812088:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e470700. 00000100:00100000:2.0:1762167009.812129:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3050 00000100:00100000:2.0:1762167009.812139:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451935616:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167009.812150:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3051 00000100:00100000:1.0:1762167009.812163:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451935744:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167009.812530:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.812531:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 204800 -> 201220 00002000:00010000:1.0:1762167009.812537:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.812538:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167009.812542:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167009.812544:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167009.812547:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.812549:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167009.812552:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167009.812554:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167009.812606:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451935744:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 447us (697us total) trans 21474843489 rc 0/0 00000100:00100000:1.0:1762167009.812615:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3051 00002000:00010000:1.0:1762167009.812619:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:1.0:1762167009.812621:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e470700 with x1847765451935744 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167009.812627:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e470700. 00000100:00100000:2.0:1762167009.812655:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451935616:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 516us (678us total) trans 17179875932 rc 0/0 00000100:00100000:2.0:1762167009.812663:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3050 00002000:00010000:2.0:1762167009.812667:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (201220->18446744073709551615) 00002000:00100000:2.0:1762167009.812671:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e473480 with x1847765451935616 ext(201220->18446744073709551615) 00002000:00010000:2.0:1762167009.812677:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e473480. 00000100:00100000:1.0:1762167009.813861:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.813966:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451935872 00000100:00100000:3.0:1762167009.813972:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451935872 00000100:00100000:3.0:1762167009.814009:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19934 00000100:00100000:3.0:1762167009.814016:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56215:x1847765451935872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.814032:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.814048:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b5c5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d6d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.814113:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b5cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.814126:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b5cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.814135:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b5cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167009.814157:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:3.0:1762167009.814161:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.814174:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b5cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.814196:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b5c5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d6d expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.814211:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b5cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d6d expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.814219:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.814222:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.814225:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:3.0:1762167009.814262:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56215:x1847765451935872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 245us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.814268:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19934 00000100:00100000:3.0:1762167009.815465:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.815521:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936128 00000100:00100000:0.0:1762167009.815529:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936128 00000100:00100000:0.0:1762167009.815565:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19935 00000100:00100000:0.0:1762167009.815572:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56215:x1847765451936128:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167009.815600:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167009.815614:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b5cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d6d expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.815625:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.815628:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167009.815834:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.815846:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.815852:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:0.0:1762167009.815901:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953031 00000004:00010000:0.0:1762167009.815927:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000055e806fc reply state 00000000328e0cdd transno 8589953032 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167009.815935:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167009.816012:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56215:x1847765451936128:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 440us (547us total) trans 8589953032 rc 0/0 00000100:00100000:0.0:1762167009.816019:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19935 00000020:00080000:0.0:1762167009.816024:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167009.816635:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.816645:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.816651:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.816658:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167009.816661:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.816668:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.816679:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:1.0:1762167009.816682:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167009.816686:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.816692:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b5d3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.816823:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.816861:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936256 00000100:00100000:0.0:1762167009.816865:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936256 00000100:00100000:0.0:1762167009.816898:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17162 00000100:00100000:0.0:1762167009.816906:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56215:x1847765451936256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.816917:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.816932:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b5da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d74 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167009.816962:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 204800, mtime: 0x690888e1, atime: 0x690888db, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:0.0:1762167009.816978:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.816980:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.816987:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b5da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d74 expref: 18 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.816999:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b5da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d74 expref: 18 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.817013:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c400, rc 0) 00000100:00100000:0.0:1762167009.817050:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56215:x1847765451936256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 144us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.817057:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17162 00000100:00100000:0.0:1762167009.818260:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.818318:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936384 00000100:00100000:2.0:1762167009.818324:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936384 00002000:00010000:2.0:1762167009.818357:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (201220->18446744073709551615) 00002000:00100000:2.0:1762167009.818362:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e470380 with x1847765451936384 ext(201220->18446744073709551615) 00002000:00010000:2.0:1762167009.818383:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e470380. 00000100:00100000:2.0:1762167009.818420:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3052 00000100:00100000:3.0:1762167009.818422:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.818432:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451936384:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167009.818461:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936512 00000100:00100000:0.0:1762167009.818466:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936512 00002000:00010000:0.0:1762167009.818484:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167009.818488:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242523800 with x1847765451936512 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167009.818496:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242523800. 00000100:00100000:0.0:1762167009.818524:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3053 00000100:00100000:0.0:1762167009.818533:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2358:x1847765451936512:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167009.818743:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 204800 -> 201220 00002000:00010000:2.0:1762167009.818748:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:0.0:1762167009.818749:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.818752:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167009.818754:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.818757:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:0.0:1762167009.818759:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167009.818786:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167009.818795:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:0.0:1762167009.818799:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.818845:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765451936512:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 307us (420us total) trans 17179875933 rc 0/0 00000100:00100000:2.0:1762167009.818846:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451936384:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 410us (582us total) trans 21474843490 rc 0/0 00000100:00100000:0.0:1762167009.818859:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3053 00002000:00010000:0.0:1762167009.818863:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167009.818865:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242523800 with x1847765451936512 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167009.818870:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3052 00002000:00010000:0.0:1762167009.818873:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242523800. 00002000:00010000:2.0:1762167009.818880:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (201220->18446744073709551615) 00002000:00100000:2.0:1762167009.818886:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e470380 with x1847765451936384 ext(201220->18446744073709551615) 00002000:00010000:2.0:1762167009.818893:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e470380. 00000100:00100000:0.0:1762167009.820092:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.820143:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936640 00000100:00100000:3.0:1762167009.820157:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936640 00000100:00100000:3.0:1762167009.820224:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19936 00000100:00100000:3.0:1762167009.820235:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56215:x1847765451936640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.820260:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.820286:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d7b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.820391:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b5e8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.820406:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.820418:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167009.820460:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:3.0:1762167009.820465:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.820486:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.820520:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b5e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d7b expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.820543:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d7b expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.820552:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.820556:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.820560:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167009.820624:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56215:x1847765451936640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 391us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.820632:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19936 00000100:00100000:1.0:1762167009.822033:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.822131:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451936896 00000100:00100000:3.0:1762167009.822140:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451936896 00000100:00100000:3.0:1762167009.822189:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19937 00000100:00100000:3.0:1762167009.822200:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56215:x1847765451936896:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.822249:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.822273:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b5e8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d7b expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.822294:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.822297:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.822576:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.822592:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.822601:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762167009.822668:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953033 00000004:00010000:3.0:1762167009.822695:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000044c0ae69 reply state 00000000ed0cb908 transno 8589953034 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.822706:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.822825:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56215:x1847765451936896:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 626us (797us total) trans 8589953034 rc 0/0 00000100:00100000:3.0:1762167009.822835:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19937 00000020:00080000:3.0:1762167009.822841:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167009.823673:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.823686:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.823691:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.823696:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.823699:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.823705:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.823718:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:2.0:1762167009.823720:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.823723:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.823730:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b5ef lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167009.824030:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.824088:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451937024 00000100:00100000:0.0:1762167009.824096:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451937024 00000100:00100000:0.0:1762167009.824148:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17163 00000100:00100000:0.0:1762167009.824159:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56215:x1847765451937024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.824176:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.824198:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b5f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d82 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167009.824222:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 204800, mtime: 0x690888e1, atime: 0x690888db, ctime: 0x690888e1, blocks: 0x203 00010000:00010000:0.0:1762167009.824239:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.824241:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167009.824247:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d82 expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.824259:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d82 expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.824267:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167009.824305:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56215:x1847765451937024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 151us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.824310:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17163 00000100:00100000:0.0:1762167009.825392:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.825423:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.825447:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451937280 00000100:00100000:2.0:1762167009.825456:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451937280 00000100:00100000:1.0:1762167009.825483:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451937152 00000100:00100000:1.0:1762167009.825490:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451937152 00002000:00010000:2.0:1762167009.825491:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.825498:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e471c00 with x1847765451937280 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.825511:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e471c00. 00002000:00010000:1.0:1762167009.825511:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (201220->18446744073709551615) 00002000:00100000:1.0:1762167009.825518:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e472300 with x1847765451937152 ext(201220->18446744073709551615) 00002000:00010000:1.0:1762167009.825526:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e472300. 00000100:00100000:2.0:1762167009.825558:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3054 00000100:00100000:2.0:1762167009.825572:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451937280:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167009.825581:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3055 00000100:00100000:1.0:1762167009.825594:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451937152:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167009.825926:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.825926:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 204800 -> 201220 00002000:00010000:1.0:1762167009.825932:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.825933:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167009.825936:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167009.825938:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167009.825939:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.825943:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167009.825943:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167009.825950:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167009.825993:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451937152:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 403us (568us total) trans 17179875934 rc 0/0 00000100:00100000:2.0:1762167009.826000:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451937280:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 432us (611us total) trans 21474843491 rc 0/0 00000100:00100000:1.0:1762167009.826000:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3055 00002000:00010000:1.0:1762167009.826006:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (201220->18446744073709551615) 00002000:00100000:1.0:1762167009.826010:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e472300 with x1847765451937152 ext(201220->18446744073709551615) 00000100:00100000:2.0:1762167009.826015:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3054 00002000:00010000:1.0:1762167009.826016:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e472300. 00002000:00010000:2.0:1762167009.826019:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.826024:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e471c00 with x1847765451937280 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.826029:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e471c00. 00000100:00100000:3.0:1762167009.827277:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.827337:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451937408 00000100:00100000:0.0:1762167009.827345:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451937408 00000100:00100000:0.0:1762167009.827406:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19938 00000100:00100000:0.0:1762167009.827417:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56215:x1847765451937408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167009.827440:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167009.827458:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b5fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d89 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.827549:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b604 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.827565:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b604 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.827576:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b604 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167009.827603:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:0.0:1762167009.827606:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167009.827624:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b604 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167009.827651:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b5fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d89 expref: 899 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.827672:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b604 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d89 expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.827681:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.827684:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167009.827688:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167009.827727:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56215:x1847765451937408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 314us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.827732:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19938 00000100:00100000:0.0:1762167009.829455:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.829649:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451937664 00000100:00100000:3.0:1762167009.829662:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451937664 00000100:00100000:3.0:1762167009.829728:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19939 00000100:00100000:3.0:1762167009.829738:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56215:x1847765451937664:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.829832:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.829860:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b604 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d89 expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.829882:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.829886:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.830057:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.830070:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.830079:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762167009.830127:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953035 00000004:00010000:3.0:1762167009.830151:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000922bbacb reply state 00000000b7f5c47d transno 8589953036 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.830159:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.830262:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56215:x1847765451937664:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 526us (824us total) trans 8589953036 rc 0/0 00000100:00100000:3.0:1762167009.830268:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19939 00000020:00080000:3.0:1762167009.830274:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167009.831232:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.831245:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.831252:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.831258:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167009.831262:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.831269:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.831280:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:1.0:1762167009.831283:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167009.831287:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.831293:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b60b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167009.831439:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.831528:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451937792 00000100:00100000:3.0:1762167009.831533:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451937792 00000100:00100000:3.0:1762167009.831577:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17164 00000100:00100000:3.0:1762167009.831585:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56215:x1847765451937792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.831598:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.831616:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b612 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d90 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167009.831637:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 204800, mtime: 0x690888e2, atime: 0x690888dd, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167009.831655:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.831657:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.831663:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b612 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d90 expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.831674:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b612 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d90 expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.831682:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:3.0:1762167009.831722:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56215:x1847765451937792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 137us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.831729:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17164 00000100:00100000:3.0:1762167009.832899:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.832948:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.832981:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451937920 00000100:00100000:2.0:1762167009.832995:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451937920 00000100:00100000:1.0:1762167009.833008:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938048 00000100:00100000:1.0:1762167009.833016:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938048 00002000:00010000:2.0:1762167009.833046:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (201220->18446744073709551615) 00002000:00010000:1.0:1762167009.833046:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.833055:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242520700 with x1847765451937920 ext(201220->18446744073709551615) 00002000:00100000:1.0:1762167009.833055:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242522a00 with x1847765451938048 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.833070:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242520700. 00002000:00010000:1.0:1762167009.833070:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242522a00. 00000100:00100000:1.0:1762167009.833113:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3056 00000100:00100000:1.0:1762167009.833127:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451938048:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167009.833134:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3057 00000100:00100000:2.0:1762167009.833147:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451937920:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167009.833483:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.833486:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167009.833490:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167009.833492:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.833493:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 204800 -> 201220 00002000:00010000:1.0:1762167009.833494:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167009.833501:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.833504:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167009.833507:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.833510:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167009.833560:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451938048:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 438us (612us total) trans 21474843492 rc 0/0 00000100:00100000:1.0:1762167009.833565:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3056 00000100:00100000:2.0:1762167009.833571:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451937920:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 425us (673us total) trans 17179875935 rc 0/0 00002000:00010000:1.0:1762167009.833572:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:1.0:1762167009.833577:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242522a00 with x1847765451938048 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167009.833587:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242522a00. 00000100:00100000:2.0:1762167009.833591:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3057 00002000:00010000:2.0:1762167009.833596:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (201220->18446744073709551615) 00002000:00100000:2.0:1762167009.833600:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242520700 with x1847765451937920 ext(201220->18446744073709551615) 00002000:00010000:2.0:1762167009.833606:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee242520700. 00000100:00100000:0.0:1762167009.835048:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.835086:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938176 00000100:00100000:3.0:1762167009.835096:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938176 00000100:00100000:3.0:1762167009.835145:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19940 00000100:00100000:3.0:1762167009.835154:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56215:x1847765451938176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.835174:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.835192:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b619 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d97 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.835271:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b620 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.835284:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b620 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.835294:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b620 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167009.835318:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:3.0:1762167009.835322:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.835337:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b620 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.835359:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b619 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d97 expref: 901 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.835398:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b620 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d97 expref: 900 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.835406:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.835410:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.835413:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922200, rc 0) 00000100:00100000:3.0:1762167009.835470:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56215:x1847765451938176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 316us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.835477:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19940 00000100:00100000:0.0:1762167009.837184:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.837273:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938432 00000100:00100000:3.0:1762167009.837278:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938432 00000100:00100000:3.0:1762167009.837315:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19941 00000100:00100000:3.0:1762167009.837323:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56215:x1847765451938432:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.837375:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.837396:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b620 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d97 expref: 900 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.837410:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.837414:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.837591:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.837601:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.837607:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762167009.837653:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953037 00000004:00010000:3.0:1762167009.837675:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000104ba1de reply state 000000005fbf2771 transno 8589953038 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.837684:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.837745:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56215:x1847765451938432:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 423us (565us total) trans 8589953038 rc 0/0 00000100:00100000:3.0:1762167009.837750:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19941 00000020:00080000:3.0:1762167009.837753:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167009.838531:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.838542:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.838549:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.838555:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.838559:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.838566:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.838580:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:2.0:1762167009.838583:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.838586:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.838591:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b627 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167009.838715:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.838849:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938560 00000100:00100000:3.0:1762167009.838854:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938560 00000100:00100000:3.0:1762167009.838889:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17165 00000100:00100000:3.0:1762167009.838897:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56215:x1847765451938560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.838909:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.838926:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b62e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3d9e expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167009.838947:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 204800, mtime: 0x690888e2, atime: 0x690888dd, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167009.838961:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.838963:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.838969:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b62e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d9e expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.838986:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b62e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d9e expref: 22 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.838995:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:3.0:1762167009.839029:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56215:x1847765451938560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 133us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.839035:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17165 00000100:00100000:0.0:1762167009.840103:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.840141:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.840143:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938688 00000100:00100000:2.0:1762167009.840148:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938688 00002000:00010000:2.0:1762167009.840169:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (201220->18446744073709551615) 00002000:00100000:2.0:1762167009.840172:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047f480 with x1847765451938688 ext(201220->18446744073709551615) 00002000:00010000:2.0:1762167009.840179:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047f480. 00000100:00100000:2.0:1762167009.840197:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938816 00000100:00100000:2.0:1762167009.840201:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938816 00002000:00010000:2.0:1762167009.840210:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.840213:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047e680 with x1847765451938816 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167009.840213:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3058 00002000:00010000:2.0:1762167009.840222:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee35047e680. 00000100:00100000:1.0:1762167009.840230:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451938688:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167009.840238:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3059 00000100:00100000:2.0:1762167009.840247:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451938816:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167009.840469:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.840473:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.840476:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167009.840479:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167009.840481:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 204800 -> 201220 00002000:00010000:2.0:1762167009.840482:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.840488:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167009.840492:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167009.840495:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167009.840498:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167009.840532:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451938816:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 286us (393us total) trans 17179875936 rc 0/0 00000100:00100000:1.0:1762167009.840540:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2358:x1847765451938688:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 313us (441us total) trans 21474843493 rc 0/0 00000100:00100000:2.0:1762167009.840554:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3059 00002000:00010000:2.0:1762167009.840559:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00000100:00100000:1.0:1762167009.840562:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3058 00002000:00100000:2.0:1762167009.840564:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047e680 with x1847765451938816 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167009.840568:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (201220->18446744073709551615) 00002000:00010000:2.0:1762167009.840571:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee35047e680. 00002000:00100000:1.0:1762167009.840572:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047f480 with x1847765451938688 ext(201220->18446744073709551615) 00002000:00010000:1.0:1762167009.840581:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047f480. 00000100:00100000:0.0:1762167009.841972:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.842020:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451938944 00000100:00100000:3.0:1762167009.842026:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451938944 00000100:00100000:3.0:1762167009.842073:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19942 00000100:00100000:3.0:1762167009.842081:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56215:x1847765451938944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.842097:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.842116:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b635 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3da5 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.842180:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b63c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.842193:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b63c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.842203:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b63c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167009.842226:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:3.0:1762167009.842230:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.842255:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b63c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.842283:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b635 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3da5 expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.842298:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b63c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3da5 expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.842305:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.842308:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.842311:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00000100:00100000:3.0:1762167009.842353:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56215:x1847765451938944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 273us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.842360:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19942 00000100:00100000:0.0:1762167009.843986:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.844060:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939200 00000100:00100000:3.0:1762167009.844070:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939200 00000100:00100000:3.0:1762167009.844113:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19943 00000100:00100000:3.0:1762167009.844121:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56215:x1847765451939200:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.844160:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.844184:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b63c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3da5 expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.844197:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.844201:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.844399:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.844410:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.844423:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762167009.844464:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953039 00000004:00010000:3.0:1762167009.844488:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005091aca4 reply state 00000000bac5469f transno 8589953040 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.844496:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.844556:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56215:x1847765451939200:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 435us (573us total) trans 8589953040 rc 0/0 00000100:00100000:3.0:1762167009.844564:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19943 00000020:00080000:3.0:1762167009.844568:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167009.845440:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.845460:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.845466:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.845471:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc2129310) 00000100:00100000:0.0:1762167009.845477:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167009.845478:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.845488:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.845501:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:1.0:1762167009.845504:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167009.845508:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.845514:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b643 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.845579:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939328 00000100:00100000:3.0:1762167009.845585:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939328 00000100:00100000:3.0:1762167009.845627:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17166 00000100:00100000:3.0:1762167009.845635:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56215:x1847765451939328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.845647:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.845662:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b64a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3dac expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167009.845682:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 204800, mtime: 0x690888e2, atime: 0x690888de, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167009.845700:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.845702:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.845710:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dac expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.845725:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dac expref: 24 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.845741:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167009.845799:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56215:x1847765451939328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 163us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.845806:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17166 00000100:00100000:0.0:1762167009.847034:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.847069:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.847092:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939456 00000100:00100000:1.0:1762167009.847099:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939456 00000100:00100000:2.0:1762167009.847118:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939584 00000100:00100000:2.0:1762167009.847128:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939584 00002000:00010000:1.0:1762167009.847131:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (201220->18446744073709551615) 00002000:00100000:1.0:1762167009.847137:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047c380 with x1847765451939456 ext(201220->18446744073709551615) 00002000:00010000:1.0:1762167009.847146:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047c380. 00002000:00010000:2.0:1762167009.847149:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00100000:2.0:1762167009.847154:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb11f80 with x1847765451939584 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.847162:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb11f80. 00000100:00100000:1.0:1762167009.847174:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3060 00000100:00100000:1.0:1762167009.847184:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451939456:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167009.847195:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3061 00000100:00100000:2.0:1762167009.847206:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451939584:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167009.847465:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.847469:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.847472:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167009.847472:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 204800 -> 201220 00002000:00010000:2.0:1762167009.847479:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167009.847479:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.847486:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.847486:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167009.847493:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167009.847497:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167009.847536:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451939584:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 331us (465us total) trans 17179875937 rc 0/0 00000100:00100000:1.0:1762167009.847538:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451939456:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 355us (506us total) trans 21474843494 rc 0/0 00000100:00100000:1.0:1762167009.847547:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3060 00002000:00010000:1.0:1762167009.847552:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (201220->18446744073709551615) 00000100:00100000:2.0:1762167009.847557:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3061 00002000:00100000:1.0:1762167009.847557:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee35047c380 with x1847765451939456 ext(201220->18446744073709551615) 00002000:00010000:2.0:1762167009.847565:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00010000:1.0:1762167009.847566:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee35047c380. 00002000:00100000:2.0:1762167009.847574:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb11f80 with x1847765451939584 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.847581:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb11f80. 00000100:00100000:0.0:1762167009.848903:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.848954:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939712 00000100:00100000:3.0:1762167009.848961:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939712 00000100:00100000:3.0:1762167009.849006:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19944 00000100:00100000:3.0:1762167009.849013:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56215:x1847765451939712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.849030:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.849045:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b651 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3db3 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.849118:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b658 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.849133:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b658 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.849144:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b658 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167009.849165:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:3.0:1762167009.849169:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.849181:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b658 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.849203:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b651 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3db3 expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.849221:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b658 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3db3 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.849228:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.849231:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.849234:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922a00, rc 0) 00000100:00100000:3.0:1762167009.849276:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56215:x1847765451939712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 262us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.849282:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19944 00000100:00100000:0.0:1762167009.850843:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.850924:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451939968 00000100:00100000:3.0:1762167009.850931:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451939968 00000100:00100000:3.0:1762167009.850977:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19945 00000100:00100000:3.0:1762167009.850987:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56215:x1847765451939968:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.851026:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.851047:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b658 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3db3 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.851063:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.851066:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.851250:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.851262:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.851270:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762167009.851327:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953041 00000004:00010000:3.0:1762167009.851352:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000daf57f5b reply state 000000007ba1aaf5 transno 8589953042 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.851376:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.851441:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56215:x1847765451939968:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 456us (603us total) trans 8589953042 rc 0/0 00000100:00100000:3.0:1762167009.851452:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19945 00000020:00080000:3.0:1762167009.851457:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167009.852162:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.852177:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.852183:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.852189:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.852193:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.852199:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.852209:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:2.0:1762167009.852212:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.852223:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.852232:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b65f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167009.852437:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.852519:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940096 00000100:00100000:3.0:1762167009.852525:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940096 00000100:00100000:3.0:1762167009.852568:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17167 00000100:00100000:3.0:1762167009.852577:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56215:x1847765451940096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.852588:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.852605:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b666 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3dba expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167009.852628:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 204800, mtime: 0x690888e2, atime: 0x690888de, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167009.852645:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.852647:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.852652:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dba expref: 32 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.852662:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dba expref: 32 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.852669:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:3.0:1762167009.852703:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56215:x1847765451940096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 127us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.852709:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17167 00000100:00100000:0.0:1762167009.853741:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.853810:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.853834:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940224 00000100:00100000:2.0:1762167009.853840:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940224 00002000:00010000:2.0:1762167009.853865:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (201220->18446744073709551615) 00002000:00100000:2.0:1762167009.853870:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13480 with x1847765451940224 ext(201220->18446744073709551615) 00002000:00010000:2.0:1762167009.853879:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb13480. 00000100:00100000:1.0:1762167009.853879:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940352 00000100:00100000:1.0:1762167009.853888:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940352 00002000:00010000:1.0:1762167009.853908:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00000100:00100000:2.0:1762167009.853912:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3062 00002000:00100000:1.0:1762167009.853914:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb12a00 with x1847765451940352 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167009.853925:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451940224:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167009.853925:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb12a00. 00000100:00100000:1.0:1762167009.853949:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3063 00000100:00100000:1.0:1762167009.853959:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451940352:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167009.854202:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.854207:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167009.854210:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167009.854211:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 204800 -> 201220 00002000:00010000:1.0:1762167009.854215:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.854217:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167009.854222:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167009.854223:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167009.854227:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.854229:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167009.854271:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451940352:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 314us (461us total) trans 21474843495 rc 0/0 00000100:00100000:2.0:1762167009.854279:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451940224:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 356us (538us total) trans 17179875938 rc 0/0 00000100:00100000:1.0:1762167009.854284:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3063 00002000:00010000:1.0:1762167009.854291:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00000100:00100000:2.0:1762167009.854295:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3062 00002000:00100000:1.0:1762167009.854297:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb12a00 with x1847765451940352 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.854301:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (201220->18446744073709551615) 00002000:00010000:1.0:1762167009.854305:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb12a00. 00002000:00100000:2.0:1762167009.854306:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13480 with x1847765451940224 ext(201220->18446744073709551615) 00002000:00010000:2.0:1762167009.854315:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb13480. 00000100:00100000:0.0:1762167009.855343:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.855396:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940480 00000100:00100000:3.0:1762167009.855401:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940480 00000100:00100000:3.0:1762167009.855438:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19946 00000100:00100000:3.0:1762167009.855447:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56215:x1847765451940480:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.855462:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.855478:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b66d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3dc1 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.855544:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b674 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.855554:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b674 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.855560:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b674 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167009.855578:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:3.0:1762167009.855582:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167009.855591:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b674 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.855608:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b66d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc1 expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.855620:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b674 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc1 expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.855629:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.855631:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167009.855633:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:3.0:1762167009.855667:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56215:x1847765451940480:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 221us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.855674:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19946 00000100:00100000:0.0:1762167009.857127:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.857207:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940736 00000100:00100000:3.0:1762167009.857213:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940736 00000100:00100000:3.0:1762167009.857249:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19947 00000100:00100000:3.0:1762167009.857256:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56215:x1847765451940736:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.857290:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.857307:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b674 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc1 expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.857321:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.857325:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.857500:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.857511:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.857519:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:3.0:1762167009.857560:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953043 00000004:00010000:3.0:1762167009.857579:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c4d1ebe0 reply state 00000000e2bf7423 transno 8589953044 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.857593:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.857653:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56215:x1847765451940736:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 397us (530us total) trans 8589953044 rc 0/0 00000100:00100000:3.0:1762167009.857664:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19947 00000020:00080000:3.0:1762167009.857668:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167009.858326:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.858336:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.858342:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.858349:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167009.858353:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.858360:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.858383:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:1.0:1762167009.858385:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167009.858389:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167009.858395:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b67b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167009.858516:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.858580:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940864 00000100:00100000:3.0:1762167009.858585:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940864 00000100:00100000:3.0:1762167009.858617:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17168 00000100:00100000:3.0:1762167009.858624:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56215:x1847765451940864:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.858633:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.858649:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b682 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3dc8 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167009.858666:0:12402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 204800, mtime: 0x690888e2, atime: 0x690888e0, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167009.858678:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.858680:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.858686:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b682 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc8 expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.858699:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b682 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc8 expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.858709:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:3.0:1762167009.858738:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56215:x1847765451940864:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 114us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.858744:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17168 00000100:00100000:0.0:1762167009.859700:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.859734:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.859756:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451940992 00000100:00100000:2.0:1762167009.859781:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451940992 00002000:00010000:2.0:1762167009.859808:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (201220->18446744073709551615) 00000100:00100000:1.0:1762167009.859810:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941120 00002000:00100000:2.0:1762167009.859813:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc5b480 with x1847765451940992 ext(201220->18446744073709551615) 00000100:00100000:1.0:1762167009.859816:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941120 00002000:00010000:2.0:1762167009.859823:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc5b480. 00000100:00100000:2.0:1762167009.859853:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3064 00000100:00100000:2.0:1762167009.859862:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451940992:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167009.859868:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00100000:1.0:1762167009.859873:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc5ad80 with x1847765451941120 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167009.859881:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fc5ad80. 00000100:00100000:1.0:1762167009.859907:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3065 00000100:00100000:1.0:1762167009.859917:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451941120:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167009.860123:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.860128:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 204800 -> 201220 00002000:00010000:1.0:1762167009.860128:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.860135:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167009.860136:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167009.860143:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167009.860143:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167009.860149:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167009.860150:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 1 -> 3 00002000:00010000:2.0:1762167009.860155:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167009.860203:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451941120:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 286us (466us total) trans 17179875939 rc 0/0 00000100:00100000:2.0:1762167009.860204:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451940992:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 341us (505us total) trans 21474843496 rc 0/0 00000100:00100000:1.0:1762167009.860217:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3065 00002000:00010000:1.0:1762167009.860223:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00000100:00100000:2.0:1762167009.860226:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3064 00002000:00100000:1.0:1762167009.860229:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc5ad80 with x1847765451941120 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167009.860232:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (201220->18446744073709551615) 00002000:00010000:1.0:1762167009.860235:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fc5ad80. 00002000:00100000:2.0:1762167009.860237:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc5b480 with x1847765451940992 ext(201220->18446744073709551615) 00002000:00010000:2.0:1762167009.860244:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc5b480. 00000100:00100000:0.0:1762167009.861475:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.861519:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941376 00000100:00100000:3.0:1762167009.861527:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941376 00000100:00100000:3.0:1762167009.861562:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19948 00000100:00100000:3.0:1762167009.861568:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56215:x1847765451941376:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167009.861630:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.861641:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.861648:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:3.0:1762167009.861724:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c9fdea5c reply state 0000000027211a53 transno 8589953045 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167009.861740:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167009.861827:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56215:x1847765451941376:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 257us (354us total) trans 8589953045 rc 0/0 00000100:00100000:3.0:1762167009.861834:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19948 00010000:00010000:2.0:1762167009.862808:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.862821:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.862830:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.862837:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.862841:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.862848:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.862863:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:2.0:1762167009.862866:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.862871:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.862877:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b689 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167009.863044:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.863083:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941504 00000100:00100000:3.0:1762167009.863090:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941504 00000100:00100000:3.0:1762167009.863172:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17169 00000100:00100000:3.0:1762167009.863181:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56215:x1847765451941504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.863193:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.863206:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3dcf expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.863231:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b56a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d51 expref: 29 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167009.863246:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.863248:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.863252:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 29 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.863281:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b56a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d51 expref: 29 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167009.863290:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b56a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d51 expref: 29 pid: 6532 timeout: 730 lvb_type: 1 00000100:00100000:3.0:1762167009.863300:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454502144:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167009.863356:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167009.864438:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454502144:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.864460:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 29 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.864475:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:3.0:1762167009.864574:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56215:x1847765451941504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1393us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.864582:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17169 00000100:00100000:0.0:1762167009.864635:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.864671:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941632 00000100:00100000:3.0:1762167009.864677:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941632 00010000:00010000:3.0:1762167009.864697:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b56a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d51 expref: 29 pid: 6532 timeout: 730 lvb_type: 1 00000100:00100000:3.0:1762167009.864729:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7581 00000100:00100000:3.0:1762167009.864735:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451941632:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167009.864912:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.864931:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b56a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d51 expref: 29 pid: 6532 timeout: 730 lvb_type: 1 00010000:00010000:3.0:1762167009.864940:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b56a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d51 expref: 29 pid: 6532 timeout: 730 lvb_type: 1 00010000:00010000:3.0:1762167009.864960:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b56a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d51 expref: 29 pid: 6532 timeout: 730 lvb_type: 1 00010000:00010000:3.0:1762167009.864972:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.864974:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.864980:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.864988:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.865014:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.865024:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454502272:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167009.865072:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167009.866182:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454502272:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167009.866200:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167009.866244:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.866249:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451941632:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1510us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.866261:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7581 00000100:00100000:2.0:1762167009.866391:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941760 00000100:00100000:2.0:1762167009.866398:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941760 00000100:00100000:2.0:1762167009.866444:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17170 00000100:00100000:2.0:1762167009.866452:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:56215:x1847765451941760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167009.866467:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167009.866483:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3dd6 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.866510:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b571 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d58 expref: 35 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167009.866517:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.866519:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.866523:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 35 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.866548:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d58 expref: 35 pid: 12402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167009.866561:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b571 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d58 expref: 35 pid: 12402 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.866573:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454502400:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.866634:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.867707:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454502400:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.867729:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 35 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.867755:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167009.867831:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:56215:x1847765451941760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1379us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.867845:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17170 00000100:00100000:1.0:1762167009.867934:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.868015:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451941888 00000100:00100000:3.0:1762167009.868022:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451941888 00010000:00010000:3.0:1762167009.868047:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b571 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d58 expref: 35 pid: 12402 timeout: 730 lvb_type: 1 00000100:00100000:3.0:1762167009.868077:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7582 00000100:00100000:3.0:1762167009.868087:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451941888:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167009.868101:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.868119:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b571 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d58 expref: 35 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:3.0:1762167009.868131:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d58 expref: 35 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:3.0:1762167009.868152:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b571 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d58 expref: 35 pid: 12402 timeout: 730 lvb_type: 1 00010000:00010000:3.0:1762167009.868167:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.868169:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.868175:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 34 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.868189:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 34 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.868215:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 34 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.868226:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765454502528:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167009.868284:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167009.869302:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765454502528:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167009.869319:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167009.869384:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451941888:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1297us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.869386:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.869400:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7582 00000100:00100000:2.0:1762167009.869438:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942016 00000100:00100000:2.0:1762167009.869445:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942016 00000100:00100000:2.0:1762167009.869483:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17171 00000100:00100000:2.0:1762167009.869490:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56215:x1847765451942016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167009.869504:0:12402:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167009.869524:0:12402:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ddd expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.869556:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b563 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d5f expref: 29 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167009.869564:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.869566:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.869570:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 29 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.869596:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d5f expref: 29 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167009.869608:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b563 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d5f expref: 29 pid: 33894 timeout: 730 lvb_type: 1 00000100:00100000:2.0:1762167009.869619:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454502656:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.869664:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.870671:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454502656:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.870699:0:12402:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 29 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.870723:0:12402:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167009.870799:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56215:x1847765451942016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1298us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.870809:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17171 00000100:00100000:0.0:1762167009.870908:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.870987:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942144 00000100:00100000:3.0:1762167009.870992:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942144 00010000:00010000:3.0:1762167009.871018:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b563 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d5f expref: 29 pid: 33894 timeout: 730 lvb_type: 1 00000100:00100000:3.0:1762167009.871053:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7583 00000100:00100000:3.0:1762167009.871061:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451942144:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167009.871074:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.871099:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b563 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d5f expref: 29 pid: 33894 timeout: 730 lvb_type: 1 00010000:00010000:3.0:1762167009.871119:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d5f expref: 29 pid: 33894 timeout: 730 lvb_type: 1 00010000:00010000:3.0:1762167009.871141:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b563 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d5f expref: 29 pid: 33894 timeout: 730 lvb_type: 1 00010000:00010000:3.0:1762167009.871159:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.871161:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.871166:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.871176:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.871203:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.871216:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454502784:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167009.871272:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427203c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.872703:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.872740:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.872809:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454502784:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167009.872813:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942272 00000100:00100000:2.0:1762167009.872819:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942528 00000100:00100000:1.0:1762167009.872829:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942272 00000100:00100000:2.0:1762167009.872830:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942528 00000100:00100000:0.0:1762167009.872836:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167009.872865:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167009.872879:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942400 00000100:00100000:0.0:1762167009.872886:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942400 00000100:00100000:2.0:1762167009.872911:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17172 00000100:00100000:1.0:1762167009.872923:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17173 00000100:00100000:2.0:1762167009.872929:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451942528:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167009.872943:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451942272:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:0.0:1762167009.872943:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17174 00000100:00100000:3.0:1762167009.872966:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451942144:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1895us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167009.872968:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451942400:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167009.873000:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7583 00002000:00010000:2.0:1762167009.873283:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.873290:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.873293:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.873293:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.873301:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167009.873303:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 201220 -> 201220 00002000:00010000:0.0:1762167009.873303:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.873305:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.873312:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.873313:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167009.873319:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.873320:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167009.873327:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167009 -> 1762167010 00002000:00010000:0.0:1762167009.873327:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167009.873333:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 423 -> 341 00000100:00100000:1.0:1762167009.873387:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451942272:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 451us (686us total) trans 21474843498 rc 0/0 00000100:00100000:2.0:1762167009.873388:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451942528:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 463us (644us total) trans 21474843497 rc 0/0 00000100:00100000:0.0:1762167009.873389:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451942400:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 430us (562us total) trans 17179875940 rc 0/0 00000100:00100000:1.0:1762167009.873405:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17173 00000100:00100000:2.0:1762167009.873413:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17172 00000100:00100000:0.0:1762167009.873421:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17174 00000100:00100000:0.0:1762167009.874871:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.874969:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942784 00000100:00100000:2.0:1762167009.874977:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942784 00000100:00100000:2.0:1762167009.875027:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7370 00000100:00100000:2.0:1762167009.875037:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56215:x1847765451942784:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167009.875105:0:33886:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b524 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d3c expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.875154:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167009.875168:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b54e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d43 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.875174:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167009.875201:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b54e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d43 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.875210:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b54e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d43 expref: 908 pid: 30817 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.875222:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454502912:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.875306:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.876486:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454502912:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.876513:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167009.876897:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.877005:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451942912 00000100:00100000:3.0:1762167009.877012:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451942912 00010000:00010000:3.0:1762167009.877040:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b54e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d43 expref: 909 pid: 30817 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.877066:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7584 00000100:00100000:3.0:1762167009.877073:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:2360:x1847765451942912:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167009.877084:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.877089:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b54e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d43 expref: 909 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.877098:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b54e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d43 expref: 909 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.877114:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b54e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d43 expref: 909 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.877128:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:3.0:1762167009.877132:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167009.877139:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167009.877144:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167009.877164:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167009.877198:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167009.877205:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2360:x1847765451942912:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 131us (309us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167009.877213:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167009.877217:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7584 00000040:00080000:2.0:1762167009.877888:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5535, 88 off447360 00000004:00080000:2.0:1762167009.877898:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630670134606ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.877993:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5543, 88 off448416 00000004:00080000:2.0:1762167009.878001:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630670237343ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.878034:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5544, 88 off448504 00000004:00080000:2.0:1762167009.878040:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630670277354ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.878069:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5536, 88 off447448 00000004:00080000:2.0:1762167009.878074:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630670310980ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.878108:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5545, 88 off448592 00000004:00080000:2.0:1762167009.878113:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630670350186ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.878140:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5537, 88 off447536 00000004:00080000:2.0:1762167009.878145:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630670382024ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.878177:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5538, 88 off447624 00000004:00080000:2.0:1762167009.878182:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630670418661ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.878210:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5546, 88 off448680 00000004:00080000:2.0:1762167009.878214:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630670451521ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.878243:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5547, 88 off448768 00000004:00080000:2.0:1762167009.878248:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630670485526ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.878276:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5539, 88 off447712 00000004:00080000:2.0:1762167009.878279:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630670516706ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.878307:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5548, 88 off448856 00000004:00080000:2.0:1762167009.878312:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630670549054ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.878342:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5540, 88 off447800 00000004:00080000:2.0:1762167009.878347:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630670584166ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.878391:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5541, 88 off447888 00000004:00080000:2.0:1762167009.878397:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630670634176ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.878428:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5549, 88 off448944 00000004:00080000:2.0:1762167009.878432:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630670669578ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.878458:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5542, 88 off447976 00000004:00080000:2.0:1762167009.878463:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630670700141ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.878512:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5550, 88 off449032 00000004:00080000:2.0:1762167009.878518:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630670755226ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.878547:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5551, 88 off449120 00000004:00080000:2.0:1762167009.878552:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630670789637ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167009.878581:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5543, 88 off448064 00000004:00080000:2.0:1762167009.878586:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630670823188ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.878619:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5544, 88 off448152 00000004:00080000:2.0:1762167009.878624:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630670861064ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167009.878653:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5552, 88 off449208 00000004:00080000:2.0:1762167009.878658:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630670894954ns, next at 630703976179ns, rc = 0 00000001:00080000:3.0:1762167009.889507:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953032 is committed 00000004:00010000:0.0:1762167009.889537:0:33886:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000825717bf reply state 000000000ec3134b transno 8589953046 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000001:00080000:3.0:1762167009.889541:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953046 is committed 00000004:00080000:3.0:1762167009.889545:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3664 committed 00000100:00100000:0.0:1762167009.889552:0:33886:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:3.0:1762167009.889559:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3651 committed 00010000:00010000:0.0:1762167009.889565:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:0.0:1762167009.889568:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:3.0:1762167009.889570:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3650 committed 00000004:00080000:3.0:1762167009.889572:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3663 committed 00000004:00080000:3.0:1762167009.889575:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3662 committed 00000004:00080000:3.0:1762167009.889578:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3649 committed 00010000:00010000:0.0:1762167009.889579:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b524 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d3c expref: 905 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762167009.889584:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3661 committed 00000004:00080000:3.0:1762167009.889587:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3648 committed 00000004:00080000:3.0:1762167009.889590:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3647 committed 00000004:00080000:3.0:1762167009.889592:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3660 committed 00000004:00080000:3.0:1762167009.889595:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3646 committed 00000004:00080000:3.0:1762167009.889597:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3659 committed 00000004:00080000:3.0:1762167009.889600:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3658 committed 00000004:00080000:3.0:1762167009.889603:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3645 committed 00000004:00080000:3.0:1762167009.889609:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3644 committed 00000004:00080000:3.0:1762167009.889612:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3657 committed 00000004:00080000:3.0:1762167009.889614:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3643 committed 00000004:00080000:3.0:1762167009.889616:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3656 committed 00000004:00080000:3.0:1762167009.889618:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3655 committed 00000004:00080000:3.0:1762167009.889621:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3642 committed 00000100:00100000:3.0:1762167009.889700:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454503040:0@lo:2:osp-syn-1-0.0 00010000:00080000:0.0:1762167009.889746:0:33886:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762167009.889793:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56215:x1847765451942784:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 14757us (14936us total) trans 8589953046 rc 0/0 00000100:00100000:3.0:1762167009.889799:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.889807:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7370 00000100:00100000:3.0:1762167009.889850:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454503552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.889873:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454503040 00000100:00100000:3.0:1762167009.889878:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.889880:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454503040 00000100:00100000:1.0:1762167009.889890:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454503168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.889913:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454504064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.889918:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454503552 00000100:00100000:0.0:1762167009.889921:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454503552 00000100:00100000:1.0:1762167009.889930:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.889956:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454503424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.889959:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454503168 00000100:00100000:0.0:1762167009.889962:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454503168 00000100:00100000:2.0:1762167009.889969:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17175 00000100:00100000:1.0:1762167009.889980:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454503680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.889987:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1847765454503040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.889993:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.889993:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17176 00000100:00100000:0.0:1762167009.890004:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454503552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.890017:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454503936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.890019:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.890050:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454504192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.890051:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.890076:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454504448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.890095:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.890110:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.890119:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454504704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.890128:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454504960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.890158:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167009.890169:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454503424 00000100:00100000:3.0:1762167009.890174:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454503424 00000100:00100000:1.0:1762167009.890188:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1762167009.890194:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454503680 00000100:00100000:3.0:1762167009.890199:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454503680 00000100:00100000:1.0:1762167009.890199:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454503296:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.890214:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454503936 00000100:00100000:3.0:1762167009.890218:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454503936 00000100:00100000:3.0:1762167009.890229:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454504192 00000100:00100000:3.0:1762167009.890233:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454504192 00000100:00100000:1.0:1762167009.890234:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167009.890256:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167009.890258:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454504448 00002000:00010000:0.0:1762167009.890260:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00000100:00100000:3.0:1762167009.890261:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454504448 00002000:00010000:0.0:1762167009.890263:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167009.890265:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.890268:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167009.890269:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167009.890270:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454503808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167009.890273:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454504704 00002000:00010000:2.0:1762167009.890277:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00000100:00100000:3.0:1762167009.890278:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454504704 00002000:00010000:2.0:1762167009.890282:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1762167009.890293:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454503296 00000100:00100000:3.0:1762167009.890296:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454503296 00002000:00010000:2.0:1762167009.890309:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000100:00100000:0.0:1762167009.890311:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454503552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 308us (430us total) trans 21474843499 rc 0/0 00002000:00010000:2.0:1762167009.890314:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167009.890328:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17177 00000100:00100000:1.0:1762167009.890334:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.890336:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17176 00000100:00100000:3.0:1762167009.890339:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454503168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.890355:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454503808 00000100:00100000:0.0:1762167009.890359:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454503808 00000100:00100000:1.0:1762167009.890376:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454504320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.890383:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454503040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 401us (582us total) trans 17179875941 rc 0/0 00000100:00100000:2.0:1762167009.890394:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17175 00000100:00100000:0.0:1762167009.890400:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17178 00000100:00100000:0.0:1762167009.890412:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454503424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.890415:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.890417:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17179 00000100:00100000:2.0:1762167009.890431:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454503680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.890434:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454504832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.890468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762167009.890470:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 201220 -> 201220 00002000:00010000:3.0:1762167009.890475:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.890478:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167009.890480:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167009.890482:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 341 -> 341 00000100:00100000:1.0:1762167009.890505:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454504320 00000100:00100000:1.0:1762167009.890510:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454504320 00000100:00100000:3.0:1762167009.890519:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454503168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 182us (589us total) trans 21474843500 rc 0/0 00000100:00100000:3.0:1762167009.890527:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17177 00002000:00010000:0.0:1762167009.890537:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 201220 -> 201220 00000100:00100000:1.0:1762167009.890539:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454504832 00002000:00010000:0.0:1762167009.890540:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:1.0:1762167009.890545:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454504832 00000100:00100000:3.0:1762167009.890546:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17180 00002000:00010000:0.0:1762167009.890546:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167009.890551:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.890553:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167009.890556:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454503936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.890576:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17181 00000100:00100000:1.0:1762167009.890589:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454504192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.890590:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454503424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (598us total) trans 17179875942 rc 0/0 00002000:00010000:2.0:1762167009.890593:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.890600:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.890606:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167009.890606:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17178 00002000:00010000:2.0:1762167009.890612:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.890614:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167009.890624:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17182 00000100:00100000:0.0:1762167009.890632:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454504448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.890654:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454503680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (634us total) trans 17179875943 rc 0/0 00002000:00010000:3.0:1762167009.890663:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167009.890663:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17179 00002000:00010000:3.0:1762167009.890669:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167009.890672:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167009.890675:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167009.890677:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.890685:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17183 00000100:00100000:2.0:1762167009.890695:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454504704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167009.890708:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454503936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (657us total) trans 21474843501 rc 0/0 00000100:00100000:3.0:1762167009.890716:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17180 00000100:00100000:3.0:1762167009.890735:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17184 00002000:00010000:1.0:1762167009.890739:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 201220 -> 201220 00000100:00100000:3.0:1762167009.890743:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454503296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167009.890745:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167009.890752:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167009.890752:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.890760:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.890785:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.890790:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167009.890792:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167009.890795:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.890799:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167009.890836:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454504192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 251us (741us total) trans 21474843502 rc 0/0 00000100:00100000:0.0:1762167009.890843:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454504448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 210us (731us total) trans 21474843503 rc 0/0 00000100:00100000:1.0:1762167009.890849:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17181 00000100:00100000:0.0:1762167009.890857:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17182 00000100:00100000:1.0:1762167009.890876:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17185 00002000:00010000:2.0:1762167009.890881:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167009.890882:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17186 00002000:00010000:2.0:1762167009.890887:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:1.0:1762167009.890888:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454503808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167009.890891:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.890892:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167009.890898:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00000100:00100000:0.0:1762167009.890898:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454504320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167009.890899:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167009.890902:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167009.890906:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167009.890908:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167009.890911:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.890951:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454504704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 258us (793us total) trans 21474843504 rc 0/0 00000100:00100000:3.0:1762167009.890955:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454503296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (721us total) trans 17179875944 rc 0/0 00000100:00100000:2.0:1762167009.890965:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17183 00000100:00100000:3.0:1762167009.890971:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17184 00000100:00100000:2.0:1762167009.890986:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17187 00000100:00100000:2.0:1762167009.890996:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454504832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167009.891025:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 201220 -> 201220 00002000:00010000:1.0:1762167009.891034:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167009.891038:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167009.891038:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167009.891044:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.891045:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167009.891052:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167009.891052:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167009.891054:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.891058:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167009.891099:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454503808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (787us total) trans 17179875945 rc 0/0 00000100:00100000:0.0:1762167009.891099:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454504320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (688us total) trans 17179875946 rc 0/0 00002000:00010000:2.0:1762167009.891105:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 201220 -> 201220 00002000:00010000:2.0:1762167009.891112:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:1.0:1762167009.891116:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17185 00002000:00010000:2.0:1762167009.891117:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167009.891122:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000100:00100000:0.0:1762167009.891122:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17186 00002000:00010000:2.0:1762167009.891127:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167009.891157:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.891164:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454504832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (694us total) trans 21474843505 rc 0/0 00000100:00100000:2.0:1762167009.891171:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17187 00000100:00100000:2.0:1762167009.891187:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454504960 00000100:00100000:2.0:1762167009.891191:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454504960 00000100:00100000:1.0:1762167009.891219:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875927 gen 2 00000100:00100000:2.0:1762167009.891222:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17188 00000004:00080000:1.0:1762167009.891228:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de02d80, transno 17179875897 00000100:00100000:2.0:1762167009.891235:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454504960:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167009.891242:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de00380, transno 17179875898 00000004:00080000:1.0:1762167009.891247:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de02a00, transno 17179875899 00000004:00080000:1.0:1762167009.891251:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de02680, transno 17179875900 00000004:00080000:1.0:1762167009.891254:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de00a80, transno 17179875901 00000004:00080000:1.0:1762167009.891257:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03480, transno 17179875902 00000004:00080000:1.0:1762167009.891261:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03b80, transno 17179875903 00000004:00080000:1.0:1762167009.891264:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03100, transno 17179875904 00000004:00080000:1.0:1762167009.891269:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348257100, transno 17179875905 00000004:00080000:1.0:1762167009.891273:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348254000, transno 17179875906 00000004:00080000:1.0:1762167009.891277:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2443cbb80, transno 17179875907 00000004:00080000:1.0:1762167009.891281:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b06680, transno 17179875908 00000004:00080000:1.0:1762167009.891286:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc5c00, transno 17179875909 00000004:00080000:1.0:1762167009.891290:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc4700, transno 17179875910 00000004:00080000:1.0:1762167009.891293:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc4e00, transno 17179875911 00000004:00080000:1.0:1762167009.891297:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b04e00, transno 17179875912 00000004:00080000:1.0:1762167009.891300:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc6680, transno 17179875913 00000004:00080000:1.0:1762167009.891304:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180a80, transno 17179875914 00000004:00080000:1.0:1762167009.891308:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24732fb80, transno 17179875915 00000004:00080000:1.0:1762167009.891311:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee374ab1500, transno 17179875916 00000004:00080000:1.0:1762167009.891316:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550f480, transno 17179875918 00000004:00080000:1.0:1762167009.891321:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345732680, transno 17179875919 00000004:00080000:1.0:1762167009.891325:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345730700, transno 17179875920 00000004:00080000:1.0:1762167009.891329:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345732d80, transno 17179875921 00000004:00080000:1.0:1762167009.891332:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550c000, transno 17179875922 00002000:00010000:2.0:1762167009.891333:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 201220 -> 201220 00000004:00080000:1.0:1762167009.891336:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550f800, transno 17179875923 00002000:00010000:2.0:1762167009.891339:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000004:00080000:1.0:1762167009.891341:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345731f80, transno 17179875924 00002000:00010000:2.0:1762167009.891343:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000004:00080000:1.0:1762167009.891346:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345731180, transno 17179875925 00002000:00010000:2.0:1762167009.891348:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000004:00080000:1.0:1762167009.891353:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee245189180, transno 17179875926 00000004:00080000:1.0:1762167009.891356:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee245188380, transno 17179875927 00002000:00010000:2.0:1762167009.891371:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167009.891376:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee245188700 x1847765454503424/t17179875942(17179875942) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167025 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762167009.891390:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee245188700/2, rc 0, transno 17179875942 00000100:00100000:1.0:1762167009.891397:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454503424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.891402:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454504960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (244us total) trans 21474843506 rc 0/0 00000100:00100000:1.0:1762167009.891414:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843484 gen 2 00000004:00080000:1.0:1762167009.891420:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb11180, transno 21474843475 00000100:00100000:2.0:1762167009.891425:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17188 00000004:00080000:1.0:1762167009.891441:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb12680, transno 21474843476 00000004:00080000:1.0:1762167009.891446:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb11880, transno 21474843477 00000004:00080000:1.0:1762167009.891450:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb11c00, transno 21474843478 00000004:00080000:1.0:1762167009.891453:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb10700, transno 21474843479 00000004:00080000:1.0:1762167009.891456:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242ce9f80, transno 21474843480 00000004:00080000:1.0:1762167009.891458:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb10e00, transno 21474843481 00000004:00080000:1.0:1762167009.891462:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb13800, transno 21474843482 00000004:00080000:1.0:1762167009.891464:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242ceaa00, transno 21474843483 00000004:00080000:1.0:1762167009.891467:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242ce8380, transno 21474843484 00000100:00100000:1.0:1762167009.891472:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee242cead80 x1847765454503936/t21474843501(21474843501) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167025 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762167009.891481:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242cead80/2, rc 0, transno 21474843501 00000100:00100000:1.0:1762167009.891485:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454503936:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167009.891496:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242cebb80/2, rc 0, transno 21474843503 00000100:00100000:1.0:1762167009.891500:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454504448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167009.891507:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc2aa00/2, rc 0, transno 21474843506 00000100:00100000:1.0:1762167009.891511:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454504960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.891531:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.891566:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454504576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.891591:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167009.891619:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee245189c00/2, rc 0, transno 17179875941 00000100:00100000:1.0:1762167009.891624:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454503040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.891633:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454504064 00000100:00100000:0.0:1762167009.891639:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454504064 00000004:00080000:1.0:1762167009.891641:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242ce8700/2, rc 0, transno 21474843499 00000100:00100000:1.0:1762167009.891647:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454503552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.891672:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454504576 00000100:00100000:0.0:1762167009.891676:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454504576 00000100:00100000:0.0:1762167009.891702:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17189 00000100:00100000:0.0:1762167009.891709:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454504064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167009.891838:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 201220 -> 201220 00002000:00010000:0.0:1762167009.891842:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.891845:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167009.891847:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.891850:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167009.891882:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454504064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 174us (351us total) trans 17179875947 rc 0/0 00000100:00100000:0.0:1762167009.891889:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17189 00000004:00080000:3.0:1762167009.891947:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 4 in flight, 10 done 00000004:00080000:1.0:1762167009.892018:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 8 in progress, 6 in flight, 30 done 00000100:00100000:0.0:1762167009.892049:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17190 00000100:00100000:0.0:1762167009.892058:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454504576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.892064:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454505344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.892096:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167009.892127:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762167009.892134:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454505216:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167009.892151:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167009.892155:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.892160:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:1.0:1762167009.892162:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167009.892164:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454505344 00002000:00010000:0.0:1762167009.892166:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.892168:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167009.892169:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454505344 00000100:00100000:2.0:1762167009.892194:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454505216 00000100:00100000:2.0:1762167009.892198:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454505216 00000100:00100000:0.0:1762167009.892202:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454504576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (609us total) trans 17179875948 rc 0/0 00000100:00100000:0.0:1762167009.892209:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17190 00010000:00010000:1.0:1762167009.892211:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167009.892222:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167009.892226:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17191 00000100:00100000:2.0:1762167009.892235:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17192 00010000:00010000:1.0:1762167009.892236:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167009.892236:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454505344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.892241:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454505216:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762167009.892252:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167009.892264:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167009.892274:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167009.892296:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef100) 00010000:00010000:1.0:1762167009.892299:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167009.892304:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167009.892311:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b6a5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00002000:00010000:0.0:1762167009.892337:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 201220 -> 201220 00002000:00010000:0.0:1762167009.892341:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.892344:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 201220 -> 201220 00002000:00010000:0.0:1762167009.892344:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167009.892347:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.892347:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.892350:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167009.892350:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167009.892353:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.892356:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167009.892358:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454505472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.892406:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454505216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (248us total) trans 21474843507 rc 0/0 00000100:00100000:0.0:1762167009.892406:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454505344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (310us total) trans 17179875949 rc 0/0 00000100:00100000:1.0:1762167009.892409:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167009.892418:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17191 00000100:00100000:2.0:1762167009.892422:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17192 00000100:00100000:2.0:1762167009.892434:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454505472 00000100:00100000:2.0:1762167009.892437:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454505472 00000100:00100000:1.0:1762167009.892439:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762167009.892448:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454505088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167009.892459:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17193 00000100:00100000:2.0:1762167009.892467:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454505472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.892479:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167009.892501:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24518a300/2, rc 0, transno 17179875947 00000100:00100000:0.0:1762167009.892508:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454504064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.892516:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454505088 00000100:00100000:1.0:1762167009.892521:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454505088 00000004:00080000:0.0:1762167009.892521:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee245189500/2, rc 0, transno 17179875948 00000100:00100000:0.0:1762167009.892528:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454504576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167009.892557:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17194 00002000:00010000:2.0:1762167009.892560:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167009.892563:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.892565:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00000100:00100000:0.0:1762167009.892566:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454505088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167009.892567:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167009.892570:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:1.0:1762167009.892587:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24518a680/2, rc 0, transno 17179875944 00000100:00100000:1.0:1762167009.892595:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454503296:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167009.892613:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9c00/2, rc 0, transno 21474843507 00000100:00100000:2.0:1762167009.892614:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454505472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 145us (204us total) trans 17179875950 rc 0/0 00000004:00080000:1.0:1762167009.892615:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24518b100/2, rc 0, transno 17179875945 00000100:00100000:3.0:1762167009.892624:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454505216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167009.892625:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454503808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167009.892630:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17193 00000004:00080000:3.0:1762167009.892652:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28700/2, rc 0, transno 17179875949 00000004:00080000:1.0:1762167009.892656:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee245188a80/2, rc 0, transno 17179875946 00000100:00100000:3.0:1762167009.892660:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454505344:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167009.892660:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167009.892664:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454504320:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167009.892666:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.892674:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167009.892678:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167009.892681:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:1.0:1762167009.892686:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242ceb100/2, rc 0, transno 21474843505 00000100:00100000:1.0:1762167009.892692:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454504832:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167009.892707:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242ce8000/2, rc 0, transno 21474843500 00000100:00100000:0.0:1762167009.892710:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454505088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (231us total) trans 21474843508 rc 0/0 00000100:00100000:1.0:1762167009.892714:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454503168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167009.892719:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17194 00000004:00080000:1.0:1762167009.892732:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee245189f80/2, rc 0, transno 17179875943 00000100:00100000:1.0:1762167009.892738:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454503680:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167009.892748:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242cea680/2, rc 0, transno 21474843502 00000100:00100000:1.0:1762167009.892751:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454504192:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167009.892759:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242ce9500/2, rc 0, transno 21474843504 00000100:00100000:1.0:1762167009.892783:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454504704:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167009.892815:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a8700/2, rc 0, transno 21474843508 00000100:00100000:1.0:1762167009.892821:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454505088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167009.892830:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28e00/2, rc 0, transno 17179875950 00000100:00100000:1.0:1762167009.892834:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454505472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167009.892915:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.893005:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943040 00000100:00100000:3.0:1762167009.893010:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943040 00000100:00100000:3.0:1762167009.893038:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19949 00000100:00100000:3.0:1762167009.893043:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56215:x1847765451943040:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.893054:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.893068:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b6ac lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3de4 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.893115:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b6ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3de4 expref: 890 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.893124:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b6ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3de4 expref: 890 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.893135:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:3.0:1762167009.893138:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167009.893141:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167009.893185:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56215:x1847765451943040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 141us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167009.893192:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19949 00000100:00100000:0.0:1762167009.895114:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.895179:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943296 00000100:00100000:2.0:1762167009.895188:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943296 00000100:00100000:2.0:1762167009.895243:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7371 00000100:00100000:2.0:1762167009.895254:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56215:x1847765451943296:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167009.895531:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56215:x1847765451943296:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 278us (424us total) trans 8589953047 rc 0/0 00000100:00100000:2.0:1762167009.895539:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7371 00000100:00100000:0.0:1762167009.907267:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.907336:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943424 00000100:00100000:3.0:1762167009.907347:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943424 00000100:00100000:3.0:1762167009.907434:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19950 00000100:00100000:3.0:1762167009.907444:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56217:x1847765451943424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167009.907469:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167009.907489:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b6b3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3deb expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.907577:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b6ba lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.907592:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b6ba lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.907603:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b6ba lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.907617:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b6c1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.907623:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.907628:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.907810:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.907818:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167009.907825:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167009.907990:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:2.0:1762167009.907997:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167009.908023:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908038:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908048:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b6ba lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908055:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b6ba lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908066:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b6ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908073:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.908077:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b6ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908085:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b6ba lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908106:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167009.908109:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.908114:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b6ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908120:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b6ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908139:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908145:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908150:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908155:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167009.908158:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908163:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908172:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167009.908174:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167009.908177:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b6c1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908187:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b6c1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.908224:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b6b3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3deb expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.908238:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3deb expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.908245:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167009.908248:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167009.908250:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:2.0:1762167009.908328:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56217:x1847765451943424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 885us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.908336:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19950 00000100:00100000:1.0:1762167009.910885:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.910922:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943680 00000100:00100000:2.0:1762167009.910933:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943680 00000100:00100000:2.0:1762167009.911009:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19951 00000100:00100000:2.0:1762167009.911020:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56217:x1847765451943680:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167009.911044:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167009.911065:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b6cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3df2 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.911176:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b6d6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.911191:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.911200:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167009.911210:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00010000:00010000:2.0:1762167009.911394:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b6cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3df2 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.911416:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3df2 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.911426:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167009.911429:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762167009.911433:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:2.0:1762167009.911509:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56217:x1847765451943680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 491us (631us total) trans 8589953048 rc 0/0 00000100:00100000:2.0:1762167009.911517:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19951 00000100:00100000:0.0:1762167009.913384:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.913467:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451943936 00000100:00100000:2.0:1762167009.913476:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451943936 00000100:00100000:2.0:1762167009.913539:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19952 00000100:00100000:2.0:1762167009.913548:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56217:x1847765451943936:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167009.913571:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167009.913587:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6e4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3df9 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.913674:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b6eb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.913688:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b6eb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167009.913697:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b6eb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167009.913708:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00010000:00010000:2.0:1762167009.913866:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6e4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3df9 expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.913885:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b6eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3df9 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.913894:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167009.913897:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167009.913900:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167009.913974:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56217:x1847765451943936:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 426us (598us total) trans 8589953049 rc 0/0 00000100:00100000:2.0:1762167009.913982:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19952 00000100:00100000:0.0:1762167009.942111:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.942189:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944064 00000100:00100000:2.0:1762167009.942199:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944064 00000100:00100000:2.0:1762167009.942277:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3066 00000100:00100000:2.0:1762167009.942287:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451944064:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167009.942325:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.942349:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 30 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.942357:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.942359:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.942376:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.942413:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 30 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.942426:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 30 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.942441:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454505600:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.942526:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.943843:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454505600:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.943877:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.944170:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.944227:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944192 00000100:00100000:3.0:1762167009.944233:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944192 00010000:00010000:3.0:1762167009.944259:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 31 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.944318:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7585 00000100:00100000:3.0:1762167009.944326:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451944192:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167009.944339:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167009.944374:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 31 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.944387:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 31 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.944408:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b690 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dcf expref: 31 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167009.944424:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.944426:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167009.944431:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.944440:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.944469:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167009.944518:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451944192:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 191us (348us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167009.944526:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.944532:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7585 00010000:00010000:2.0:1762167009.944538:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.946593:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.946609:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.946618:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.946624:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.946628:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.946636:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.946652:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.946659:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0b6f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.947171:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451944064:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4881us (5066us total) trans 0 rc 201220/201220 00000100:00100000:2.0:1762167009.947181:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3066 00000100:00100000:3.0:1762167009.949895:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.949943:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944320 00000100:00100000:2.0:1762167009.949953:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944320 00000100:00100000:2.0:1762167009.950027:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3067 00000100:00100000:2.0:1762167009.950038:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2358:x1847765451944320:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167009.950070:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.950088:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b5be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d66 expref: 35 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.950096:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.950098:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.950101:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.950131:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b5be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d66 expref: 35 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.950143:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b5be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d66 expref: 35 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.950157:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454505728:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.950241:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.951356:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454505728:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.951391:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.951564:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.951607:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944448 00000100:00100000:2.0:1762167009.951613:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944448 00010000:00010000:2.0:1762167009.951640:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b5be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d66 expref: 36 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.951674:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7586 00000100:00100000:2.0:1762167009.951685:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451944448:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.951698:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.951720:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b5be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d66 expref: 36 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.951741:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b5be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d66 expref: 36 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.951787:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922400/0xf915a5bdf3d0b5be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d66 expref: 36 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.951801:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.951803:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.951806:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.951815:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.951843:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.951889:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451944448:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 204us (324us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167009.951890:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.951906:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7586 00010000:00010000:3.0:1762167009.951917:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.953592:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.953608:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.953623:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.953630:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.953634:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.953642:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.953668:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.953676:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b700 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.953754:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451944320:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3714us (3865us total) trans 0 rc 201220/201220 00000100:00100000:2.0:1762167009.953818:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3067 00000100:00100000:0.0:1762167009.958787:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.958847:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944576 00000100:00100000:2.0:1762167009.958858:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944576 00000100:00100000:2.0:1762167009.958931:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3068 00000100:00100000:2.0:1762167009.958942:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2359:x1847765451944576:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167009.958991:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.959016:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b5da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d74 expref: 29 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.959025:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.959027:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167009.959030:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.959065:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b5da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d74 expref: 29 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.959080:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b5da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d74 expref: 29 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.959095:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454505856:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167009.959180:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167009.960465:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454505856:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.960489:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.960900:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.961026:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944704 00000100:00100000:2.0:1762167009.961033:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944704 00010000:00010000:2.0:1762167009.961061:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b5da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d74 expref: 30 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167009.961099:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7587 00000100:00100000:2.0:1762167009.961108:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451944704:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167009.961120:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167009.961140:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b5da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d74 expref: 30 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.961152:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b5da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d74 expref: 30 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.961173:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b5da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d74 expref: 30 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167009.961187:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.961189:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167009.961193:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.961203:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.961230:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167009.961274:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451944704:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 167us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167009.961281:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7587 00010000:00010000:3.0:1762167009.961395:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.961405:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.963390:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.963407:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.963415:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.963422:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167009.963426:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.963435:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.963453:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.963464:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b707 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.963553:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765451944576:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4610us (4797us total) trans 0 rc 201220/201220 00000100:00100000:3.0:1762167009.963573:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3068 00000100:00100000:0.0:1762167009.966703:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.966817:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944832 00000100:00100000:3.0:1762167009.966829:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944832 00000100:00100000:3.0:1762167009.966917:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3069 00000100:00100000:3.0:1762167009.966929:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451944832:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167009.966965:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.966983:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b5f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d82 expref: 34 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.966991:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.966994:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.966997:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.967031:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d82 expref: 34 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.967046:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d82 expref: 34 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.967072:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454505984:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167009.967159:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167009.968517:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454505984:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.968540:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.968728:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.968840:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451944960 00000100:00100000:1.0:1762167009.968847:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451944960 00010000:00010000:1.0:1762167009.968874:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d82 expref: 35 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167009.968906:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7588 00000100:00100000:1.0:1762167009.968916:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451944960:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167009.968930:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167009.968954:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d82 expref: 35 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.968966:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d82 expref: 35 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.968988:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b5f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d82 expref: 35 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.968999:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.969001:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.969004:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.969011:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.969030:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167009.969066:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451944960:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 153us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.969072:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7588 00010000:00010000:3.0:1762167009.969624:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.969635:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.971169:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.971191:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.971200:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.971207:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167009.971211:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.971220:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.971243:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.971251:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b70e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.971386:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451944832:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4453us (4686us total) trans 0 rc 201220/201220 00000100:00100000:3.0:1762167009.971398:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3069 00000100:00100000:2.0:1762167009.974031:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.974075:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945088 00000100:00100000:3.0:1762167009.974085:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945088 00000100:00100000:3.0:1762167009.974148:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3070 00000100:00100000:3.0:1762167009.974158:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451945088:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167009.974189:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.974208:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b612 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d90 expref: 33 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.974227:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.974229:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.974232:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.974264:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b612 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d90 expref: 33 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.974283:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b612 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d90 expref: 33 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.974299:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454506112:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167009.974381:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167009.975818:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454506112:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.975845:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.975906:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.976080:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945216 00000100:00100000:1.0:1762167009.976085:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945216 00010000:00010000:1.0:1762167009.976110:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b612 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d90 expref: 34 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167009.976142:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7589 00000100:00100000:1.0:1762167009.976150:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451945216:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167009.976164:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167009.976185:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b612 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d90 expref: 34 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.976198:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b612 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d90 expref: 34 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.976215:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0b612 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d90 expref: 34 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.976228:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.976229:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.976233:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.976239:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.976258:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.976281:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.976292:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.976293:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451945216:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 143us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.976315:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7589 00010000:00010000:3.0:1762167009.979098:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.979116:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.979125:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.979133:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167009.979138:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.979147:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.979163:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.979170:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b715 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.979254:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451945088:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5093us (5229us total) trans 0 rc 201220/201220 00000100:00100000:3.0:1762167009.979265:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3070 00000100:00100000:0.0:1762167009.982060:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.982118:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945344 00000100:00100000:3.0:1762167009.982129:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945344 00000100:00100000:3.0:1762167009.982191:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3071 00000100:00100000:3.0:1762167009.982199:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451945344:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167009.982230:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.982248:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b62e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d9e expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.982254:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.982256:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.982259:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.982301:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b62e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d9e expref: 28 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.982314:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b62e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d9e expref: 28 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.982330:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454506240:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167009.982431:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167009.983971:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454506240:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167009.983996:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.984155:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.984216:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945472 00000100:00100000:1.0:1762167009.984223:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945472 00010000:00010000:1.0:1762167009.984254:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b62e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d9e expref: 29 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167009.984287:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7590 00000100:00100000:1.0:1762167009.984294:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451945472:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167009.984305:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167009.984323:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b62e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d9e expref: 29 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.984332:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b62e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d9e expref: 29 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.984349:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0b62e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3d9e expref: 29 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.984360:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.984371:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.984376:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.984386:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.984416:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167009.984435:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.984448:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.984463:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451945472:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 168us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.984472:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7590 00010000:00010000:3.0:1762167009.986870:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.986886:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.986894:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.986906:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167009.986911:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.986918:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.986934:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.986941:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b71c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167009.987020:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451945344:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4818us (4969us total) trans 0 rc 201220/201220 00000100:00100000:3.0:1762167009.987030:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3071 00000100:00100000:0.0:1762167009.989555:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167009.989602:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945600 00000100:00100000:3.0:1762167009.989612:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945600 00000100:00100000:3.0:1762167009.989681:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3072 00000100:00100000:3.0:1762167009.989692:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765451945600:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167009.989720:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.989733:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b64a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dac expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.989742:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.989743:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167009.989746:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.989795:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dac expref: 27 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167009.989812:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dac expref: 27 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167009.989827:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454506368:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.989974:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.991023:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454506368:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167009.991043:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167009.991234:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167009.991282:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945728 00000100:00100000:1.0:1762167009.991288:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945728 00010000:00010000:1.0:1762167009.991319:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dac expref: 28 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167009.991352:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7591 00000100:00100000:1.0:1762167009.991374:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451945728:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167009.991388:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167009.991410:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dac expref: 28 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.991421:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dac expref: 28 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.991442:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0b64a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dac expref: 28 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167009.991455:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.991457:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167009.991461:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.991486:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167009.991517:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167009.991549:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.991559:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167009.991570:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451945728:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 209us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167009.991579:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7591 00010000:00010000:2.0:1762167009.993060:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.993071:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.993080:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.993084:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167009.993087:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.993093:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.993104:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167009.993121:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0b723 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167009.993189:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451945600:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3494us (3644us total) trans 0 rc 201220/201220 00000100:00100000:2.0:1762167009.993199:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3072 00000100:00100000:2.0:1762167009.996660:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167009.997139:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945856 00000100:00100000:0.0:1762167009.997152:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945856 00000100:00100000:0.0:1762167009.997227:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3073 00000100:00100000:0.0:1762167009.997238:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451945856:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167009.997273:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.997292:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b666 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dba expref: 32 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.997301:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167009.997303:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167009.997306:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.997372:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dba expref: 32 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167009.997387:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dba expref: 32 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167009.997401:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454506496:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167009.997485:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167009.999863:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167009.999892:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:21530:1847765454506496:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167009.999914:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.000082:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451945984 00000100:00100000:1.0:1762167010.000100:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451945984 00010000:00010000:1.0:1762167010.000174:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dba expref: 33 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167010.000225:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7592 00000100:00100000:1.0:1762167010.000236:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451945984:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167010.000261:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.000295:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b666 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dba expref: 33 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.000318:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dba expref: 33 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.000348:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0b666 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dba expref: 33 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.000385:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.000390:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.000396:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.000413:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.000450:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.000487:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.000505:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.000530:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451945984:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 294us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.000542:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7592 00010000:00010000:2.0:1762167010.003571:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.003589:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.003597:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.003604:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.003609:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.003617:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.003634:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.003640:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b72a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.003725:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451945856:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6484us (7068us total) trans 0 rc 201220/201220 00000100:00100000:2.0:1762167010.003735:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3073 00000100:00100000:3.0:1762167010.007265:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.007325:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946112 00000100:00100000:2.0:1762167010.007337:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946112 00000100:00100000:2.0:1762167010.007438:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3074 00000100:00100000:2.0:1762167010.007457:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765451946112:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167010.007499:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.007519:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b682 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc8 expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.007527:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167010.007529:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167010.007532:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.007568:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b682 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc8 expref: 26 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.007581:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b682 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc8 expref: 26 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167010.007595:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454506624:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167010.007667:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167010.009224:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454506624:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167010.009251:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.009604:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.009832:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946240 00000100:00100000:1.0:1762167010.009840:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946240 00010000:00010000:1.0:1762167010.009876:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b682 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc8 expref: 27 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167010.009918:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7593 00000100:00100000:1.0:1762167010.009929:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451946240:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167010.009944:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.009971:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b682 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc8 expref: 27 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.009987:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b682 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc8 expref: 27 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.010009:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0b682 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dc8 expref: 27 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.010026:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.010028:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.010032:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.010041:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.010066:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.010085:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.010095:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.010122:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451946240:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 193us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.010131:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7593 00010000:00010000:2.0:1762167010.011711:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.011737:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.011746:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.011754:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.011758:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.011796:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.011813:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.011821:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b731 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.011897:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765451946112:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4449us (4649us total) trans 0 rc 201220/201220 00000100:00100000:2.0:1762167010.011907:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3074 00000100:00100000:3.0:1762167010.019757:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.019863:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946368 00000100:00100000:1.0:1762167010.019875:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946368 00000100:00100000:1.0:1762167010.019939:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 657 00000100:00100000:1.0:1762167010.019951:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56217:x1847765451946368:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:1.0:1762167010.019969:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.019995:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b6eb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3df9 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.020014:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:1.0:1762167010.020020:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167010.020078:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56217:x1847765451946368:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 129us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.020086:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 657 00000100:00100000:0.0:1762167010.021377:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.021427:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946624 00000100:00100000:2.0:1762167010.021436:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946624 00000100:00100000:2.0:1762167010.021482:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7372 00000100:00100000:2.0:1762167010.021492:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56217:x1847765451946624:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167010.021712:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56217:x1847765451946624:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 218us (349us total) trans 8589953050 rc 0/0 00000100:00100000:2.0:1762167010.021720:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7372 00000100:00100000:3.0:1762167010.024398:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.024472:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451946880 00000100:00100000:1.0:1762167010.024481:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451946880 00000100:00100000:1.0:1762167010.024537:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19953 00000100:00100000:1.0:1762167010.024547:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451946880:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167010.024570:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.024589:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b738 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e00 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.024700:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.024711:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3deb expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.024716:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.024744:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3deb expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.024755:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3deb expref: 897 pid: 30817 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167010.024812:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454506752:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167010.024890:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167010.027334:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454506752:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167010.027386:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167010.027938:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.028010:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947008 00000100:00100000:1.0:1762167010.028018:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947008 00010000:00010000:1.0:1762167010.028051:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3deb expref: 898 pid: 30817 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167010.028096:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7594 00000100:00100000:1.0:1762167010.028106:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765451947008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167010.028121:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.028128:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3deb expref: 898 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.028140:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3deb expref: 898 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.028163:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0b6c8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3deb expref: 898 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.028177:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:1.0:1762167010.028182:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.028190:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.028198:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.028226:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.028272:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.028282:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.028284:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451947008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 179us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.028298:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7594 00000004:00200000:0.0:1762167010.028305:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00010000:00010000:0.0:1762167010.028489:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b738 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e00 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.028507:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e00 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.028514:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167010.028516:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167010.028519:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b400, rc 0) 00000100:00100000:0.0:1762167010.028558:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451946880:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 4012us (4166us total) trans 8589953051 rc 0/0 00000100:00100000:0.0:1762167010.028567:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19953 00000100:00100000:2.0:1762167010.029752:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.029849:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947136 00000100:00100000:0.0:1762167010.029855:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947136 00000100:00100000:0.0:1762167010.029900:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19954 00000100:00100000:0.0:1762167010.029910:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451947136:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167010.029928:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.029944:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b74d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e07 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.030011:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.030024:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e00 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.030032:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.030061:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e00 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.030074:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e00 expref: 898 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167010.030087:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2438b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454506880:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167010.030170:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167010.031266:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2438b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454506880:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167010.031287:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167010.031655:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.031738:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947264 00000100:00100000:1.0:1762167010.031744:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947264 00010000:00010000:1.0:1762167010.031802:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e00 expref: 899 pid: 30819 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167010.031830:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7595 00000100:00100000:1.0:1762167010.031839:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765451947264:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167010.031852:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.031858:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e00 expref: 899 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.031868:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e00 expref: 899 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.031894:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b73f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e00 expref: 899 pid: 30819 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.031911:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:1.0:1762167010.031916:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.031924:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.031931:0:5741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.031960:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167010.031992:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765451947264:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.031997:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7595 00010000:00010000:0.0:1762167010.032052:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.032060:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.032093:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:0.0:1762167010.032097:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167010.032114:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.032140:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b74d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e07 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.032156:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e07 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.032162:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167010.032165:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167010.032167:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30cc00, rc 0) 00000100:00100000:0.0:1762167010.032202:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451947136:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2294us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.032209:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19954 00000100:00100000:2.0:1762167010.033848:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.033894:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947392 00000100:00100000:0.0:1762167010.033900:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947392 00000100:00100000:0.0:1762167010.033944:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17195 00000100:00100000:0.0:1762167010.033953:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451947392:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167010.033968:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.033986:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b75b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e0e expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167010.034009:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 201220, mtime: 0x690888e2, atime: 0x690888de, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:0.0:1762167010.034024:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.034026:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.034034:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b75b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e0e expref: 26 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167010.034047:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b75b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e0e expref: 26 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167010.034058:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ce00, rc 0) 00000100:00100000:0.0:1762167010.034108:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451947392:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 156us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.034115:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17195 00000100:00100000:3.0:1762167010.035790:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.035823:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947648 00000100:00100000:0.0:1762167010.035830:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947648 00000100:00100000:0.0:1762167010.035881:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19955 00000100:00100000:0.0:1762167010.035890:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451947648:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167010.035939:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167010.035963:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b754 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e07 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.035980:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167010.035984:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.036208:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.036218:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.036224:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167010.036265:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953052 00000004:00010000:0.0:1762167010.036285:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000037987fc1 reply state 000000003dc6fe24 transno 8589953053 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.036293:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167010.036379:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451947648:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 490us (622us total) trans 8589953053 rc 0/0 00000100:00100000:0.0:1762167010.036387:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19955 00000020:00080000:0.0:1762167010.036392:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167010.037529:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.037542:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.037548:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.037554:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167010.037558:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.037564:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.037575:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167010.037578:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167010.037582:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.037587:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b762 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167010.037896:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.038147:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451947904 00000100:00100000:2.0:1762167010.038155:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451947904 00000100:00100000:2.0:1762167010.038199:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7373 00000100:00100000:2.0:1762167010.038210:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451947904:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167010.038473:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451947904:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 264us (577us total) trans 8589953054 rc 0/0 00000100:00100000:2.0:1762167010.038480:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7373 00000100:00100000:2.0:1762167010.040192:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.040269:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948160 00000100:00100000:0.0:1762167010.040277:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948160 00000100:00100000:0.0:1762167010.040330:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19956 00000100:00100000:0.0:1762167010.040339:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451948160:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167010.040358:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.040373:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762167010.040401:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0b6d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3df2 expref: 899 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.040422:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0b6ac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3de4 expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.040435:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167010.040443:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.040457:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b769 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e15 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.040504:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b770 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.040516:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b770 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.040525:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b770 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:0.0:1762167010.041110:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5545, 88 off448240 00000004:00080000:0.0:1762167010.041119:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630833355492ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.041161:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5553, 88 off449296 00000004:00080000:0.0:1762167010.041165:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630833402994ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.041189:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5554, 88 off449384 00000004:00080000:0.0:1762167010.041192:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630833429362ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.041201:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5546, 88 off448328 00000004:00080000:0.0:1762167010.041203:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630833440871ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.041211:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5555, 88 off449472 00000004:00080000:0.0:1762167010.041213:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630833450718ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.041221:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5547, 88 off448416 00000004:00080000:0.0:1762167010.041224:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630833460479ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.041232:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5548, 88 off448504 00000004:00080000:0.0:1762167010.041235:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630833472422ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.041246:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5556, 88 off449560 00000004:00080000:0.0:1762167010.041248:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630833485323ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.041258:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5557, 88 off449648 00000004:00080000:0.0:1762167010.041264:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630833500356ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.041309:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5549, 88 off448592 00000004:00080000:0.0:1762167010.041319:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630833555564ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.041396:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5558, 88 off449736 00000004:00080000:0.0:1762167010.041402:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630833638876ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.041442:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5550, 88 off448680 00000004:00080000:0.0:1762167010.041447:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630833684746ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.041486:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5551, 88 off448768 00000004:00080000:0.0:1762167010.041490:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630833727752ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.041509:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5559, 88 off449824 00000004:00080000:0.0:1762167010.041512:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630833749564ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.041543:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5552, 88 off448856 00000004:00080000:0.0:1762167010.041548:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630833785164ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.041565:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5560, 88 off449912 00000004:00080000:0.0:1762167010.041569:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630833805976ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.041605:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5561, 88 off450000 00000004:00080000:0.0:1762167010.041609:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630833846322ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.041627:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5553, 88 off448944 00000004:00080000:0.0:1762167010.041631:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630833868749ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.041651:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5554, 88 off449032 00000004:00080000:0.0:1762167010.041657:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630833894019ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.041690:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5562, 88 off450088 00000004:00080000:0.0:1762167010.041695:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630833931994ns, next at 630703976179ns, rc = 0 00000001:00080000:2.0:1762167010.053034:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953055 is committed 00000004:00080000:2.0:1762167010.053049:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3674 committed 00000004:00080000:2.0:1762167010.053065:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3661 committed 00010000:00010000:0.0:1762167010.053075:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b770 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e15 expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.053090:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef200) 00000004:00080000:2.0:1762167010.053092:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3660 committed 00010000:00010000:0.0:1762167010.053094:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:2.0:1762167010.053101:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3673 committed 00000004:00080000:2.0:1762167010.053106:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3672 committed 00000004:00080000:2.0:1762167010.053109:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3659 committed 00000004:00080000:2.0:1762167010.053112:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3671 committed 00000004:00080000:2.0:1762167010.053115:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3658 committed 00010000:00010000:0.0:1762167010.053118:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b769 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e15 expref: 899 pid: 30819 timeout: 0 lvb_type: 3 00000004:00080000:2.0:1762167010.053124:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3657 committed 00000004:00080000:2.0:1762167010.053133:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3670 committed 00000004:00080000:2.0:1762167010.053137:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3656 committed 00010000:00010000:0.0:1762167010.053140:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b770 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e15 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762167010.053145:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3669 committed 00000004:00080000:2.0:1762167010.053150:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3668 committed 00000004:00080000:2.0:1762167010.053152:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3655 committed 00000004:00080000:2.0:1762167010.053154:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3654 committed 00000004:00080000:2.0:1762167010.053159:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3667 committed 00000004:00080000:2.0:1762167010.053164:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3653 committed 00000004:00080000:2.0:1762167010.053166:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3666 committed 00000004:00080000:2.0:1762167010.053172:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3665 committed 00010000:00010000:0.0:1762167010.053177:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef200) 00000004:00080000:2.0:1762167010.053180:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3652 committed 00010000:00010000:0.0:1762167010.053182:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762167010.053187:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c000, rc 0) 00000100:00100000:3.0:1762167010.053231:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454507264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.053279:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451948160:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 12939us (13091us total) trans 8589953055 rc 0/0 00000100:00100000:0.0:1762167010.053291:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19956 00000100:00100000:3.0:1762167010.053310:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.053349:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454507008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.053377:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454507776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.053396:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454507392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.053403:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167010.053425:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454507264 00000100:00100000:3.0:1762167010.053433:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454507264 00000100:00100000:0.0:1762167010.053443:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454507520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.053480:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167010.053502:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454507392 00000100:00100000:0.0:1762167010.053502:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454507008 00000100:00100000:0.0:1762167010.053507:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454507008 00000100:00100000:3.0:1762167010.053508:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454507392 00000100:00100000:2.0:1762167010.053541:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17196 00000100:00100000:1.0:1762167010.053543:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454507904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.053554:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17197 00000100:00100000:0.0:1762167010.053576:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454507008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.053580:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3296:x1847765454507264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.053589:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167010.053631:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454507904 00000100:00100000:3.0:1762167010.053636:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454507904 00000100:00100000:1.0:1762167010.053639:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454507136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.053680:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17198 00000100:00100000:1.0:1762167010.053685:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167010.053695:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454507392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.053714:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454507648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.053748:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.053822:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454507136 00000100:00100000:1.0:1762167010.053828:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454507136 00000100:00100000:1.0:1762167010.053852:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454507648 00000100:00100000:1.0:1762167010.053855:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454507648 00002000:00010000:0.0:1762167010.053876:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167010.053883:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17199 00002000:00010000:0.0:1762167010.053884:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167010.053890:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762167010.053893:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167010.053897:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167010.053898:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454507904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167010.053908:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.053912:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.053916:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167010.053919:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.053921:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.053959:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454507008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 395us (555us total) trans 17179875951 rc 0/0 00000100:00100000:0.0:1762167010.053968:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17197 00000100:00100000:3.0:1762167010.053977:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454507392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 283us (498us total) trans 17179875952 rc 0/0 00000100:00100000:3.0:1762167010.053985:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17198 00000100:00100000:0.0:1762167010.053995:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17200 00000100:00100000:0.0:1762167010.054006:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454507136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.054008:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17201 00000100:00100000:3.0:1762167010.054022:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454507648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.054037:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454507264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 477us (724us total) trans 17179875953 rc 0/0 00000100:00100000:2.0:1762167010.054049:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17196 00002000:00010000:1.0:1762167010.054064:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.054070:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.054075:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167010.054078:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.054081:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167010.054123:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454507904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 231us (539us total) trans 17179875954 rc 0/0 00000100:00100000:1.0:1762167010.054132:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17199 00002000:00010000:0.0:1762167010.054155:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.054159:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167010.054162:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167010.054165:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.054168:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.054207:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3295:x1847765454507136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (525us total) trans 17179875955 rc 0/0 00000100:00100000:0.0:1762167010.054216:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17200 00000004:00080000:1.0:1762167010.054243:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28380/2, rc 0, transno 17179875955 00000100:00100000:1.0:1762167010.054258:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454507136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.054280:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.054310:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454507520 00000100:00100000:1.0:1762167010.054314:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454507520 00000100:00100000:3.0:1762167010.054333:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3295:x1847765454507648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 310us (583us total) trans 17179875956 rc 0/0 00000004:00080000:0.0:1762167010.054334:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc2b100/2, rc 0, transno 17179875951 00000100:00100000:1.0:1762167010.054345:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17202 00000100:00100000:3.0:1762167010.054354:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17201 00000100:00100000:0.0:1762167010.054356:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454507008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.054360:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454507520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.054384:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454508032:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1762167010.054402:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762167010.054434:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.054476:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454508032 00000100:00100000:0.0:1762167010.054481:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454508032 00000100:00100000:0.0:1762167010.054524:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17203 00000100:00100000:2.0:1762167010.054531:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454508544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.054539:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454508032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.054544:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454507520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (265us total) trans 17179875957 rc 0/0 00000100:00100000:1.0:1762167010.054552:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17202 00000100:00100000:2.0:1762167010.054604:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167010.054633:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454508544 00000100:00100000:3.0:1762167010.054639:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454508544 00000100:00080000:1.0:1762167010.054682:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1762167010.054686:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d6a680/2, rc 0, transno 17179875957 00000100:00100000:3.0:1762167010.054699:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17204 00000100:00100000:2.0:1762167010.054704:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454507520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.054715:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454508032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (283us total) trans 17179875958 rc 0/0 00000100:00100000:3.0:1762167010.054716:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454508544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.054729:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454509056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.054730:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17203 00000100:00100000:2.0:1762167010.054820:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.054867:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454509056 00000004:00080000:2.0:1762167010.054868:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce7800/2, rc 0, transno 17179875958 00000100:00100000:0.0:1762167010.054876:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454509056 00000100:00100000:2.0:1762167010.054879:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454508032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.054900:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00002000:00010000:3.0:1762167010.054908:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167010.054909:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454508416:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167010.054921:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:0.0:1762167010.054923:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17205 00002000:00010000:3.0:1762167010.054930:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167010.054934:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.054938:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.054939:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454509056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.054955:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.055002:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454508928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.055007:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454508416 00000100:00100000:3.0:1762167010.055012:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454508544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 295us (405us total) trans 21474843509 rc 0/0 00000100:00100000:1.0:1762167010.055017:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454508416 00000100:00100000:3.0:1762167010.055027:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17204 00000100:00100000:2.0:1762167010.055060:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.055080:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454508928 00000100:00100000:1.0:1762167010.055087:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454508928 00000100:00100000:3.0:1762167010.055092:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17206 00000100:00100000:3.0:1762167010.055110:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454508416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.055130:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454509056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 189us (307us total) trans 21474843510 rc 0/0 00000004:00080000:2.0:1762167010.055132:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb10380/2, rc 0, transno 21474843510 00000100:00100000:1.0:1762167010.055134:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17207 00000100:00100000:1.0:1762167010.055153:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454508928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.055154:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17205 00000100:00100000:2.0:1762167010.055163:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454509056:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167010.055186:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9f80/2, rc 0, transno 21474843509 00000100:00100000:2.0:1762167010.055193:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454508544:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167010.055252:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.055255:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167010.055257:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167010.055259:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.055261:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167010.055295:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167010.055298:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454508416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (342us total) trans 21474843511 rc 0/0 00002000:00010000:1.0:1762167010.055301:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:3.0:1762167010.055305:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17206 00002000:00010000:1.0:1762167010.055309:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167010.055315:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.055318:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167010.055335:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167010.055340:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435ab480/2, rc 0, transno 21474843511 00000100:00100000:2.0:1762167010.055352:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454508416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.055387:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454508928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 237us (327us total) trans 21474843512 rc 0/0 00000100:00100000:0.0:1762167010.055395:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454507776 00000100:00100000:1.0:1762167010.055396:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17207 00000100:00100000:0.0:1762167010.055401:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454507776 00000004:00080000:2.0:1762167010.055404:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb13b80/2, rc 0, transno 21474843512 00000004:00080000:3.0:1762167010.055409:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d6ad80/2, rc 0, transno 17179875953 00000100:00100000:3.0:1762167010.055424:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454507264:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.055425:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454508928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.055442:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17208 00000100:00100000:3.0:1762167010.055452:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454508288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.055454:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454507776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.055482:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.055510:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454508288 00000100:00100000:1.0:1762167010.055515:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454508288 00000100:00100000:1.0:1762167010.055548:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17209 00002000:00010000:0.0:1762167010.055550:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.055555:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:1.0:1762167010.055559:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454508288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167010.055560:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167010.055567:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.055571:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167010.055605:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454508800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.055614:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454507776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (279us total) trans 17179875959 rc 0/0 00000100:00100000:0.0:1762167010.055621:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17208 00000100:00100000:3.0:1762167010.055635:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.055651:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454508800 00000100:00100000:0.0:1762167010.055655:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454508800 00000004:00080000:3.0:1762167010.055663:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d6b800/2, rc 0, transno 17179875959 00000100:00100000:3.0:1762167010.055668:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454507776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.055680:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1762167010.055683:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17210 00000100:00100000:3.0:1762167010.055688:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454508160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.055690:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454508800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.055725:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.055726:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454508288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (240us total) trans 21474843513 rc 0/0 00000100:00100000:1.0:1762167010.055735:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17209 00000100:00100000:1.0:1762167010.055748:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454508160 00000100:00100000:1.0:1762167010.055753:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454508160 00000100:00100000:1.0:1762167010.055810:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17211 00000100:00100000:1.0:1762167010.055820:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454508160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.055828:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454508672:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167010.055831:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.055836:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.055838:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167010.055841:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.055845:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167010.055868:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.055889:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454508800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (250us total) trans 21474843514 rc 0/0 00000100:00100000:0.0:1762167010.055900:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17210 00000004:00080000:3.0:1762167010.055902:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d69880/2, rc 0, transno 17179875956 00000100:00100000:3.0:1762167010.055910:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454507648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.055920:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948288 00000100:00100000:0.0:1762167010.055924:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948288 00000004:00080000:3.0:1762167010.055949:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d6b480/2, rc 0, transno 17179875952 00002000:00010000:1.0:1762167010.055953:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167010.055954:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454507392:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167010.055959:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:0.0:1762167010.055963:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17212 00002000:00010000:1.0:1762167010.055965:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167010.055970:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.055974:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.055975:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56065:x1847765451948288:12345-192.168.203.35@tcp:101:fsx.0 00000004:00080000:3.0:1762167010.055977:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d6aa00/2, rc 0, transno 17179875954 00000100:00100000:3.0:1762167010.055983:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454507904:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762167010.055987:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167010.056010:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3296:x1847765454508160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (286us total) trans 17179875960 rc 0/0 00010000:00010000:0.0:1762167010.056012:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e1c expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.056021:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17211 00002000:00010000:0.0:1762167010.056037:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 201220, mtime: 0x690888e1, atime: 0x690888e1, ctime: 0x690888e2, blocks: 0x155 00010000:00010000:0.0:1762167010.056056:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.056060:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762167010.056061:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762167010.056064:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454509440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.056075:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167010.056075:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.056083:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454509312:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762167010.056096:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.056099:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454509184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.056107:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167010.056114:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c600, rc 0) 00000100:00100000:1.0:1762167010.056147:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454508672 00000100:00100000:1.0:1762167010.056154:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454508672 00000100:00100000:3.0:1762167010.056157:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454509440 00000100:00100000:3.0:1762167010.056165:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454509440 00000100:00100000:0.0:1762167010.056166:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451948288:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 187us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.056167:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.056180:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17212 00000100:00100000:1.0:1762167010.056193:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454509312 00000100:00100000:1.0:1762167010.056198:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454509312 00000100:00100000:0.0:1762167010.056210:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17213 00000100:00100000:3.0:1762167010.056218:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17214 00000100:00100000:0.0:1762167010.056221:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454508672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.056231:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454509440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.056243:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17215 00000100:00100000:1.0:1762167010.056260:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454509312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.056394:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3296:x1847765454508672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (318us total) trans 21474843515 rc 0/0 00000100:00100000:3.0:1762167010.056398:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454509440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (294us total) trans 21474843516 rc 0/0 00000100:00100000:0.0:1762167010.056404:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17213 00000100:00100000:3.0:1762167010.056411:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17214 00002000:00010000:1.0:1762167010.056431:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.056436:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.056439:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167010.056442:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000004:00080000:3.0:1762167010.056445:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb13800/2, rc 0, transno 21474843516 00002000:00010000:1.0:1762167010.056446:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167010.056454:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454509440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.056475:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.056494:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454509312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 239us (340us total) trans 21474843517 rc 0/0 00000100:00100000:0.0:1762167010.056501:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454509184 00000100:00100000:0.0:1762167010.056506:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454509184 00000100:00100000:1.0:1762167010.056508:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17215 00000004:00080000:3.0:1762167010.056521:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a8a80/2, rc 0, transno 21474843513 00000100:00100000:3.0:1762167010.056529:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454508288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.056552:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17216 00000004:00080000:2.0:1762167010.056553:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb10e00/2, rc 0, transno 21474843517 00000004:00080000:3.0:1762167010.056554:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9180/2, rc 0, transno 21474843514 00000100:00100000:3.0:1762167010.056566:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454508800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.056568:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454509184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.056574:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454509312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167010.056643:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dce7480/2, rc 0, transno 17179875960 00000100:00100000:3.0:1762167010.056650:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454508160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167010.056663:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a8e00/2, rc 0, transno 21474843515 00002000:00010000:1.0:1762167010.056667:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 201220 -> 201220 00000100:00100000:3.0:1762167010.056668:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454508672:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167010.056673:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.056677:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167010.056679:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.056682:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167010.056723:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3296:x1847765454509184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (246us total) trans 21474843518 rc 0/0 00000100:00100000:1.0:1762167010.056732:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17216 00000004:00080000:2.0:1762167010.056789:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb11180/2, rc 0, transno 21474843518 00000100:00100000:2.0:1762167010.056797:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454509184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.057730:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.057799:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.057828:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.057873:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948416 00000100:00100000:0.0:1762167010.057874:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948544 00000100:00100000:1.0:1762167010.057882:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948416 00000100:00100000:0.0:1762167010.057883:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948544 00002000:00010000:1.0:1762167010.057913:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (190178->18446744073709551615) 00002000:00010000:0.0:1762167010.057913:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167010.057919:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce4700 with x1847765451948544 ext(0->18446744073709551615) 00000100:00100000:3.0:1762167010.057920:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948672 00002000:00100000:1.0:1762167010.057921:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce7100 with x1847765451948416 ext(190178->18446744073709551615) 00000100:00100000:3.0:1762167010.057935:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948672 00002000:00010000:1.0:1762167010.057938:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce7100. 00002000:00010000:0.0:1762167010.057938:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce4700. 00000100:00100000:0.0:1762167010.057982:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3075 00002000:00010000:3.0:1762167010.057983:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167010.057995:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5c00 with x1847765451948672 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167010.057997:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3076 00000100:00100000:0.0:1762167010.058006:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451948544:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167010.058015:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce5c00. 00000100:00100000:1.0:1762167010.058018:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451948416:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167010.058059:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3077 00000100:00100000:3.0:1762167010.058079:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451948672:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:0.0:1762167010.058281:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.058287:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:0.0:1762167010.058290:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:0.0:1762167010.058293:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.058296:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.058376:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451948544:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 364us (559us total) trans 17179875961 rc 0/0 00000100:00100000:0.0:1762167010.058385:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3075 00002000:00010000:0.0:1762167010.058389:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167010.058393:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce4700 with x1847765451948544 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167010.058400:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce4700. 00002000:00010000:3.0:1762167010.058471:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.058479:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:3.0:1762167010.058482:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167010.058485:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.058488:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 201220 -> 190178 00002000:00010000:3.0:1762167010.058489:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167010.058504:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167009 -> 1762167010 00002000:00010000:1.0:1762167010.058512:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:1.0:1762167010.058516:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.058519:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 341 -> 341 00000100:00100000:1.0:1762167010.058570:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451948416:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 551us (836us total) trans 21474843520 rc 0/0 00000100:00100000:3.0:1762167010.058572:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451948672:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 492us (733us total) trans 21474843519 rc 0/0 00000100:00100000:1.0:1762167010.058597:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3076 00002000:00010000:1.0:1762167010.058604:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (190178->18446744073709551615) 00002000:00100000:1.0:1762167010.058607:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce7100 with x1847765451948416 ext(190178->18446744073709551615) 00000100:00100000:3.0:1762167010.058618:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3077 00002000:00010000:1.0:1762167010.058619:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce7100. 00002000:00010000:3.0:1762167010.058627:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167010.058634:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5c00 with x1847765451948672 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167010.058710:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce5c00. 00000100:00100000:2.0:1762167010.060172:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.060265:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948800 00000100:00100000:0.0:1762167010.060274:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948800 00000100:00100000:0.0:1762167010.060318:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19957 00000100:00100000:0.0:1762167010.060324:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451948800:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167010.060347:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.060381:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b77e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e23 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.060467:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b785 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.060487:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b785 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.060499:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b785 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.060528:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 201220 00000004:00200000:0.0:1762167010.060532:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167010.060548:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b785 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.060571:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b77e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e23 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.060588:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b785 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e23 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.060597:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef200) 00010000:00010000:0.0:1762167010.060600:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167010.060603:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30cc00, rc 0) 00000100:00100000:0.0:1762167010.060665:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451948800:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 338us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.060673:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19957 00000100:00100000:2.0:1762167010.063175:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.063264:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451948928 00000100:00100000:3.0:1762167010.063275:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451948928 00002000:00100000:3.0:1762167010.063314:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->86015) req@ffff9ee243180a80 x1847765451948928/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.063327:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243180a80 with x1847765451948928 ext(81920->86015) 00002000:00010000:3.0:1762167010.063331:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243180a80 00000100:00100000:3.0:1762167010.063357:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3078 00000100:00100000:3.0:1762167010.063377:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451948928:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762167010.063548:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451948928:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 183us (380us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762167010.063553:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3078 00002000:00100000:3.0:1762167010.063558:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->86015) req@ffff9ee243180a80 x1847765451948928/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/4536 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.063563:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243180a80 with x1847765451948928 ext(81920->86015) 00002000:00010000:3.0:1762167010.063566:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243180a80 00000100:00100000:2.0:1762167010.065643:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.065699:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949056 00000100:00100000:3.0:1762167010.065714:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949056 00002000:00100000:3.0:1762167010.065796:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (86016->90111) req@ffff9ee243183100 x1847765451949056/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.065810:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243183100 with x1847765451949056 ext(86016->90111) 00002000:00010000:3.0:1762167010.065816:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243183100 00000100:00100000:3.0:1762167010.065849:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3079 00000100:00100000:3.0:1762167010.065859:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451949056:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762167010.066091:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451949056:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 233us (453us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762167010.066099:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3079 00002000:00100000:3.0:1762167010.066107:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (86016->90111) req@ffff9ee243183100 x1847765451949056/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/4536 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.066115:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243183100 with x1847765451949056 ext(86016->90111) 00002000:00010000:3.0:1762167010.066119:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243183100 00000100:00100000:2.0:1762167010.068071:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.068161:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949184 00000100:00100000:3.0:1762167010.068219:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949184 00002000:00100000:3.0:1762167010.068284:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (61440->126975) req@ffff9ee243182300 x1847765451949184/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 504/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.068296:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243182300 with x1847765451949184 ext(61440->126975) 00002000:00010000:3.0:1762167010.068304:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243182300 00000100:00100000:3.0:1762167010.068344:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3080 00000100:00100000:3.0:1762167010.068353:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451949184:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762167010.070087:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451949184:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1725us (2012us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1762167010.070102:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3080 00002000:00100000:3.0:1762167010.070121:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (61440->126975) req@ffff9ee243182300 x1847765451949184/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 504/440 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.070133:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243182300 with x1847765451949184 ext(61440->126975) 00002000:00010000:3.0:1762167010.070141:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243182300 00000100:00100000:2.0:1762167010.072665:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.072721:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949312 00000100:00100000:3.0:1762167010.072730:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949312 00002000:00100000:3.0:1762167010.072811:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->106495) req@ffff9ee243182680 x1847765451949312/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.072822:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243182680 with x1847765451949312 ext(81920->106495) 00002000:00010000:3.0:1762167010.072828:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243182680 00000100:00100000:3.0:1762167010.072862:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3081 00000100:00100000:3.0:1762167010.072871:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451949312:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:3.0:1762167010.074421:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451949312:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 1546us (1758us total) trans 21474843521 rc 0/0 00000100:00100000:3.0:1762167010.074432:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3081 00002000:00100000:3.0:1762167010.074441:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (81920->106495) req@ffff9ee243182680 x1847765451949312/t21474843521(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/448 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.074451:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243182680 with x1847765451949312 ext(81920->106495) 00002000:00010000:3.0:1762167010.074456:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243182680 00000100:00100000:2.0:1762167010.076043:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.076160:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949440 00000100:00100000:1.0:1762167010.076179:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949440 00000100:00100000:1.0:1762167010.076260:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17217 00000100:00100000:1.0:1762167010.076272:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451949440:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:0.0:1762167010.092254:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843515 is committed 00000001:00080000:0.0:1762167010.092285:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843520 is committed 00000001:00080000:0.0:1762167010.092292:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843518 is committed 00000001:00080000:0.0:1762167010.092334:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843521 is committed 00000100:00100000:2.0:1762167010.092345:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451949440:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 16068us (16301us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.092360:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17217 00000100:00100000:2.0:1762167010.097028:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.097094:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949568 00000100:00100000:3.0:1762167010.097107:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949568 00002000:00100000:3.0:1762167010.097160:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (147456->151551) req@ffff9ee243181880 x1847765451949568/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.097171:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243181880 with x1847765451949568 ext(147456->151551) 00002000:00010000:3.0:1762167010.097177:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243181880 00000100:00100000:3.0:1762167010.097211:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3082 00000100:00100000:3.0:1762167010.097221:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451949568:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:3.0:1762167010.097487:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451949568:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 266us (467us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762167010.097495:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3082 00002000:00100000:3.0:1762167010.097503:0:14122:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x7ff:0x0] (147456->151551) req@ffff9ee243181880 x1847765451949568/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/4536 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.097519:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243181880 with x1847765451949568 ext(147456->151551) 00002000:00010000:3.0:1762167010.097522:0:14122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243181880 00000100:00100000:3.0:1762167010.103690:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.104463:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949824 00000100:00100000:0.0:1762167010.104475:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949824 00000100:00100000:0.0:1762167010.104543:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19958 00000100:00100000:0.0:1762167010.104554:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451949824:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167010.104607:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167010.104644:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b785 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e23 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.104670:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b770 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e15 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.104692:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2477ef200) 00010000:00010000:0.0:1762167010.104704:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.105066:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.105080:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.105090:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167010.105150:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953056 00000004:00010000:0.0:1762167010.105177:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006238a7a3 reply state 0000000073d27a44 transno 8589953057 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.105185:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167010.105287:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451949824:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 733us (1606us total) trans 8589953057 rc 0/0 00000100:00100000:0.0:1762167010.105295:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19958 00000020:00080000:0.0:1762167010.105300:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167010.106481:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.106493:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.106500:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.106506:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167010.106511:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.106522:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.106534:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075dc00) 00010000:00010000:1.0:1762167010.106538:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167010.106542:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.106549:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b78c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167010.106604:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.106655:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451949952 00000100:00100000:0.0:1762167010.106664:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451949952 00000100:00100000:0.0:1762167010.106720:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19959 00000100:00100000:0.0:1762167010.106728:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451949952:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167010.106748:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.106803:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b793 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e2a expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.106848:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b793 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e2a expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.106861:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b793 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e2a expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.106879:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.106882:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167010.106885:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167010.106937:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451949952:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 209us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.106944:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19959 00000100:00100000:2.0:1762167010.108880:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.108918:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.108966:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950080 00000100:00100000:1.0:1762167010.108978:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950080 00002000:00010000:1.0:1762167010.109024:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (239570->18446744073709551615) 00002000:00100000:1.0:1762167010.109030:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243181500 with x1847765451950080 ext(239570->18446744073709551615) 00002000:00010000:1.0:1762167010.109043:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243181500. 00000100:00100000:1.0:1762167010.109064:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950208 00000100:00100000:1.0:1762167010.109068:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950208 00002000:00010000:1.0:1762167010.109081:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.109085:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243180380 with x1847765451950208 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167010.109092:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee243180380. 00000100:00100000:1.0:1762167010.109110:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3083 00000100:00100000:1.0:1762167010.109120:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451950080:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167010.109146:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.109171:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950336 00000100:00100000:3.0:1762167010.109176:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950336 00002000:00010000:3.0:1762167010.109239:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167010.109244:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ceaa00 with x1847765451950336 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167010.109252:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ceaa00. 00000100:00100000:3.0:1762167010.109272:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3084 00000100:00100000:3.0:1762167010.109281:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451950208:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167010.109524:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3085 00002000:00010000:3.0:1762167010.109525:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.109532:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.109532:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 190178 -> 239570 00002000:00010000:3.0:1762167010.109539:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00000100:00100000:2.0:1762167010.109540:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451950336:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167010.109540:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.109546:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.109548:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:3.0:1762167010.109553:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167010.109554:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.109559:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 341 -> 325 00000100:00100000:3.0:1762167010.109622:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451950208:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 340us (700us total) trans 17179875962 rc 0/0 00000100:00100000:3.0:1762167010.109632:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3084 00002000:00010000:3.0:1762167010.109637:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167010.109640:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243180380 with x1847765451950208 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167010.109645:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee243180380. 00002000:00010000:2.0:1762167010.109702:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.109707:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.109709:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167009 -> 1762167009 00002000:00010000:2.0:1762167010.109712:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.109715:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167010.110164:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451950080:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 1042us (1291us total) trans 21474843522 rc 0/0 00000100:00100000:2.0:1762167010.110170:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451950336:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 635us (1022us total) trans 21474843523 rc 0/0 00000100:00100000:1.0:1762167010.110179:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3083 00002000:00010000:1.0:1762167010.110184:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (239570->18446744073709551615) 00000100:00100000:2.0:1762167010.110186:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3085 00002000:00100000:1.0:1762167010.110189:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee243181500 with x1847765451950080 ext(239570->18446744073709551615) 00002000:00010000:2.0:1762167010.110192:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:1.0:1762167010.110196:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee243181500. 00002000:00100000:2.0:1762167010.110198:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242ceaa00 with x1847765451950336 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.110206:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242ceaa00. 00000100:00100000:2.0:1762167010.112144:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.112237:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950464 00000100:00100000:0.0:1762167010.112249:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950464 00000100:00100000:0.0:1762167010.112317:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19960 00000100:00100000:0.0:1762167010.112330:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451950464:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167010.112371:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.112396:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b79a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e31 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.112516:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.112531:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.112544:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167010.112579:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:0.0:1762167010.112584:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167010.112603:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.112628:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b79a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e31 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.112647:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e31 expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.112656:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.112659:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167010.112662:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d200, rc 0) 00000100:00100000:0.0:1762167010.112720:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451950464:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 392us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.112726:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19960 00000100:00100000:0.0:1762167010.116636:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.116749:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950592 00000100:00100000:2.0:1762167010.116799:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950592 00002000:00100000:2.0:1762167010.116856:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (217088->241663) req@ffff9ee2438b8a80 x1847765451950592/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.116868:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2438b8a80 with x1847765451950592 ext(217088->241663) 00002000:00010000:2.0:1762167010.116874:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2438b8a80 00000100:00100000:2.0:1762167010.116907:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3086 00000100:00100000:2.0:1762167010.116918:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451950592:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167010.118110:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2358:x1847765451950592:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1191us (1483us total) trans 0 rc 24576/24576 00000100:00100000:2.0:1762167010.118118:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3086 00002000:00100000:2.0:1762167010.118126:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (217088->241663) req@ffff9ee2438b8a80 x1847765451950592/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/440 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.118134:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2438b8a80 with x1847765451950592 ext(217088->241663) 00002000:00010000:2.0:1762167010.118137:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2438b8a80 00000100:00100000:0.0:1762167010.121556:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.121635:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950848 00000100:00100000:2.0:1762167010.121648:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950848 00000100:00100000:2.0:1762167010.121710:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7374 00000100:00100000:2.0:1762167010.121722:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451950848:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167010.122018:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451950848:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 298us (477us total) trans 8589953058 rc 0/0 00000100:00100000:2.0:1762167010.122029:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7374 00000100:00100000:0.0:1762167010.133350:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.133515:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451950976 00000100:00100000:2.0:1762167010.133533:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451950976 00000100:00100000:2.0:1762167010.133620:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19961 00000100:00100000:2.0:1762167010.133633:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56218:x1847765451950976:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167010.133668:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167010.133695:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7a8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e38 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.133831:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b7af lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.133850:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b7af lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.133865:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b7af lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.133884:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b7b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.133892:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.133901:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134066:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b7bd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134076:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b7bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134084:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b7bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167010.134127:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:2.0:1762167010.134132:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167010.134155:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b7bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134168:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b7bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134176:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b7af lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134182:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b7af lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134187:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b7af lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134193:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167010.134197:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b7af lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134204:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b7af lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134217:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167010.134220:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167010.134226:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b7af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134231:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0b7af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134247:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134253:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b7b6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134258:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134263:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167010.134266:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134272:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b7b6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134279:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0900) 00010000:00010000:2.0:1762167010.134281:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167010.134284:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b7b6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134289:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0b7b6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.134331:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7a8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e38 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.134346:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b7bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e38 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.134353:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.134355:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167010.134358:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:2.0:1762167010.134457:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56218:x1847765451950976:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 825us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.134465:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19961 00000100:00100000:0.0:1762167010.137565:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.137567:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.137679:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951360 00000100:00100000:2.0:1762167010.137693:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951360 00000100:00100000:2.0:1762167010.137811:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19962 00000100:00100000:2.0:1762167010.137829:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56218:x1847765451951360:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:1.0:1762167010.137835:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951104 00000100:00100000:1.0:1762167010.137845:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951104 00010000:00010000:2.0:1762167010.137856:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167010.137884:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b7c4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e3f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.137894:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 658 00000100:00100000:1.0:1762167010.137906:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451951104:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167010.137925:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.137951:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0b7bd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e38 expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.137974:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.137979:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.138024:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.138042:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e31 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.138052:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167010.138062:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765451951104:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 156us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.138073:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 658 00010000:00010000:2.0:1762167010.138106:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e31 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.138125:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e31 expref: 895 pid: 30817 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167010.138142:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454509568:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167010.138228:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345adfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167010.139830:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454509568:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167010.139859:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167010.140045:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.140096:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951488 00000100:00100000:2.0:1762167010.140103:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951488 00010000:00010000:2.0:1762167010.140138:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e31 expref: 896 pid: 30817 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167010.140184:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7596 00000100:00100000:2.0:1762167010.140196:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765451951488:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.140212:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.140219:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e31 expref: 896 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167010.140232:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e31 expref: 896 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167010.140253:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b7a1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e31 expref: 896 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167010.140270:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.140275:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.140284:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.140297:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.140329:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.140387:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167010.140395:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765451951488:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 200us (350us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167010.140401:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167010.140408:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7596 00000004:00200000:0.0:1762167010.140428:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00010000:00010000:0.0:1762167010.140613:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0b7c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e3f expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.140628:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e3f expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.140634:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.140636:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167010.140638:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:0.0:1762167010.140673:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee35047f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56218:x1847765451951360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2852us (3129us total) trans 8589953059 rc 0/0 00000100:00100000:0.0:1762167010.140678:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19962 00000100:00100000:3.0:1762167010.142621:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.142690:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951616 00000100:00100000:0.0:1762167010.142702:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951616 00000100:00100000:0.0:1762167010.142791:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19963 00000100:00100000:0.0:1762167010.142803:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56218:x1847765451951616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.142828:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.142845:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b7d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e46 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.142925:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.142940:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e3f expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.142959:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.142997:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e3f expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.143012:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e3f expref: 896 pid: 30817 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167010.143027:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454509696:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167010.143106:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167010.144418:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454509696:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167010.144447:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167010.144701:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.144802:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451951744 00000100:00100000:2.0:1762167010.144809:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451951744 00010000:00010000:2.0:1762167010.144839:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e3f expref: 897 pid: 30817 timeout: 730 lvb_type: 0 00000100:00100000:2.0:1762167010.144877:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7597 00000100:00100000:2.0:1762167010.144885:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451951744:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.144897:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.144902:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e3f expref: 897 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167010.144913:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e3f expref: 897 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167010.144931:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0b7cb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e3f expref: 897 pid: 30817 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167010.144944:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.144948:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.144960:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.144967:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.144993:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.145017:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.145027:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167010.145036:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765451951744:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 149us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.145046:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7597 00000004:00200000:0.0:1762167010.145068:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:0.0:1762167010.145074:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167010.145093:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.145121:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b7d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e46 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.145138:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e46 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.145146:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.145149:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167010.145152:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30da00, rc 0) 00000100:00100000:0.0:1762167010.145193:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56218:x1847765451951616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2394us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.145200:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19963 00000100:00100000:3.0:1762167010.147518:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.147573:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952000 00000100:00100000:0.0:1762167010.147581:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952000 00000100:00100000:0.0:1762167010.147639:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19964 00000100:00100000:0.0:1762167010.147649:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56218:x1847765451952000:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.147673:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.147692:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b7e7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e4d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.147813:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b7ee lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.147828:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b7ee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.147839:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b7ee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167010.147851:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00010000:00010000:0.0:1762167010.147980:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b7e7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e4d expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.147998:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b7ee lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e4d expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.148006:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.148009:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167010.148013:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167010.148057:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56218:x1847765451952000:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 410us (548us total) trans 8589953060 rc 0/0 00000100:00100000:0.0:1762167010.148064:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19964 00000100:00100000:1.0:1762167010.150267:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.150317:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.150334:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952256 00000100:00100000:1.0:1762167010.150341:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.150345:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952256 00000100:00100000:2.0:1762167010.150411:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952128 00000100:00100000:2.0:1762167010.150415:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952128 00000100:00100000:3.0:1762167010.150418:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952384 00000100:00100000:3.0:1762167010.150424:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952384 00000100:00100000:2.0:1762167010.150459:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17218 00000100:00100000:2.0:1762167010.150470:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451952256:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167010.150513:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.150532:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 33 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.150539:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167010.150542:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167010.150545:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.150581:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 33 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.150597:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17219 00010000:00010000:2.0:1762167010.150602:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 33 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:3.0:1762167010.150610:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17220 00000100:00100000:0.0:1762167010.150613:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451952128:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:3.0:1762167010.150627:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451952384:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167010.150629:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454509824:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167010.150643:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.150655:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.150659:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.150676:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167010.150679:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.150680:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.150683:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.150698:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.150702:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.150705:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.150716:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 20 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.150720:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee345adf3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1762167010.150731:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 20 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.150732:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 20 pid: 33892 timeout: 730 lvb_type: 0 00010000:00010000:3.0:1762167010.150759:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 20 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167010.150779:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454509952:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167010.150796:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454510080:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167010.150824:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167010.150889:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720300 going to sleep for 11 seconds 00000100:00100000:2.0:1762167010.152879:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454509824:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167010.152916:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.153061:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454509952:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167010.153087:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.153089:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454510080:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167010.153123:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.153158:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.153172:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952512 00000100:00100000:0.0:1762167010.153180:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952512 00000100:00100000:1.0:1762167010.153194:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167010.153218:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 34 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1762167010.153222:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952640 00000100:00100000:1.0:1762167010.153228:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952640 00010000:00010000:1.0:1762167010.153252:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 21 pid: 12402 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167010.153273:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7598 00000100:00100000:1.0:1762167010.153281:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7599 00000100:00100000:0.0:1762167010.153286:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451952512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762167010.153293:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451952640:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167010.153302:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.153304:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762167010.153317:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952768 00000100:00100000:3.0:1762167010.153322:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952768 00010000:00010000:1.0:1762167010.153329:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 22 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167010.153329:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 34 pid: 12402 timeout: 730 lvb_type: 0 00002000:00100000:3.0:1762167010.153351:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (118784->151551) req@ffff9ee36f332d80 x1847765451952768/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1762167010.153358:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 34 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.153377:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 22 pid: 12402 timeout: 730 lvb_type: 0 00002000:00100000:3.0:1762167010.153381:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f332d80 with x1847765451952768 ext(118784->151551) 00010000:00010000:3.0:1762167010.153391:0:14118:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 22 pid: 33892 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167010.153396:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.153405:0:14118:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 22 pid: 33892 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1762167010.153409:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b69e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ddd expref: 22 pid: 12402 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167010.153411:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0b697 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3dd6 expref: 34 pid: 12402 timeout: 730 lvb_type: 0 00002000:00010000:3.0:1762167010.153417:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee36f332d80 00010000:00010000:1.0:1762167010.153433:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.153434:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.153437:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.153438:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.153445:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.153446:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.153462:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 26 00010000:00010000:0.0:1762167010.153470:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.153471:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.153481:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451952768:12345-192.168.203.35@tcp:4:fsx.0 00010000:00010000:1.0:1762167010.153512:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.153524:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167010.153563:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451952640:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 272us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.153572:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7599 00010000:00010000:3.0:1762167010.153593:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.153601:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.153611:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451952512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 327us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.153619:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7598 00010000:00010000:3.0:1762167010.153626:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.153634:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.153635:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.153655:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.153657:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.153673:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.153678:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.153681:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.153691:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.153693:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.153713:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.153718:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.153721:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.153727:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.153738:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.153746:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b7fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.153817:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451952256:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3349us (3559us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.153826:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17218 00010000:00010000:3.0:1762167010.153869:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.153881:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b80a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.153993:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451952384:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3372us (3652us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.154001:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17220 00000100:00100000:2.0:1762167010.155261:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451952768:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 1783us (2098us total) trans 21474843524 rc 0/0 00000100:00100000:2.0:1762167010.155272:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 26 00002000:00100000:2.0:1762167010.155282:0:6539:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7ff:0x0] (118784->151551) req@ffff9ee36f332d80 x1847765451952768/t21474843524(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/448 e 0 to 0 dl 1762167021 ref 1 fl Complete:H/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.155292:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f332d80 with x1847765451952768 ext(118784->151551) 00010000:00010000:2.0:1762167010.155301:0:6539:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 21 pid: 33892 timeout: 730 lvb_type: 0 00010000:00010000:2.0:1762167010.155316:0:6539:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 21 pid: 33892 timeout: 730 lvb_type: 0 00002000:00010000:2.0:1762167010.155324:0:6539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee36f332d80 00000100:00100000:1.0:1762167010.157194:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.157255:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451952896 00000100:00100000:0.0:1762167010.157269:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451952896 00010000:00010000:0.0:1762167010.157319:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 21 pid: 33892 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1762167010.157380:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7600 00000100:00100000:0.0:1762167010.157392:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451952896:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167010.157412:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1762167010.157436:0:7415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167009 -> 1762167010 00010000:00010000:0.0:1762167010.157455:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 21 pid: 33892 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167010.157470:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 21 pid: 33892 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167010.157496:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e1c expref: 21 pid: 33892 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1762167010.157514:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.157518:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.157526:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.157536:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.157587:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.157611:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.157624:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.157650:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.157653:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451952896:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 262us (470us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167010.157669:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.157670:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7600 00010000:00010000:2.0:1762167010.157682:0:12400:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.157701:0:12400:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.157707:0:12400:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.157715:0:12400:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.157727:0:12400:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.157733:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b803 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.157806:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451952128:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 7198us (7488us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.157814:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17219 00000100:00100000:0.0:1762167010.159497:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.159586:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953152 00000100:00100000:2.0:1762167010.159594:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953152 00000100:00100000:2.0:1762167010.159647:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19965 00000100:00100000:2.0:1762167010.159658:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56218:x1847765451953152:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167010.159716:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762167010.159740:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b7e0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e46 expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.159759:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b793 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e2a expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.159824:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.159828:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.159861:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.159880:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.159890:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000040:00080000:2.0:1762167010.160447:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5555, 88 off449120 00000004:00080000:2.0:1762167010.160458:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630952694369ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.160516:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5563, 88 off450176 00000004:00080000:2.0:1762167010.160521:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630952758213ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.160557:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5564, 88 off450264 00000004:00080000:2.0:1762167010.160562:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630952798981ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.160582:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5556, 88 off449208 00000004:00080000:2.0:1762167010.160585:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630952822461ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.160645:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5565, 88 off450352 00000004:00080000:2.0:1762167010.160650:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630952887139ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.160671:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5557, 88 off449296 00000004:00080000:2.0:1762167010.160675:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630952912069ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.160699:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5558, 88 off449384 00000004:00080000:2.0:1762167010.160704:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630952941452ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.160725:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5566, 88 off450440 00000004:00080000:2.0:1762167010.160729:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630952966554ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.160753:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5567, 88 off450528 00000004:00080000:2.0:1762167010.160757:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630952994371ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.160802:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5559, 88 off449472 00000004:00080000:2.0:1762167010.160807:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630953044279ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.160867:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5569, 88 off450648 00000004:00080000:2.0:1762167010.160872:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630953109511ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.160906:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5560, 88 off449560 00000004:00080000:2.0:1762167010.160911:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630953148013ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.160941:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5561, 88 off449648 00000004:00080000:2.0:1762167010.160946:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630953182681ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.160964:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5570, 88 off450736 00000004:00080000:2.0:1762167010.160968:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630953205304ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.161013:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5562, 88 off449736 00000004:00080000:2.0:1762167010.161017:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630953254406ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.161045:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5571, 88 off450824 00000004:00080000:2.0:1762167010.161051:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630953287968ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.161069:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5572, 88 off450912 00000004:00080000:2.0:1762167010.161072:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630953309066ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.161088:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5563, 88 off449824 00000004:00080000:2.0:1762167010.161092:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630953329129ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.161107:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5564, 88 off449912 00000004:00080000:2.0:1762167010.161110:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630953347854ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.161122:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5573, 88 off451000 00000004:00080000:2.0:1762167010.161125:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630953362292ns, next at 630703976179ns, rc = 0 00000004:00010000:0.0:1762167010.176041:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e1048264 reply state 0000000059671d10 transno 8589953061 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167010.176063:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1762167010.176072:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953060 is committed 00000001:00080000:2.0:1762167010.176097:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953061 is committed 00000004:00080000:2.0:1762167010.176102:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3684 committed 00000004:00080000:2.0:1762167010.176123:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3671 committed 00000004:00080000:2.0:1762167010.176137:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3670 committed 00000004:00080000:2.0:1762167010.176140:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3683 committed 00000004:00080000:2.0:1762167010.176142:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3682 committed 00000004:00080000:2.0:1762167010.176144:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3669 committed 00000004:00080000:2.0:1762167010.176147:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3681 committed 00000004:00080000:2.0:1762167010.176149:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3668 committed 00000004:00080000:2.0:1762167010.176151:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3667 committed 00000004:00080000:2.0:1762167010.176153:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3680 committed 00000004:00080000:2.0:1762167010.176155:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3666 committed 00000004:00080000:2.0:1762167010.176158:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3679 committed 00000004:00080000:2.0:1762167010.176160:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3678 committed 00000004:00080000:2.0:1762167010.176161:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3665 committed 00000004:00080000:2.0:1762167010.176164:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3664 committed 00000004:00080000:2.0:1762167010.176167:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3677 committed 00000004:00080000:2.0:1762167010.176169:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3663 committed 00000004:00080000:2.0:1762167010.176171:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3676 committed 00000004:00080000:2.0:1762167010.176174:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3675 committed 00000004:00080000:2.0:1762167010.176176:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3662 committed 00010000:00080000:0.0:1762167010.176220:0:30817:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762167010.176246:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56218:x1847765451953152:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 16584us (16751us total) trans 8589953061 rc 0/0 00000100:00100000:0.0:1762167010.176257:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19965 00010000:00010000:0.0:1762167010.176302:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.176311:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.176319:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.176326:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167010.176330:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.176344:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.176377:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.176381:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167010.176387:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167010.176393:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0b811 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167010.176464:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454510336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.176540:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.176592:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762167010.176607:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454510464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.176653:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.176695:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454510848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.176728:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.176755:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454511360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.176806:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454510208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.176823:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454510592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.176838:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.176866:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454511872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.176899:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.176937:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454510976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.176940:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454510336 00000100:00100000:0.0:1762167010.176952:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454510336 00000100:00100000:2.0:1762167010.176961:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454511104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.177003:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.177021:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454510464 00000100:00100000:0.0:1762167010.177026:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454510464 00000100:00100000:0.0:1762167010.177060:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454510848 00000100:00100000:1.0:1762167010.177061:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454511488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.177065:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454510848 00000100:00100000:0.0:1762167010.177101:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454511360 00000100:00100000:0.0:1762167010.177105:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454511360 00000100:00100000:2.0:1762167010.177111:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454510592 00000100:00100000:1.0:1762167010.177112:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.177121:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454510592 00000100:00100000:0.0:1762167010.177130:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454510976 00000100:00100000:0.0:1762167010.177135:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454510976 00000100:00100000:1.0:1762167010.177148:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454512000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.177158:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454511488 00000100:00100000:0.0:1762167010.177164:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17221 00000100:00100000:2.0:1762167010.177166:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454511488 00000100:00100000:0.0:1762167010.177176:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1847765454510336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.177196:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.177207:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17222 00000100:00100000:2.0:1762167010.177219:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3295:x1847765454510464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.177254:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454512000 00000100:00100000:1.0:1762167010.177263:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454512000 00000100:00100000:1.0:1762167010.177316:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17223 00000100:00100000:1.0:1762167010.177333:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3295:x1847765454510848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.177483:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3295:x1847765454510336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 309us (941us total) trans 17179875963 rc 0/0 00000100:00100000:0.0:1762167010.177492:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17221 00000100:00100000:2.0:1762167010.177571:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3295:x1847765454510464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 351us (917us total) trans 21474843525 rc 0/0 00000100:00100000:2.0:1762167010.177585:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17222 00000100:00100000:2.0:1762167010.177618:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17224 00000100:00100000:2.0:1762167010.177632:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3295:x1847765454511360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.177643:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3295:x1847765454510848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 314us (910us total) trans 17179875964 rc 0/0 00000100:00100000:1.0:1762167010.177656:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17223 00000100:00100000:1.0:1762167010.177689:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17225 00000100:00100000:0.0:1762167010.177703:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17226 00000100:00100000:1.0:1762167010.177705:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3293:x1847765454510592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.177718:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765454510976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.177856:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3295:x1847765454511360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (1020us total) trans 17179875965 rc 0/0 00000100:00100000:2.0:1762167010.177864:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17224 00000100:00100000:2.0:1762167010.177892:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17227 00000100:00100000:2.0:1762167010.177904:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454511488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.177951:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454510976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 236us (948us total) trans 21474843526 rc 0/0 00000100:00100000:0.0:1762167010.177961:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17226 00000100:00100000:1.0:1762167010.177978:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3293:x1847765454510592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 275us (1076us total) trans 17179875966 rc 0/0 00000100:00100000:0.0:1762167010.177989:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17228 00000100:00100000:1.0:1762167010.177999:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17225 00000100:00100000:0.0:1762167010.178006:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3296:x1847765454512000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.178010:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843518 gen 2 00000004:00080000:3.0:1762167010.178018:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242ce8700, transno 21474843499 00000004:00080000:3.0:1762167010.178030:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242ce8000, transno 21474843500 00000004:00080000:3.0:1762167010.178034:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242cead80, transno 21474843501 00000004:00080000:3.0:1762167010.178039:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242cea680, transno 21474843502 00000004:00080000:3.0:1762167010.178043:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242cebb80, transno 21474843503 00000100:00100000:1.0:1762167010.178050:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167010.178051:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242ce9500, transno 21474843504 00000004:00080000:3.0:1762167010.178060:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242ceb100, transno 21474843505 00000004:00080000:3.0:1762167010.178067:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc2aa00, transno 21474843506 00000004:00080000:3.0:1762167010.178074:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9c00, transno 21474843507 00000004:00080000:3.0:1762167010.178081:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a8700, transno 21474843508 00000004:00080000:3.0:1762167010.178084:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9f80, transno 21474843509 00000004:00080000:3.0:1762167010.178087:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb10380, transno 21474843510 00000004:00080000:3.0:1762167010.178091:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435ab480, transno 21474843511 00000100:00100000:1.0:1762167010.178095:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454510720:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167010.178097:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb13b80, transno 21474843512 00000004:00080000:3.0:1762167010.178106:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a8a80, transno 21474843513 00000004:00080000:3.0:1762167010.178111:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9180, transno 21474843514 00000004:00080000:3.0:1762167010.178113:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a8e00, transno 21474843515 00000004:00080000:3.0:1762167010.178119:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb13800, transno 21474843516 00000004:00080000:3.0:1762167010.178124:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb10e00, transno 21474843517 00000004:00080000:3.0:1762167010.178130:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb11180, transno 21474843518 00000100:00100000:3.0:1762167010.178142:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36f286d80 x1847765454510976/t21474843526(21474843526) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167026 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762167010.178153:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167010.178161:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.178164:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.178170:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.178170:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000004:00080000:3.0:1762167010.178172:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f286d80/2, rc 0, transno 21474843526 00002000:00010000:0.0:1762167010.178177:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167010.178178:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:1.0:1762167010.178181:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454511232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.178183:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454510976:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167010.178188:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.178188:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.178200:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167010.178201:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167010.178241:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.178275:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454511744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.178289:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454511488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 387us (1178us total) trans 21474843527 rc 0/0 00000100:00100000:0.0:1762167010.178290:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3296:x1847765454512000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 290us (1098us total) trans 17179875967 rc 0/0 00000100:00100000:2.0:1762167010.178307:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17227 00000100:00100000:1.0:1762167010.178321:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.178323:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17228 00000100:00100000:2.0:1762167010.178334:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454510208 00000100:00100000:2.0:1762167010.178342:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454510208 00000100:00100000:0.0:1762167010.178374:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454510720 00000100:00100000:0.0:1762167010.178380:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454510720 00000100:00100000:2.0:1762167010.178392:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454511232 00000100:00100000:1.0:1762167010.178400:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.178401:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454511232 00000100:00100000:0.0:1762167010.178403:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454511744 00000100:00100000:0.0:1762167010.178411:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454511744 00000100:00100000:1.0:1762167010.178437:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454511616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.178439:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454511104 00000100:00100000:2.0:1762167010.178448:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454511104 00000100:00100000:0.0:1762167010.178448:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17229 00000100:00100000:0.0:1762167010.178462:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454510208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.178483:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17230 00000100:00100000:1.0:1762167010.178493:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.178505:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454510720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.178521:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454512128:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.178565:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167010.178625:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1762167010.178626:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f332a00/2, rc 0, transno 17179875966 00000004:00080000:3.0:1762167010.178635:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 7 in flight, 20 done 00002000:00010000:0.0:1762167010.178636:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167010.178641:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.178643:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167010.178648:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.178648:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000100:00100000:1.0:1762167010.178652:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454510592:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167010.178656:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167010.178658:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167010.178668:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.178675:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.178717:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3294:x1847765454510208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 256us (668us total) trans 17179875968 rc 0/0 00000100:00100000:0.0:1762167010.178728:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17229 00000100:00100000:2.0:1762167010.178733:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3294:x1847765454510720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (579us total) trans 17179875969 rc 0/0 00000100:00100000:2.0:1762167010.178745:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17230 00000100:00100000:1.0:1762167010.178759:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762167010.178791:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454511616 00000100:00100000:2.0:1762167010.178797:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454511616 00000100:00100000:0.0:1762167010.178803:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454512128 00000100:00100000:0.0:1762167010.178811:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454512128 00000100:00100000:1.0:1762167010.178818:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454512256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.178825:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17231 00000100:00100000:2.0:1762167010.178838:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454511232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.178844:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17232 00000100:00100000:0.0:1762167010.178856:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454511744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.178865:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167010.179010:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.179015:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.179018:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167010.179021:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.179023:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167010.179031:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454512256 00000100:00100000:1.0:1762167010.179040:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454512256 00000100:00100000:2.0:1762167010.179062:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454511232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (821us total) trans 21474843528 rc 0/0 00000100:00100000:0.0:1762167010.179071:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3294:x1847765454511744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (757us total) trans 17179875970 rc 0/0 00000100:00100000:2.0:1762167010.179074:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17231 00000100:00100000:1.0:1762167010.179287:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17233 00000100:00100000:0.0:1762167010.179297:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17232 00000100:00100000:1.0:1762167010.179303:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454511104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.179314:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17234 00000100:00100000:0.0:1762167010.179323:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17235 00000100:00100000:2.0:1762167010.179330:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454511616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.179335:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454512128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167010.179529:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.179532:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.179535:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167010.179537:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.179540:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167010.179609:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454511616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 286us (1123us total) trans 21474843529 rc 0/0 00000100:00100000:2.0:1762167010.179621:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17234 00002000:00010000:1.0:1762167010.179650:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.179656:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:2.0:1762167010.179662:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17236 00002000:00010000:1.0:1762167010.179665:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167010.179668:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 201220 -> 201220 00002000:00010000:1.0:1762167010.179672:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.179676:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:2.0:1762167010.179681:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3293:x1847765454512256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167010.179684:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167010.179687:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000004:00080000:3.0:1762167010.179691:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284e00/2, rc 0, transno 21474843529 00002000:00010000:0.0:1762167010.179704:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.179708:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167010.179718:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454511616:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167010.179751:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284700/2, rc 0, transno 21474843530 00000100:00100000:1.0:1762167010.179753:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454511104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 453us (1357us total) trans 21474843530 rc 0/0 00000100:00100000:3.0:1762167010.179789:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454511104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.179790:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17233 00000004:00080000:3.0:1762167010.179815:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f286680/2, rc 0, transno 21474843531 00000100:00100000:3.0:1762167010.179826:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454512128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.179826:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454512128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 488us (1258us total) trans 21474843531 rc 0/0 00000100:00100000:0.0:1762167010.179853:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17235 00000100:00100000:2.0:1762167010.179930:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454512256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 255us (1064us total) trans 17179875971 rc 0/0 00000100:00100000:2.0:1762167010.179939:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17236 00000004:00080000:3.0:1762167010.179973:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247858700/2, rc 0, transno 17179875971 00000100:00100000:2.0:1762167010.179982:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454512512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.179992:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.180005:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454512256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.180031:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.180050:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454511872 00000100:00100000:2.0:1762167010.180057:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454511872 00000004:00080000:0.0:1762167010.180090:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f331180/2, rc 0, transno 17179875964 00000100:00100000:2.0:1762167010.180096:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17237 00000100:00100000:0.0:1762167010.180099:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454510848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.180109:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454511872:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167010.180119:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f332300/2, rc 0, transno 17179875965 00000100:00100000:0.0:1762167010.180128:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454511360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.180143:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167010.180168:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f286300/2, rc 0, transno 21474843525 00000100:00100000:0.0:1762167010.180179:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454510464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.180185:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454512640:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167010.180197:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f333100/2, rc 0, transno 17179875963 00000100:00100000:0.0:1762167010.180204:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454510336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.180225:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454512384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.180236:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167010.180272:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f285f80/2, rc 0, transno 21474843527 00000100:00100000:3.0:1762167010.180281:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454511488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.180306:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167010.180312:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f330e00/2, rc 0, transno 17179875967 00000100:00100000:3.0:1762167010.180321:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454512000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.180337:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454512512 00000100:00100000:1.0:1762167010.180344:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454512512 00000100:00100000:2.0:1762167010.180379:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454511872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 270us (344us total) trans 21474843532 rc 0/0 00000004:00080000:0.0:1762167010.180381:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284a80/2, rc 0, transno 21474843532 00000100:00100000:1.0:1762167010.180385:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454512640 00000100:00100000:1.0:1762167010.180392:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454512640 00000100:00100000:0.0:1762167010.180393:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454511872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.180399:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17237 00000100:00100000:1.0:1762167010.180428:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454512384 00000100:00100000:1.0:1762167010.180434:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454512384 00000100:00100000:2.0:1762167010.180440:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17238 00000100:00100000:0.0:1762167010.180449:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17239 00000100:00100000:2.0:1762167010.180455:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454512512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.180468:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454512640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.180474:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17240 00000100:00100000:1.0:1762167010.180486:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454512384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167010.180624:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.180628:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.180633:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167010.180636:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.180639:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.180700:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3293:x1847765454512640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 239us (471us total) trans 17179875972 rc 0/0 00000100:00100000:2.0:1762167010.180705:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454512512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (574us total) trans 21474843533 rc 0/0 00002000:00010000:1.0:1762167010.180713:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167010.180714:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17239 00002000:00010000:1.0:1762167010.180726:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:2.0:1762167010.180734:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17238 00002000:00010000:1.0:1762167010.180736:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167010.180743:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.180746:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:0.0:1762167010.180824:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f332680/2, rc 0, transno 17179875968 00000100:00100000:0.0:1762167010.180833:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454510208:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167010.180854:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f330a80/2, rc 0, transno 17179875969 00000100:00100000:0.0:1762167010.180860:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454510720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.180864:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454512384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 367us (552us total) trans 21474843534 rc 0/0 00000004:00080000:2.0:1762167010.180872:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284380/2, rc 0, transno 21474843534 00000004:00080000:0.0:1762167010.180879:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f286a00/2, rc 0, transno 21474843528 00000100:00100000:1.0:1762167010.180881:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17240 00000100:00100000:2.0:1762167010.180888:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454512384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.180889:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454511232:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167010.180913:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f331c00/2, rc 0, transno 17179875970 00000100:00100000:0.0:1762167010.180917:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454511744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167010.180956:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247858e00/2, rc 0, transno 17179875972 00000100:00100000:0.0:1762167010.180960:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454512640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.180979:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953280 00000100:00100000:0.0:1762167010.180983:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953280 00000004:00080000:3.0:1762167010.181017:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f285180/2, rc 0, transno 21474843533 00000100:00100000:3.0:1762167010.181024:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454512512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.181027:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19966 00000100:00100000:0.0:1762167010.181038:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56218:x1847765451953280:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.181053:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.181072:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b818 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e54 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.181123:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b818 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e54 expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.181137:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b818 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e54 expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.181160:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.181163:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167010.181167:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c600, rc 0) 00000100:00100000:0.0:1762167010.181211:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56218:x1847765451953280:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.181218:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19966 00000100:00100000:1.0:1762167010.183214:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.183337:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953408 00000100:00100000:0.0:1762167010.183346:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953408 00000100:00100000:0.0:1762167010.183445:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19967 00000100:00100000:0.0:1762167010.183456:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56218:x1847765451953408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.183485:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.183517:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b81f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e5b expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.183629:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b826 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.183643:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b826 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.183666:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b826 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.183711:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:0.0:1762167010.183723:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167010.183739:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b826 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.183841:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b81f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e5b expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.183861:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b826 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e5b expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.183880:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.183883:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167010.183887:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167010.183996:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56218:x1847765451953408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 528us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.184005:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19967 00000100:00100000:2.0:1762167010.185995:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.186032:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.186069:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.186185:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953536 00000100:00100000:3.0:1762167010.186194:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953536 00000100:00100000:3.0:1762167010.186244:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953664 00000100:00100000:3.0:1762167010.186248:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953664 00000100:00100000:3.0:1762167010.186266:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953792 00000100:00100000:3.0:1762167010.186270:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953792 00000100:00100000:2.0:1762167010.186287:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17241 00000100:00100000:3.0:1762167010.186298:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17242 00000100:00100000:2.0:1762167010.186299:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451953536:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:3.0:1762167010.186312:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451953664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167010.186314:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167010.186325:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167010.186331:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b82d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e62 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.186340:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b834 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e69 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167010.186356:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 239570, mtime: 0x690888e2, atime: 0x690888e2, ctime: 0x690888e2, blocks: 0x145 00002000:00010000:3.0:1762167010.186373:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888e2, atime: 0x690888e1, ctime: 0x690888e2, blocks: 0x3 00010000:00010000:2.0:1762167010.186384:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.186386:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.186388:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.186391:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.186398:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e62 expref: 21 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167010.186400:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b834 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e69 expref: 33 pid: 12400 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167010.186427:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17243 00010000:00010000:3.0:1762167010.186433:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b834 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e69 expref: 33 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167010.186433:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e62 expref: 21 pid: 6533 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167010.186444:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451953792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.186460:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167010.186463:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00010000:00010000:3.0:1762167010.186464:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923e00, rc 0) 00010000:00010000:0.0:1762167010.186474:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b83b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e70 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167010.186492:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888e2, atime: 0x690888e1, ctime: 0x690888e2, blocks: 0x3 00010000:00010000:0.0:1762167010.186503:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.186506:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.186512:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b83b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e70 expref: 22 pid: 33894 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762167010.186514:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451953536:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 217us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.186530:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17241 00010000:00010000:0.0:1762167010.186536:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b83b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e70 expref: 22 pid: 33894 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167010.186545:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765451953664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 233us (508us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167010.186550:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30da00, rc 0) 00000100:00100000:3.0:1762167010.186556:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17242 00000100:00100000:0.0:1762167010.186580:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2359:x1847765451953792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 141us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.186587:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17243 00000100:00100000:2.0:1762167010.215011:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.215075:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451953920 00000100:00100000:1.0:1762167010.215085:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451953920 00000100:00100000:1.0:1762167010.215150:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3087 00000100:00100000:1.0:1762167010.215161:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451953920:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167010.215200:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b842 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.215213:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.215215:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.215221:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b842 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.215236:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b842 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.218283:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b842 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.218302:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b842 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.218311:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b842 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.218318:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.218322:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b842 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.218336:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b842 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.218354:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b842 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.218374:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b842 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.218450:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451953920:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3288us (3445us total) trans 0 rc 239570/239570 00000100:00100000:2.0:1762167010.218462:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3087 00000100:00100000:2.0:1762167010.220898:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.220984:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954048 00000100:00100000:1.0:1762167010.220996:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954048 00000100:00100000:1.0:1762167010.221069:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3088 00000100:00100000:1.0:1762167010.221079:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765451954048:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167010.221127:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 201220, mtime: 0x690888e2, atime: 0x690888d5, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:1.0:1762167010.221136:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b849 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.221149:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.221151:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.221156:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.221171:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167010.240340:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875972 is committed 00000001:00080000:3.0:1762167010.240390:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875961 is committed 00000001:00080000:3.0:1762167010.240421:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875973 is committed 00002000:00010000:1.0:1762167010.240591:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 201220 -> 241664 00010000:00010000:1.0:1762167010.240608:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.240620:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.240629:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.240636:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167010.240641:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.240649:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.240689:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b849 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.240696:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b849 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.240865:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451954048:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 19783us (19972us total) trans 17179875973 rc 0/0 00000100:00100000:1.0:1762167010.240876:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3088 00000100:00100000:2.0:1762167010.245246:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.245384:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954176 00000100:00100000:3.0:1762167010.245399:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954176 00000100:00100000:3.0:1762167010.245474:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3089 00000100:00100000:3.0:1762167010.245485:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451954176:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167010.245536:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 201220, mtime: 0x690888e2, atime: 0x690888db, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167010.245551:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.245564:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.245566:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.245571:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.245584:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167010.269135:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843531 is committed 00000001:00080000:0.0:1762167010.269162:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843534 is committed 00000001:00080000:0.0:1762167010.269170:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843522 is committed 00000001:00080000:0.0:1762167010.269187:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843524 is committed 00000001:00080000:0.0:1762167010.269199:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843535 is committed 00002000:00010000:2.0:1762167010.269485:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 201220 -> 241664 00010000:00010000:2.0:1762167010.269502:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.269514:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.269528:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.269536:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.269541:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.269555:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b850 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.269577:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b850 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.269584:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0b850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.269696:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2438ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451954176:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 24209us (24473us total) trans 21474843535 rc 0/0 00000100:00100000:2.0:1762167010.269706:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3089 00000100:00100000:2.0:1762167010.273283:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.273413:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954304 00000100:00100000:3.0:1762167010.273426:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954304 00000100:00100000:3.0:1762167010.273511:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3090 00000100:00100000:3.0:1762167010.273522:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451954304:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167010.273589:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 201220, mtime: 0x690888e2, atime: 0x690888db, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167010.273599:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b857 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.273615:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.273617:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.273623:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.273642:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167010.297389:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875974 is committed 00002000:00010000:0.0:1762167010.297655:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 201220 -> 241664 00010000:00010000:0.0:1762167010.297673:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.297685:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.297693:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.297701:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167010.297705:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.297714:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b857 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.297795:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b857 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.297804:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923400/0xf915a5bdf3d0b857 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.297903:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451954304:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 24379us (24627us total) trans 17179875974 rc 0/0 00000100:00100000:0.0:1762167010.297915:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3090 00000100:00100000:0.0:1762167010.300507:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.300573:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954432 00000100:00100000:3.0:1762167010.300585:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954432 00000100:00100000:3.0:1762167010.300654:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3091 00000100:00100000:3.0:1762167010.300664:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451954432:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167010.300709:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 201220, mtime: 0x690888e2, atime: 0x690888dd, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167010.300718:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b85e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.300735:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.300737:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.300742:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.300757:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.318972:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875975 is committed 00002000:00010000:0.0:1762167010.319137:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 201220 -> 241664 00010000:00010000:0.0:1762167010.319152:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.319162:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b85e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.319168:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b85e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.319172:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167010.319176:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b85e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.319181:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b85e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.319197:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b85e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.319202:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0b85e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.319298:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451954432:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 18633us (18798us total) trans 17179875975 rc 0/0 00000100:00100000:0.0:1762167010.319307:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3091 00000100:00100000:0.0:1762167010.322451:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.322518:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954560 00000100:00100000:3.0:1762167010.322528:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954560 00000100:00100000:3.0:1762167010.322618:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3092 00000100:00100000:3.0:1762167010.322629:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451954560:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167010.322685:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 201220, mtime: 0x690888e2, atime: 0x690888dd, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167010.322692:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b865 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.322704:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.322707:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.322712:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.322726:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167010.345119:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843536 is committed 00002000:00010000:2.0:1762167010.345391:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 201220 -> 241664 00010000:00010000:2.0:1762167010.345406:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.345417:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.345425:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.345432:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.345437:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.345452:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b865 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.345470:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b865 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.345477:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b865 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.345584:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451954560:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 22951us (23140us total) trans 21474843536 rc 0/0 00000100:00100000:2.0:1762167010.345597:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3092 00000100:00100000:2.0:1762167010.348250:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.348333:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954688 00000100:00100000:0.0:1762167010.348345:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954688 00000100:00100000:0.0:1762167010.348442:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3093 00000100:00100000:0.0:1762167010.348456:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451954688:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762167010.348499:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.348519:0:6539:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b75b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e0e expref: 17 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167010.348527:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.348529:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.348533:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.348571:0:6539:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b75b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e0e expref: 17 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167010.348586:0:6539:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b75b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e0e expref: 17 pid: 6533 timeout: 731 lvb_type: 1 00000100:00100000:0.0:1762167010.348610:0:6539:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454512768:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167010.348709:0:6539:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a300 going to sleep for 11 seconds 00000100:00100000:0.0:1762167010.350626:0:6539:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:6539:1847765454512768:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167010.350666:0:6539:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.350728:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.350909:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954816 00000100:00100000:0.0:1762167010.350930:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954816 00010000:00010000:0.0:1762167010.350977:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b75b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e0e expref: 18 pid: 6533 timeout: 731 lvb_type: 1 00000100:00100000:0.0:1762167010.351038:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7601 00000100:00100000:0.0:1762167010.351049:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451954816:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167010.351078:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167010.351112:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b75b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e0e expref: 18 pid: 6533 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1762167010.351123:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b75b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e0e expref: 18 pid: 6533 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1762167010.351160:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b75b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e0e expref: 18 pid: 6533 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1762167010.351193:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.351196:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.351201:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.351221:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.351475:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167010.351565:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451954816:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 518us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.351583:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7601 00010000:00010000:2.0:1762167010.351637:0:6539:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.351657:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167010.370066:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843537 is committed 00002000:00010000:2.0:1762167010.370322:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 201220 -> 241664 00010000:00010000:2.0:1762167010.370337:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.370351:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.370373:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.370382:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.370386:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.370394:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.370416:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.370424:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b86c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.370526:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451954688:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 22069us (22281us total) trans 21474843537 rc 0/0 00000100:00100000:2.0:1762167010.370538:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3093 00000100:00100000:1.0:1762167010.373218:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.373448:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451954944 00000100:00100000:2.0:1762167010.373460:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451954944 00000100:00100000:2.0:1762167010.373537:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3094 00000100:00100000:2.0:1762167010.373548:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451954944:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167010.373599:0:6539:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 201220, mtime: 0x690888e2, atime: 0x690888de, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:2.0:1762167010.373608:0:6539:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b873 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.373623:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.373625:0:6539:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.373631:0:6539:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.373644:0:6539:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.389693:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875976 is committed 00002000:00010000:2.0:1762167010.389895:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 201220 -> 241664 00010000:00010000:2.0:1762167010.389913:0:6539:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.389924:0:6539:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b873 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.389931:0:6539:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b873 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.389938:0:6539:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.389942:0:6539:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b873 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.389951:0:6539:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b873 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.389969:0:6539:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b873 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.389975:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0b873 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.390077:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451954944:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16527us (16864us total) trans 17179875976 rc 0/0 00000100:00100000:2.0:1762167010.390086:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3094 00000100:00100000:0.0:1762167010.392634:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.392695:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451955072 00000100:00100000:2.0:1762167010.392706:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451955072 00000100:00100000:3.0:1762167010.392815:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3095 00000100:00100000:3.0:1762167010.392831:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451955072:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167010.392883:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 201220, mtime: 0x690888e2, atime: 0x690888e0, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167010.392892:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b87a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.392905:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.392907:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.392912:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.392926:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167010.406684:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843538 is committed 00002000:00010000:2.0:1762167010.406998:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 201220 -> 241664 00010000:00010000:2.0:1762167010.407014:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.407031:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b87a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.407040:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b87a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.407047:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.407052:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b87a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.407060:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b87a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.407079:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b87a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.407087:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b87a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.407194:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765451955072:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14363us (14568us total) trans 21474843538 rc 0/0 00000100:00100000:2.0:1762167010.407208:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3095 00000100:00100000:0.0:1762167010.415621:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.415704:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451955328 00000100:00100000:1.0:1762167010.415714:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451955328 00000100:00100000:1.0:1762167010.415817:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19968 00000100:00100000:1.0:1762167010.415828:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56218:x1847765451955328:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167010.415887:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.415915:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b826 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e5b expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.415935:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.415940:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167010.416239:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.416255:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.416269:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167010.416323:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953062 00000004:00010000:1.0:1762167010.416349:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001cd497d9 reply state 00000000415dd164 transno 8589953063 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.416357:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167010.416465:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56218:x1847765451955328:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 639us (852us total) trans 8589953063 rc 0/0 00000100:00100000:1.0:1762167010.416472:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19968 00000020:00080000:1.0:1762167010.416478:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167010.417376:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.417387:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.417394:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.417400:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7be00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167010.417404:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.417411:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.417423:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.417427:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167010.417430:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.417436:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b881 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.417660:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.417702:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451955456 00000100:00100000:1.0:1762167010.417710:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451955456 00000100:00100000:1.0:1762167010.417755:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17244 00000100:00100000:1.0:1762167010.417787:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56218:x1847765451955456:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.417800:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.417817:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0b888 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e77 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167010.417844:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 241664, mtime: 0x690888e2, atime: 0x690888d5, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:1.0:1762167010.417863:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.417865:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.417872:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0b888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e77 expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.417886:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0b888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e77 expref: 23 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.417902:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7aa00, rc 0) 00000100:00100000:1.0:1762167010.417942:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56218:x1847765451955456:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 178us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.417949:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17244 00000100:00100000:0.0:1762167010.418941:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.418977:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.418998:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451955584 00000100:00100000:2.0:1762167010.419004:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451955584 00002000:00010000:2.0:1762167010.419031:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (239570->18446744073709551615) 00002000:00100000:2.0:1762167010.419035:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc2ad80 with x1847765451955584 ext(239570->18446744073709551615) 00002000:00010000:2.0:1762167010.419042:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fc2ad80. 00000100:00100000:2.0:1762167010.419064:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451955712 00000100:00100000:2.0:1762167010.419068:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451955712 00002000:00010000:2.0:1762167010.419080:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:2.0:1762167010.419084:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc29180 with x1847765451955712 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.419089:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc29180. 00000100:00100000:0.0:1762167010.419100:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3096 00000100:00100000:0.0:1762167010.419109:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451955584:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167010.419116:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3097 00000100:00100000:2.0:1762167010.419127:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451955712:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167010.419460:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 241664 -> 239570 00002000:00010000:0.0:1762167010.419465:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.419468:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167010.419470:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.419471:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.419472:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167010.419479:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.419483:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167010.419485:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.419487:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167010.419529:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451955712:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 404us (551us total) trans 21474843539 rc 0/0 00000100:00100000:2.0:1762167010.419536:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3097 00002000:00010000:2.0:1762167010.419539:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:2.0:1762167010.419542:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc29180 with x1847765451955712 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.419547:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fc29180. 00000100:00100000:0.0:1762167010.419647:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451955584:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 412us (582us total) trans 17179875977 rc 0/0 00000100:00100000:0.0:1762167010.419655:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3096 00002000:00010000:0.0:1762167010.419658:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (239570->18446744073709551615) 00002000:00100000:0.0:1762167010.419662:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fc2ad80 with x1847765451955584 ext(239570->18446744073709551615) 00002000:00010000:0.0:1762167010.419667:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fc2ad80. 00000100:00100000:2.0:1762167010.421041:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.421099:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451955840 00000100:00100000:1.0:1762167010.421105:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451955840 00000100:00100000:1.0:1762167010.421149:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19969 00000100:00100000:1.0:1762167010.421159:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56218:x1847765451955840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.421179:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.421198:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b88f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e7e expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.421285:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b896 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.421300:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b896 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.421311:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b896 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167010.421337:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:1.0:1762167010.421341:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167010.421355:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b896 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.421384:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b88f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e7e expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.421405:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b896 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e7e expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.421413:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.421416:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167010.421420:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ba00, rc 0) 00000100:00100000:1.0:1762167010.421475:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56218:x1847765451955840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 317us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.421483:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19969 00000100:00100000:3.0:1762167010.423195:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.423385:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451956096 00000100:00100000:1.0:1762167010.423393:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451956096 00000100:00100000:1.0:1762167010.423440:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19970 00000100:00100000:1.0:1762167010.423449:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56218:x1847765451956096:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167010.423492:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.423514:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b896 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e7e expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.423529:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.423533:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167010.423812:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.423825:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.423833:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167010.423888:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953064 00000004:00010000:1.0:1762167010.423912:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009048116e reply state 00000000cc239f37 transno 8589953065 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.423920:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167010.423992:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56218:x1847765451956096:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 543us (802us total) trans 8589953065 rc 0/0 00000100:00100000:1.0:1762167010.424001:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19970 00000020:00080000:1.0:1762167010.424006:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167010.425094:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.425115:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.425187:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.425197:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7bc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167010.425203:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.425213:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.425234:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:3.0:1762167010.425238:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167010.425244:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.425252:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b89d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.425335:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.425413:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451956224 00000100:00100000:1.0:1762167010.425424:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451956224 00000100:00100000:1.0:1762167010.425475:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17245 00000100:00100000:1.0:1762167010.425485:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56218:x1847765451956224:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.425501:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.425519:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b8a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e85 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167010.425549:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 241664, mtime: 0x690888e2, atime: 0x690888db, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:1.0:1762167010.425567:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.425569:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.425576:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e85 expref: 18 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.425588:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e85 expref: 18 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.425597:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a600, rc 0) 00000100:00100000:1.0:1762167010.425634:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56218:x1847765451956224:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 152us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.425639:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17245 00000100:00100000:0.0:1762167010.426808:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.426855:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.426898:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451956480 00000100:00100000:2.0:1762167010.426898:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451956352 00000100:00100000:3.0:1762167010.426906:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451956480 00000100:00100000:2.0:1762167010.426907:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451956352 00002000:00010000:2.0:1762167010.426938:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (239570->18446744073709551615) 00002000:00010000:3.0:1762167010.426940:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167010.426944:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13b80 with x1847765451956352 ext(239570->18446744073709551615) 00002000:00100000:3.0:1762167010.426951:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13800 with x1847765451956480 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.426956:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb13b80. 00002000:00010000:3.0:1762167010.426961:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb13800. 00000100:00100000:2.0:1762167010.426988:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3098 00000100:00100000:2.0:1762167010.426998:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451956352:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167010.427004:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3099 00000100:00100000:3.0:1762167010.427015:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451956480:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167010.427277:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.427279:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 241664 -> 239570 00002000:00010000:3.0:1762167010.427281:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.427287:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167010.427287:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.427293:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167010.427294:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.427298:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167010.427300:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.427304:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167010.427342:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451956480:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 329us (487us total) trans 17179875978 rc 0/0 00000100:00100000:2.0:1762167010.427351:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451956352:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 353us (587us total) trans 21474843540 rc 0/0 00000100:00100000:3.0:1762167010.427356:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3099 00002000:00010000:3.0:1762167010.427373:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00000100:00100000:2.0:1762167010.427376:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3098 00002000:00100000:3.0:1762167010.427378:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13800 with x1847765451956480 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.427383:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (239570->18446744073709551615) 00002000:00010000:3.0:1762167010.427385:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb13800. 00002000:00100000:2.0:1762167010.427387:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb13b80 with x1847765451956352 ext(239570->18446744073709551615) 00002000:00010000:2.0:1762167010.427395:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb13b80. 00000100:00100000:2.0:1762167010.428484:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.428537:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451956608 00000100:00100000:1.0:1762167010.428544:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451956608 00000100:00100000:1.0:1762167010.428586:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19971 00000100:00100000:1.0:1762167010.428597:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56218:x1847765451956608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.428614:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.428629:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b8ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e8c expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.428701:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b8b2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.428715:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.428724:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167010.428750:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:1.0:1762167010.428754:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167010.428800:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.428825:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b8ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e8c expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.428842:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e8c expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.428855:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.428858:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167010.428862:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b000, rc 0) 00000100:00100000:1.0:1762167010.428906:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56218:x1847765451956608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 311us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.428912:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19971 00000100:00100000:0.0:1762167010.430584:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.430638:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451956864 00000100:00100000:1.0:1762167010.430647:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451956864 00000100:00100000:1.0:1762167010.430700:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19972 00000100:00100000:1.0:1762167010.430709:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56218:x1847765451956864:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167010.430752:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.430804:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b8b2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e8c expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.430824:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.430828:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167010.431022:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.431034:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.431043:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167010.431089:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953066 00000004:00010000:1.0:1762167010.431109:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000069e2b8c9 reply state 00000000ea14e78e transno 8589953067 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.431122:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167010.431189:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56218:x1847765451956864:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 481us (611us total) trans 8589953067 rc 0/0 00000100:00100000:1.0:1762167010.431196:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19972 00000020:00080000:1.0:1762167010.431200:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167010.432273:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.432284:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.432289:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.432292:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167010.432295:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.432300:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.432309:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.432313:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167010.432316:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.432321:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b8b9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.432435:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.432497:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451956992 00000100:00100000:1.0:1762167010.432505:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451956992 00000100:00100000:1.0:1762167010.432545:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17246 00000100:00100000:1.0:1762167010.432551:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56218:x1847765451956992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.432561:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.432574:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b8c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e93 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167010.432590:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 241664, mtime: 0x690888e2, atime: 0x690888db, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:1.0:1762167010.432603:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.432604:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.432609:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e93 expref: 26 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.432619:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e93 expref: 26 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.432627:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a000, rc 0) 00000100:00100000:1.0:1762167010.432658:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56218:x1847765451956992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.432664:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17246 00000100:00100000:0.0:1762167010.433928:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.433996:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451957120 00000100:00100000:2.0:1762167010.434003:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451957120 00000100:00100000:0.0:1762167010.434008:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:2.0:1762167010.434034:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (239570->18446744073709551615) 00002000:00100000:2.0:1762167010.434041:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb12680 with x1847765451957120 ext(239570->18446744073709551615) 00002000:00010000:2.0:1762167010.434049:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb12680. 00000100:00100000:2.0:1762167010.434074:0:6539:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451957248 00000100:00100000:2.0:1762167010.434077:0:6539:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451957248 00002000:00010000:2.0:1762167010.434093:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167010.434097:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb11880 with x1847765451957248 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.434104:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb11880. 00000100:00100000:1.0:1762167010.434104:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3100 00000100:00100000:1.0:1762167010.434119:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451957120:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167010.434138:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3101 00000100:00100000:3.0:1762167010.434150:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451957248:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167010.434432:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 241664 -> 239570 00002000:00010000:3.0:1762167010.434434:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.434436:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.434440:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.434441:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167010.434446:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.434448:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167010.434449:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:3.0:1762167010.434456:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.434459:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167010.434504:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451957248:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 357us (496us total) trans 21474843541 rc 0/0 00000100:00100000:3.0:1762167010.434516:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3101 00000100:00100000:1.0:1762167010.434516:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451957120:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 398us (589us total) trans 17179875979 rc 0/0 00002000:00010000:3.0:1762167010.434521:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:3.0:1762167010.434526:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb11880 with x1847765451957248 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167010.434528:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3100 00002000:00010000:3.0:1762167010.434535:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fb11880. 00002000:00010000:1.0:1762167010.434535:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (239570->18446744073709551615) 00002000:00100000:1.0:1762167010.434541:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fb12680 with x1847765451957120 ext(239570->18446744073709551615) 00002000:00010000:1.0:1762167010.434548:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fb12680. 00000100:00100000:2.0:1762167010.436230:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.436278:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451957376 00000100:00100000:1.0:1762167010.436286:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451957376 00000100:00100000:1.0:1762167010.436330:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19973 00000100:00100000:1.0:1762167010.436340:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56218:x1847765451957376:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.436358:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.436385:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b8c7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3e9a expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.436462:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.436475:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.436485:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167010.436510:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:1.0:1762167010.436514:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167010.436530:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.436554:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b8c7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e9a expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.436571:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e9a expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.436578:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.436580:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167010.436582:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ae00, rc 0) 00000100:00100000:1.0:1762167010.436627:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56218:x1847765451957376:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 289us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.436633:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19973 00000100:00100000:0.0:1762167010.438433:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.438489:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451957632 00000100:00100000:1.0:1762167010.438497:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451957632 00000100:00100000:1.0:1762167010.438545:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19974 00000100:00100000:1.0:1762167010.438555:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56218:x1847765451957632:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167010.438590:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.438623:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e9a expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.438640:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.438644:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167010.438857:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.438869:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.438877:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167010.438927:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953068 00000004:00010000:1.0:1762167010.438949:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c1c52f31 reply state 000000007e984968 transno 8589953069 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.438955:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167010.439019:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56218:x1847765451957632:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 467us (593us total) trans 8589953069 rc 0/0 00000100:00100000:1.0:1762167010.439026:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19974 00000020:00080000:1.0:1762167010.439031:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167010.440010:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.440023:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.440031:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.440037:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167010.440042:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.440050:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.440141:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:3.0:1762167010.440144:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167010.440149:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.440155:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b8d5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.440216:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.440284:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451957760 00000100:00100000:1.0:1762167010.440290:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451957760 00000100:00100000:1.0:1762167010.440329:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17247 00000100:00100000:1.0:1762167010.440338:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56218:x1847765451957760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.440350:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.440379:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b8dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ea1 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167010.440401:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 241664, mtime: 0x690888e2, atime: 0x690888dd, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:1.0:1762167010.440424:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.440427:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.440435:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b8dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea1 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.440464:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b8dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea1 expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.440475:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7a400, rc 0) 00000100:00100000:1.0:1762167010.440520:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56218:x1847765451957760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 184us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.440525:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17247 00000100:00100000:0.0:1762167010.441963:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.442013:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451957888 00000100:00100000:1.0:1762167010.442020:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451957888 00000100:00100000:0.0:1762167010.442040:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:1.0:1762167010.442048:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (239570->18446744073709551615) 00002000:00100000:1.0:1762167010.442053:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d68e00 with x1847765451957888 ext(239570->18446744073709551615) 00002000:00010000:1.0:1762167010.442061:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d68e00. 00000100:00100000:1.0:1762167010.442079:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451958016 00000100:00100000:1.0:1762167010.442082:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451958016 00002000:00010000:1.0:1762167010.442095:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.442098:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d68380 with x1847765451958016 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167010.442102:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3102 00002000:00010000:1.0:1762167010.442106:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d68380. 00000100:00100000:0.0:1762167010.442119:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451957888:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167010.442136:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3103 00000100:00100000:1.0:1762167010.442149:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451958016:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167010.442396:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.442400:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.442403:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167010.442406:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.442408:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167010.442414:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 241664 -> 239570 00002000:00010000:0.0:1762167010.442419:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.442421:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167010.442424:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.442427:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167010.442480:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765451958016:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 335us (441us total) trans 21474843542 rc 0/0 00000100:00100000:0.0:1762167010.442482:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451957888:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 369us (524us total) trans 17179875980 rc 0/0 00000100:00100000:1.0:1762167010.442490:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3103 00002000:00010000:1.0:1762167010.442494:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00000100:00100000:0.0:1762167010.442498:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3102 00002000:00100000:1.0:1762167010.442499:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d68380 with x1847765451958016 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167010.442505:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (239570->18446744073709551615) 00002000:00010000:1.0:1762167010.442506:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d68380. 00002000:00100000:0.0:1762167010.442512:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d68e00 with x1847765451957888 ext(239570->18446744073709551615) 00002000:00010000:0.0:1762167010.442519:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d68e00. 00000100:00100000:2.0:1762167010.443688:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.443740:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451958144 00000100:00100000:1.0:1762167010.443747:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451958144 00000100:00100000:1.0:1762167010.443801:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19975 00000100:00100000:1.0:1762167010.443809:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56218:x1847765451958144:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.443825:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.443837:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b8e3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ea8 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.443896:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b8ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.443910:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b8ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.443921:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b8ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167010.443946:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:1.0:1762167010.443951:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167010.443966:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b8ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.443996:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b8e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea8 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.444020:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b8ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea8 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.444029:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.444032:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167010.444036:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b200, rc 0) 00000100:00100000:1.0:1762167010.444092:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56218:x1847765451958144:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 283us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.444099:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19975 00000100:00100000:3.0:1762167010.445652:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.445734:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451958400 00000100:00100000:1.0:1762167010.445740:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451958400 00000100:00100000:1.0:1762167010.445796:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19976 00000100:00100000:1.0:1762167010.445807:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56218:x1847765451958400:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167010.445845:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.445864:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b8ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea8 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.445881:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.445884:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167010.446054:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.446063:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.446069:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167010.446106:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953070 00000004:00010000:1.0:1762167010.446129:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ccd21373 reply state 000000001c1a0b31 transno 8589953071 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.446138:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167010.446218:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56218:x1847765451958400:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 415us (572us total) trans 8589953071 rc 0/0 00000100:00100000:1.0:1762167010.446224:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19976 00000020:00080000:1.0:1762167010.446229:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167010.447067:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.447084:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.447090:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.447095:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167010.447099:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.447105:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.447121:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.447124:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167010.447127:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.447132:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b8f1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167010.447338:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.447492:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451958528 00000100:00100000:1.0:1762167010.447498:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451958528 00000100:00100000:1.0:1762167010.447537:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17248 00000100:00100000:1.0:1762167010.447547:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56218:x1847765451958528:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.447560:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.447580:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3eaf expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167010.447598:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 241664, mtime: 0x690888e2, atime: 0x690888dd, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:1.0:1762167010.447612:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.447614:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.447619:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eaf expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.447630:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eaf expref: 22 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.447637:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ae00, rc 0) 00000100:00100000:1.0:1762167010.447680:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56218:x1847765451958528:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 135us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.447687:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17248 00000100:00100000:0.0:1762167010.448996:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.449098:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451958784 00000100:00100000:3.0:1762167010.449105:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451958784 00002000:00010000:3.0:1762167010.449133:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:3.0:1762167010.449138:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d69500 with x1847765451958784 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167010.449147:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d69500. 00000100:00100000:0.0:1762167010.449159:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.449174:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451958656 00000100:00100000:3.0:1762167010.449179:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451958656 00002000:00010000:3.0:1762167010.449194:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (239570->18446744073709551615) 00000100:00100000:1.0:1762167010.449195:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3104 00000100:00100000:1.0:1762167010.449210:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451958784:12345-192.168.203.35@tcp:10:lfs.0 00002000:00100000:3.0:1762167010.449239:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d69180 with x1847765451958656 ext(239570->18446744073709551615) 00002000:00010000:3.0:1762167010.449246:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d69180. 00000100:00100000:3.0:1762167010.449270:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3105 00000100:00100000:3.0:1762167010.449281:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451958656:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167010.449466:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.449470:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.449472:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167010.449475:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.449478:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167010.449513:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 241664 -> 239570 00002000:00010000:3.0:1762167010.449518:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.449521:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167010.449523:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.449526:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167010.449532:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451958784:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 324us (536us total) trans 17179875981 rc 0/0 00000100:00100000:1.0:1762167010.449541:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3104 00002000:00010000:1.0:1762167010.449546:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.449549:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d69500 with x1847765451958784 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167010.449555:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d69500. 00000100:00100000:3.0:1762167010.449559:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451958656:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 278us (397us total) trans 21474843543 rc 0/0 00000100:00100000:3.0:1762167010.449571:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3105 00002000:00010000:3.0:1762167010.449575:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (239570->18446744073709551615) 00002000:00100000:3.0:1762167010.449578:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d69180 with x1847765451958656 ext(239570->18446744073709551615) 00002000:00010000:3.0:1762167010.449583:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d69180. 00000100:00100000:0.0:1762167010.450706:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.450747:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451958912 00000100:00100000:1.0:1762167010.450752:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451958912 00000100:00100000:1.0:1762167010.450814:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19977 00000100:00100000:1.0:1762167010.450822:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56218:x1847765451958912:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.450839:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.450855:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b8ff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3eb6 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.450921:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b906 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.450936:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b906 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.450943:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b906 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167010.450966:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:1.0:1762167010.450970:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167010.450985:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b906 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.451008:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b8ff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eb6 expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.451023:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b906 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eb6 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.451029:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.451031:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167010.451033:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b800, rc 0) 00000100:00100000:1.0:1762167010.451065:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56218:x1847765451958912:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 246us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.451069:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19977 00000100:00100000:2.0:1762167010.452615:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.452667:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451959168 00000100:00100000:1.0:1762167010.452674:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451959168 00000100:00100000:1.0:1762167010.452720:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19978 00000100:00100000:1.0:1762167010.452736:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56218:x1847765451959168:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167010.452799:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.452819:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b906 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eb6 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.452835:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.452839:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167010.453034:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.453046:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.453055:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167010.453105:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953072 00000004:00010000:1.0:1762167010.453131:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007a9ff1f7 reply state 00000000811a9b24 transno 8589953073 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.453140:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167010.453213:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56218:x1847765451959168:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 484us (601us total) trans 8589953073 rc 0/0 00000100:00100000:1.0:1762167010.453220:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19978 00000020:00080000:1.0:1762167010.453225:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167010.454011:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.454023:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.454028:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.454032:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167010.454035:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.454040:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.454052:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:3.0:1762167010.454054:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167010.454115:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.454122:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b90d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167010.454205:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.454248:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451959296 00000100:00100000:1.0:1762167010.454255:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451959296 00000100:00100000:1.0:1762167010.454305:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17249 00000100:00100000:1.0:1762167010.454315:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56218:x1847765451959296:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.454325:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.454337:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b914 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ebd expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167010.454354:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 241664, mtime: 0x690888e2, atime: 0x690888de, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:1.0:1762167010.454380:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.454382:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.454390:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ebd expref: 24 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.454403:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ebd expref: 24 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.454414:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b000, rc 0) 00000100:00100000:1.0:1762167010.454449:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56218:x1847765451959296:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 138us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.454454:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17249 00000100:00100000:0.0:1762167010.455602:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.455643:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.455658:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451959424 00000100:00100000:3.0:1762167010.455665:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451959424 00000100:00100000:1.0:1762167010.455678:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451959552 00000100:00100000:1.0:1762167010.455683:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451959552 00002000:00010000:3.0:1762167010.455696:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (239570->18446744073709551615) 00002000:00010000:1.0:1762167010.455698:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.455703:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5500 with x1847765451959552 ext(0->18446744073709551615) 00002000:00100000:3.0:1762167010.455704:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce6d80 with x1847765451959424 ext(239570->18446744073709551615) 00002000:00010000:1.0:1762167010.455712:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce5500. 00002000:00010000:3.0:1762167010.455713:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce6d80. 00000100:00100000:1.0:1762167010.455737:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3106 00000100:00100000:1.0:1762167010.455743:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451959552:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167010.455797:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3107 00000100:00100000:3.0:1762167010.455808:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451959424:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167010.456015:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.456019:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.456022:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167010.456025:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.456028:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167010.456038:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 241664 -> 239570 00002000:00010000:3.0:1762167010.456042:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.456043:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167010.456045:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.456046:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167010.456083:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451959552:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 337us (439us total) trans 17179875982 rc 0/0 00000100:00100000:3.0:1762167010.456084:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451959424:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 276us (484us total) trans 21474843544 rc 0/0 00000100:00100000:3.0:1762167010.456100:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3107 00002000:00010000:3.0:1762167010.456105:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (239570->18446744073709551615) 00000100:00100000:1.0:1762167010.456109:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3106 00002000:00100000:3.0:1762167010.456110:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce6d80 with x1847765451959424 ext(239570->18446744073709551615) 00002000:00010000:1.0:1762167010.456116:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00010000:3.0:1762167010.456118:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce6d80. 00002000:00100000:1.0:1762167010.456120:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce5500 with x1847765451959552 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167010.456127:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36dce5500. 00000100:00100000:0.0:1762167010.457394:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.457603:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451959680 00000100:00100000:1.0:1762167010.457610:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451959680 00000100:00100000:1.0:1762167010.457659:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19979 00000100:00100000:1.0:1762167010.457668:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56218:x1847765451959680:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.457687:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.457707:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b91b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ec4 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.457833:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b922 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.457848:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b922 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.457859:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b922 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167010.457885:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:1.0:1762167010.457890:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167010.457911:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b922 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.457935:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b600/0xf915a5bdf3d0b91b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ec4 expref: 905 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.457963:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b922 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ec4 expref: 904 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.457971:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.457974:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167010.457978:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b400, rc 0) 00000100:00100000:1.0:1762167010.458027:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56218:x1847765451959680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 360us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.458034:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19979 00000100:00100000:2.0:1762167010.459712:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.459757:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451959936 00000100:00100000:1.0:1762167010.459785:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451959936 00000100:00100000:1.0:1762167010.459842:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19980 00000100:00100000:1.0:1762167010.459852:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56218:x1847765451959936:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167010.459894:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.459913:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b400/0xf915a5bdf3d0b922 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ec4 expref: 904 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.459929:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.459933:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167010.460158:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.460171:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.460184:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167010.460236:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953074 00000004:00010000:1.0:1762167010.460259:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fa685f94 reply state 00000000a4c223a1 transno 8589953075 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.460271:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167010.460349:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56218:x1847765451959936:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 498us (642us total) trans 8589953075 rc 0/0 00000100:00100000:1.0:1762167010.460355:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19980 00000020:00080000:1.0:1762167010.460373:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167010.461095:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.461105:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.461112:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.461118:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7a800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167010.461122:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.461129:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.461141:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.461144:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167010.461147:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.461157:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7a800/0xf915a5bdf3d0b929 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167010.461243:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.461287:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451960064 00000100:00100000:1.0:1762167010.461294:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451960064 00000100:00100000:1.0:1762167010.461329:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17250 00000100:00100000:1.0:1762167010.461337:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56218:x1847765451960064:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.461346:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.461371:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b930 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ecb expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167010.461393:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 241664, mtime: 0x690888e2, atime: 0x690888de, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:1.0:1762167010.461410:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.461412:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.461419:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ecb expref: 32 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.461433:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ecb expref: 32 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.461443:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7ba00, rc 0) 00000100:00100000:1.0:1762167010.461479:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56218:x1847765451960064:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 142us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.461485:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17250 00000100:00100000:0.0:1762167010.462414:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.462486:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451960320 00000100:00100000:1.0:1762167010.462492:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451960320 00002000:00010000:1.0:1762167010.462514:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.462519:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce4380 with x1847765451960320 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167010.462529:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce4380. 00000100:00100000:1.0:1762167010.462557:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3108 00000100:00100000:1.0:1762167010.462566:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451960320:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167010.462589:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.462621:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451960192 00000100:00100000:0.0:1762167010.462626:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451960192 00002000:00010000:0.0:1762167010.462641:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (239570->18446744073709551615) 00002000:00100000:0.0:1762167010.462645:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0700 with x1847765451960192 ext(239570->18446744073709551615) 00002000:00010000:0.0:1762167010.462652:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b0700. 00000100:00100000:0.0:1762167010.462712:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3109 00000100:00100000:0.0:1762167010.462721:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451960192:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:1.0:1762167010.462815:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.462819:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.462822:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167010.462825:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.462828:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167010.462879:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451960320:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 313us (469us total) trans 21474843545 rc 0/0 00000100:00100000:1.0:1762167010.462889:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3108 00002000:00010000:1.0:1762167010.462893:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.462896:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36dce4380 with x1847765451960320 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167010.462902:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36dce4380. 00002000:00010000:0.0:1762167010.462949:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 241664 -> 239570 00002000:00010000:0.0:1762167010.462956:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.462959:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167010.462961:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.462963:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167010.462998:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451960192:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 278us (411us total) trans 17179875983 rc 0/0 00000100:00100000:0.0:1762167010.463005:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3109 00002000:00010000:0.0:1762167010.463008:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (239570->18446744073709551615) 00002000:00100000:0.0:1762167010.463011:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0700 with x1847765451960192 ext(239570->18446744073709551615) 00002000:00010000:0.0:1762167010.463015:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b0700. 00000100:00100000:3.0:1762167010.464058:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.464119:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451960448 00000100:00100000:1.0:1762167010.464126:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451960448 00000100:00100000:1.0:1762167010.464170:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19981 00000100:00100000:1.0:1762167010.464180:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56218:x1847765451960448:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.464196:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.464212:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b937 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ed2 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.464289:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b93e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.464301:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b93e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.464311:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b93e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167010.464340:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:1.0:1762167010.464345:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167010.464374:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b93e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.464398:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7bc00/0xf915a5bdf3d0b937 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed2 expref: 907 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.464416:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b93e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed2 expref: 906 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.464424:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.464427:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167010.464430:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7be00, rc 0) 00000100:00100000:1.0:1762167010.464466:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56218:x1847765451960448:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 290us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.464471:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19981 00000100:00100000:3.0:1762167010.465919:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.465957:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451960704 00000100:00100000:1.0:1762167010.465964:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451960704 00000100:00100000:1.0:1762167010.466001:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19982 00000100:00100000:1.0:1762167010.466011:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56218:x1847765451960704:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167010.466051:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.466078:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7be00/0xf915a5bdf3d0b93e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed2 expref: 906 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.466093:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.466097:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167010.466249:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.466258:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.466263:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167010.466296:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953076 00000004:00010000:1.0:1762167010.466312:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f6b949cb reply state 000000003664ca2f transno 8589953077 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.466318:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167010.466388:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56218:x1847765451960704:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 380us (472us total) trans 8589953077 rc 0/0 00000100:00100000:1.0:1762167010.466393:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19982 00000020:00080000:1.0:1762167010.466396:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167010.467064:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.467075:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.467083:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.467089:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37fb7b800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167010.467154:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.467162:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.467172:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:3.0:1762167010.467176:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167010.467180:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.467186:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37fb7b800/0xf915a5bdf3d0b945 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.467222:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.467257:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451960832 00000100:00100000:1.0:1762167010.467262:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451960832 00000100:00100000:1.0:1762167010.467297:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17251 00000100:00100000:1.0:1762167010.467304:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56218:x1847765451960832:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167010.467315:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.467330:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b94c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ed9 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167010.467350:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 241664, mtime: 0x690888e2, atime: 0x690888e0, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:1.0:1762167010.467374:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.467376:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.467382:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed9 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.467396:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed9 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.467406:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fb7b200, rc 0) 00000100:00100000:1.0:1762167010.467445:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56218:x1847765451960832:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 140us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.467451:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17251 00000100:00100000:2.0:1762167010.468349:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.468415:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451960960 00000100:00100000:0.0:1762167010.468421:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451960960 00002000:00010000:0.0:1762167010.468443:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (239570->18446744073709551615) 00002000:00100000:0.0:1762167010.468448:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354ed80 with x1847765451960960 ext(239570->18446744073709551615) 00002000:00010000:0.0:1762167010.468457:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354ed80. 00000100:00100000:0.0:1762167010.468484:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3110 00000100:00100000:3.0:1762167010.468491:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.468500:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451960960:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167010.468518:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451961088 00000100:00100000:1.0:1762167010.468524:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451961088 00002000:00010000:1.0:1762167010.468544:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.468548:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0000 with x1847765451961088 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167010.468560:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b0000. 00000100:00100000:1.0:1762167010.468599:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3111 00000100:00100000:1.0:1762167010.468609:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451961088:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167010.468807:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 241664 -> 239570 00002000:00010000:0.0:1762167010.468811:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.468814:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167010.468817:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.468820:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167010.468827:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.468832:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.468834:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167010.468837:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.468839:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.468866:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451960960:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 370us (518us total) trans 21474843546 rc 0/0 00000100:00100000:1.0:1762167010.468869:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451961088:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 261us (381us total) trans 17179875984 rc 0/0 00000100:00100000:1.0:1762167010.468883:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3111 00002000:00010000:1.0:1762167010.468886:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.468888:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0000 with x1847765451961088 ext(0->18446744073709551615) 00000100:00100000:0.0:1762167010.468893:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3110 00002000:00010000:1.0:1762167010.468895:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b0000. 00002000:00010000:0.0:1762167010.468899:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (239570->18446744073709551615) 00002000:00100000:0.0:1762167010.468904:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24354ed80 with x1847765451960960 ext(239570->18446744073709551615) 00002000:00010000:0.0:1762167010.468910:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24354ed80. 00000100:00100000:2.0:1762167010.469948:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.469993:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451961344 00000100:00100000:1.0:1762167010.470001:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451961344 00000100:00100000:1.0:1762167010.470043:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19983 00000100:00100000:1.0:1762167010.470050:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56218:x1847765451961344:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167010.470117:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.470128:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.470135:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00010000:1.0:1762167010.470213:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005d049106 reply state 000000002f2d5692 transno 8589953078 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.470219:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167010.470275:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56218:x1847765451961344:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 224us (328us total) trans 8589953078 rc 0/0 00000100:00100000:1.0:1762167010.470282:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19983 00010000:00010000:2.0:1762167010.471020:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.471029:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.471035:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.471039:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167010.471041:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.471046:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.471055:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.471057:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167010.471060:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.471066:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b953 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167010.471340:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.471385:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.471410:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451961600 00000100:00100000:1.0:1762167010.471417:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451961600 00000100:00100000:2.0:1762167010.471426:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.471464:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451961472 00000100:00100000:2.0:1762167010.471469:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451961728 00000100:00100000:1.0:1762167010.471469:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451961472 00000100:00100000:2.0:1762167010.471476:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451961728 00000100:00100000:3.0:1762167010.471493:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17252 00000100:00100000:3.0:1762167010.471507:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451961600:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167010.471514:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17253 00000100:00100000:2.0:1762167010.471525:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17254 00000100:00100000:1.0:1762167010.471529:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451961472:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:2.0:1762167010.471537:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451961728:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:1.0:1762167010.471701:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 239570 -> 239570 00002000:00010000:1.0:1762167010.471705:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.471708:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.471710:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.471713:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 325 -> 373 00002000:00010000:3.0:1762167010.471717:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.471720:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.471723:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.471726:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.471727:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167009 -> 1762167010 00002000:00010000:2.0:1762167010.471731:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167009 -> 1762167010 00002000:00010000:3.0:1762167010.471733:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.471737:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.471738:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167010.471742:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167010.471788:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451961472:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 240us (390us total) trans 21474843547 rc 0/0 00000100:00100000:1.0:1762167010.471796:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17253 00000100:00100000:3.0:1762167010.471806:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451961600:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 302us (464us total) trans 17179875985 rc 0/0 00000100:00100000:3.0:1762167010.471817:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17252 00000100:00100000:2.0:1762167010.471819:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24354f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451961728:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 279us (387us total) trans 21474843548 rc 0/0 00000100:00100000:2.0:1762167010.471830:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17254 00000100:00100000:1.0:1762167010.472997:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.473037:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451961984 00000100:00100000:2.0:1762167010.473044:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451961984 00000100:00100000:2.0:1762167010.473084:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7375 00000100:00100000:2.0:1762167010.473094:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f652450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56218:x1847765451961984:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167010.473141:0:33886:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b7ee lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e4d expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.473180:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167010.473190:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b818 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e54 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.473197:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167010.473230:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b818 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e54 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.473241:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b818 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e54 expref: 908 pid: 30817 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.473253:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454512896:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167010.473325:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1762167010.474475:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454512896:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167010.474496:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167010.474658:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.474819:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451962112 00000100:00100000:0.0:1762167010.474834:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451962112 00010000:00010000:0.0:1762167010.474886:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b818 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e54 expref: 909 pid: 30817 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1762167010.474933:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7602 00000100:00100000:0.0:1762167010.474943:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:2361:x1847765451962112:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167010.474959:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167010.474967:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b818 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e54 expref: 909 pid: 30817 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.474980:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b818 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e54 expref: 909 pid: 30817 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.475005:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b818 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e54 expref: 909 pid: 30817 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.475025:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.475031:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167010.475040:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167010.475048:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167010.475080:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.475114:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167010.475125:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:0.0:1762167010.475149:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2361:x1847765451962112:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 206us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.475158:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7602 00000040:00080000:2.0:1762167010.475854:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5565, 88 off450000 00000004:00080000:2.0:1762167010.475867:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631268103149ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.475967:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5574, 88 off451088 00000004:00080000:2.0:1762167010.475974:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631268210712ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.476016:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5575, 88 off451176 00000004:00080000:2.0:1762167010.476020:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631268257535ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.476040:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5566, 88 off450088 00000004:00080000:2.0:1762167010.476044:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631268281220ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.476137:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5576, 88 off451264 00000004:00080000:2.0:1762167010.476141:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631268378723ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.476173:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5567, 88 off450176 00000004:00080000:2.0:1762167010.476178:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631268415070ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.476204:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5568, 88 off450264 00000004:00080000:2.0:1762167010.476209:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631268446013ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.476245:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5577, 88 off451352 00000004:00080000:2.0:1762167010.476250:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631268486977ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.476281:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5578, 88 off451440 00000004:00080000:2.0:1762167010.476285:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631268522115ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.476299:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5569, 88 off450352 00000004:00080000:2.0:1762167010.476303:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631268540630ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.476334:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5579, 88 off451528 00000004:00080000:2.0:1762167010.476340:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631268576745ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.476381:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5570, 88 off450440 00000004:00080000:2.0:1762167010.476386:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631268623063ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.476418:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5571, 88 off450528 00000004:00080000:2.0:1762167010.476423:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631268660037ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.476449:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5580, 88 off451616 00000004:00080000:2.0:1762167010.476453:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631268690807ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.476528:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5573, 88 off450648 00000004:00080000:2.0:1762167010.476531:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631268768770ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.476551:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5581, 88 off451704 00000004:00080000:2.0:1762167010.476554:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631268791396ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.476568:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5582, 88 off451792 00000004:00080000:2.0:1762167010.476571:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631268808296ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167010.476582:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5574, 88 off450736 00000004:00080000:2.0:1762167010.476584:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631268821880ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.476600:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5575, 88 off450824 00000004:00080000:2.0:1762167010.476607:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631268843702ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167010.476634:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5583, 88 off451880 00000004:00080000:2.0:1762167010.476638:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631268875205ns, next at 630703976179ns, rc = 0 00000001:00080000:0.0:1762167010.488355:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953078 is committed 00000004:00010000:2.0:1762167010.488371:0:33886:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000096b43a5a reply state 0000000077a53d6d transno 8589953079 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167010.488391:0:33886:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762167010.488402:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.488406:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167010.488415:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b7ee lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e4d expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167010.488419:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953079 is committed 00000004:00080000:0.0:1762167010.488427:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3694 committed 00000004:00080000:0.0:1762167010.488440:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3681 committed 00000004:00080000:0.0:1762167010.488448:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3680 committed 00000004:00080000:0.0:1762167010.488451:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3693 committed 00000004:00080000:0.0:1762167010.488454:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3692 committed 00000004:00080000:0.0:1762167010.488457:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3679 committed 00000004:00080000:0.0:1762167010.488459:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3691 committed 00000004:00080000:0.0:1762167010.488461:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3678 committed 00000004:00080000:0.0:1762167010.488463:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3677 committed 00000004:00080000:0.0:1762167010.488465:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3690 committed 00000004:00080000:0.0:1762167010.488467:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3676 committed 00000004:00080000:0.0:1762167010.488468:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3689 committed 00000004:00080000:0.0:1762167010.488470:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3688 committed 00000004:00080000:0.0:1762167010.488471:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3675 committed 00000004:00080000:0.0:1762167010.488472:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3674 committed 00000004:00080000:0.0:1762167010.488474:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3687 committed 00000004:00080000:0.0:1762167010.488475:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3673 committed 00000004:00080000:0.0:1762167010.488477:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3686 committed 00000004:00080000:0.0:1762167010.488480:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3685 committed 00000004:00080000:0.0:1762167010.488481:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3672 committed 00000100:00100000:0.0:1762167010.488525:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454513024:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1762167010.488549:0:33886:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762167010.488565:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f652450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56218:x1847765451961984:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 15472us (15571us total) trans 8589953079 rc 0/0 00000100:00100000:2.0:1762167010.488575:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7375 00000100:00100000:0.0:1762167010.488600:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.488648:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454513536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.488682:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.488689:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454513408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.488707:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454514048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.488718:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454513152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.488729:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.488753:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.488792:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454513920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.488799:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454513280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.488806:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454513024 00000100:00100000:2.0:1762167010.488812:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454513024 00000100:00100000:0.0:1762167010.488821:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454514560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.488836:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167010.488845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.488851:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454513536 00000100:00100000:2.0:1762167010.488854:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454513536 00000100:00100000:2.0:1762167010.488878:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454513408 00000100:00100000:2.0:1762167010.488881:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454513408 00000100:00100000:0.0:1762167010.488882:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454514048 00000100:00100000:0.0:1762167010.488889:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454514048 00000100:00100000:3.0:1762167010.488895:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454513664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.488899:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454514432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.488903:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454513920 00000100:00100000:2.0:1762167010.488908:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454513920 00000100:00100000:0.0:1762167010.488916:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454513152 00000100:00100000:0.0:1762167010.488922:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454513152 00000100:00100000:3.0:1762167010.488926:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.488930:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454513664 00000100:00100000:2.0:1762167010.488934:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454513664 00000100:00100000:1.0:1762167010.488942:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167010.488945:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454514176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.488947:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17255 00000100:00100000:0.0:1762167010.488957:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3294:x1847765454513024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.488963:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454514432 00000100:00100000:2.0:1762167010.488968:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454514432 00000100:00100000:1.0:1762167010.488968:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454514944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.488976:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.488985:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454514176 00000100:00100000:2.0:1762167010.488988:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454514176 00000100:00100000:3.0:1762167010.488990:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454514688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.489004:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.489008:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17256 00000100:00100000:2.0:1762167010.489018:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765454513536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.489019:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.489043:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454514944 00000100:00100000:1.0:1762167010.489048:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454514944 00000100:00100000:3.0:1762167010.489057:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454514688 00000100:00100000:3.0:1762167010.489062:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454514688 00000100:00100000:3.0:1762167010.489082:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17257 00000100:00100000:3.0:1762167010.489089:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454513408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.489111:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17258 00000100:00100000:1.0:1762167010.489121:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454514048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167010.489153:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.489157:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167010.489159:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167010.489160:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 239570 -> 239570 00002000:00010000:0.0:1762167010.489161:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167010.489169:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.489169:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167010.489176:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167010.489179:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.489181:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167010.489206:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454513024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (608us total) trans 17179875986 rc 0/0 00000100:00100000:0.0:1762167010.489213:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17255 00000100:00100000:2.0:1762167010.489220:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454513536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (537us total) trans 17179875987 rc 0/0 00000100:00100000:2.0:1762167010.489227:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17256 00000100:00100000:0.0:1762167010.489234:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17259 00000100:00100000:0.0:1762167010.489245:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454513920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167010.489247:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167010.489249:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17260 00002000:00010000:3.0:1762167010.489253:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.489260:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.489262:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000100:00100000:2.0:1762167010.489262:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454513152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167010.489265:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167010.489275:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 239570 -> 239570 00002000:00010000:1.0:1762167010.489280:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.489284:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167010.489286:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.489289:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167010.489302:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454513408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (574us total) trans 21474843549 rc 0/0 00000100:00100000:1.0:1762167010.489330:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454514048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (578us total) trans 17179875988 rc 0/0 00000100:00100000:3.0:1762167010.489391:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17257 00002000:00010000:0.0:1762167010.489395:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 239570 -> 239570 00000100:00100000:1.0:1762167010.489400:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17258 00002000:00010000:0.0:1762167010.489402:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.489406:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167010.489409:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000100:00100000:3.0:1762167010.489412:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17261 00002000:00010000:0.0:1762167010.489414:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167010.489417:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 239570 -> 239570 00000100:00100000:3.0:1762167010.489422:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454513664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167010.489422:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.489425:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00000100:00100000:1.0:1762167010.489427:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17262 00002000:00010000:2.0:1762167010.489429:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.489433:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 373 -> 373 00000100:00100000:1.0:1762167010.489440:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454514432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.489448:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454513920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (613us total) trans 21474843550 rc 0/0 00000100:00100000:0.0:1762167010.489457:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17259 00000100:00100000:2.0:1762167010.489476:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454513152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (629us total) trans 21474843551 rc 0/0 00000100:00100000:0.0:1762167010.489482:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17263 00000100:00100000:2.0:1762167010.489491:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17260 00000100:00100000:0.0:1762167010.489496:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454514176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167010.489529:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.489532:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.489535:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167010.489537:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.489540:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167010.489568:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454513664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (643us total) trans 21474843552 rc 0/0 00000100:00100000:3.0:1762167010.489574:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17261 00000100:00100000:3.0:1762167010.489589:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17264 00002000:00010000:1.0:1762167010.489589:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 239570 -> 239570 00002000:00010000:1.0:1762167010.489595:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:3.0:1762167010.489599:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454514688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167010.489600:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167010.489606:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.489610:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167010.489618:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17265 00000100:00100000:2.0:1762167010.489628:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454514944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167010.489631:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.489636:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.489639:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167010.489641:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.489643:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167010.489650:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454514432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (708us total) trans 17179875989 rc 0/0 00000100:00100000:1.0:1762167010.489659:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17262 00000100:00100000:0.0:1762167010.489683:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454514176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (706us total) trans 21474843553 rc 0/0 00000100:00100000:1.0:1762167010.489695:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.489697:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17263 00002000:00010000:3.0:1762167010.489708:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.489708:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 239570 -> 239570 00002000:00010000:2.0:1762167010.489712:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.489713:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.489716:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167010.489716:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167010.489719:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454513280 00002000:00010000:3.0:1762167010.489720:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.489720:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000100:00100000:1.0:1762167010.489722:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454513792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.489725:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454513280 00002000:00010000:3.0:1762167010.489726:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167010.489726:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167010.489784:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17266 00000100:00100000:3.0:1762167010.489794:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454514688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (773us total) trans 17179875990 rc 0/0 00000100:00100000:2.0:1762167010.489794:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454514944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (789us total) trans 21474843554 rc 0/0 00000100:00100000:0.0:1762167010.489796:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454513280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.489806:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17264 00000100:00100000:2.0:1762167010.489810:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17265 00000100:00100000:1.0:1762167010.489816:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.489836:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454513792 00000100:00100000:2.0:1762167010.489841:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454513792 00000100:00100000:3.0:1762167010.489844:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843534 gen 2 00000004:00080000:3.0:1762167010.489849:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f286300, transno 21474843525 00000004:00080000:3.0:1762167010.489858:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f286d80, transno 21474843526 00000004:00080000:3.0:1762167010.489861:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f285f80, transno 21474843527 00000004:00080000:3.0:1762167010.489863:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f286a00, transno 21474843528 00000100:00100000:2.0:1762167010.489864:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17267 00000004:00080000:3.0:1762167010.489866:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284e00, transno 21474843529 00000004:00080000:3.0:1762167010.489870:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284700, transno 21474843530 00000100:00100000:2.0:1762167010.489871:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454513792:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167010.489873:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f286680, transno 21474843531 00000004:00080000:3.0:1762167010.489876:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284a80, transno 21474843532 00000004:00080000:3.0:1762167010.489880:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f285180, transno 21474843533 00000004:00080000:3.0:1762167010.489883:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284380, transno 21474843534 00000100:00100000:3.0:1762167010.489891:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36e3b1180 x1847765454514944/t21474843554(21474843554) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167026 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762167010.489900:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b1180/2, rc 0, transno 21474843554 00000100:00100000:1.0:1762167010.489904:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454514304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.489909:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454514944:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167010.489927:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b3480/2, rc 0, transno 21474843549 00002000:00010000:0.0:1762167010.489929:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167010.489933:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454513408:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167010.489935:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.489942:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00000100:00100000:1.0:1762167010.489943:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167010.489947:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000004:00080000:3.0:1762167010.489951:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b3800/2, rc 0, transno 21474843550 00002000:00010000:0.0:1762167010.489952:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167010.489960:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454513920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.489972:0:3293:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875972 gen 2 00000100:00100000:1.0:1762167010.489972:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454514816:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167010.489978:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee245189c00, transno 17179875941 00002000:00010000:2.0:1762167010.489979:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.489982:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.489984:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167010.489987:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000004:00080000:3.0:1762167010.489989:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee245188700, transno 17179875942 00002000:00010000:2.0:1762167010.489989:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:3.0:1762167010.489992:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee245189f80, transno 17179875943 00000100:00100000:0.0:1762167010.489995:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454513280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (300us total) trans 17179875991 rc 0/0 00000004:00080000:3.0:1762167010.489996:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24518a680, transno 17179875944 00000004:00080000:3.0:1762167010.490001:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24518b100, transno 17179875945 00000004:00080000:3.0:1762167010.490006:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee245188a80, transno 17179875946 00000100:00100000:0.0:1762167010.490009:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17266 00000004:00080000:3.0:1762167010.490011:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24518a300, transno 17179875947 00000100:00100000:2.0:1762167010.490020:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454513792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (231us total) trans 17179875992 rc 0/0 00000100:00100000:0.0:1762167010.490026:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454514304 00000100:00100000:2.0:1762167010.490029:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17267 00000100:00100000:0.0:1762167010.490032:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454514304 00000100:00100000:2.0:1762167010.490067:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17268 00000100:00100000:2.0:1762167010.490076:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454514304:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167010.490100:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee245189500, transno 17179875948 00000004:00080000:3.0:1762167010.490103:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28700, transno 17179875949 00000004:00080000:3.0:1762167010.490106:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28e00, transno 17179875950 00000004:00080000:3.0:1762167010.490108:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc2b100, transno 17179875951 00000004:00080000:3.0:1762167010.490111:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d6b480, transno 17179875952 00000004:00080000:3.0:1762167010.490113:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d6ad80, transno 17179875953 00000004:00080000:3.0:1762167010.490116:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d6aa00, transno 17179875954 00000004:00080000:3.0:1762167010.490119:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28380, transno 17179875955 00000004:00080000:3.0:1762167010.490121:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d69880, transno 17179875956 00000004:00080000:3.0:1762167010.490123:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d6a680, transno 17179875957 00000004:00080000:3.0:1762167010.490126:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce7800, transno 17179875958 00000004:00080000:3.0:1762167010.490129:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d6b800, transno 17179875959 00000004:00080000:3.0:1762167010.490131:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dce7480, transno 17179875960 00000004:00080000:3.0:1762167010.490134:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f333100, transno 17179875963 00000004:00080000:3.0:1762167010.490136:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f331180, transno 17179875964 00000004:00080000:3.0:1762167010.490138:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f332300, transno 17179875965 00000004:00080000:3.0:1762167010.490141:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f332a00, transno 17179875966 00000004:00080000:3.0:1762167010.490144:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f330e00, transno 17179875967 00000004:00080000:3.0:1762167010.490146:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f332680, transno 17179875968 00000004:00080000:3.0:1762167010.490148:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f330a80, transno 17179875969 00000004:00080000:3.0:1762167010.490150:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f331c00, transno 17179875970 00002000:00010000:2.0:1762167010.490152:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:3.0:1762167010.490153:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247858700, transno 17179875971 00002000:00010000:2.0:1762167010.490154:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000004:00080000:3.0:1762167010.490156:0:3293:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247858e00, transno 17179875972 00002000:00010000:2.0:1762167010.490156:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167010.490158:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000100:00100000:3.0:1762167010.490161:0:3293:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee347b02a00 x1847765454514432/t17179875989(17179875989) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167026 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00002000:00010000:2.0:1762167010.490161:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167010.490191:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454514304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (251us total) trans 21474843555 rc 0/0 00000100:00100000:1.0:1762167010.490199:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.490201:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17268 00000100:00100000:2.0:1762167010.490219:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454514816 00000100:00100000:2.0:1762167010.490223:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454514816 00000004:00080000:3.0:1762167010.490231:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b02a00/2, rc 0, transno 17179875989 00000100:00100000:3.0:1762167010.490237:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454514432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.490243:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17269 00000004:00080000:1.0:1762167010.490245:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b02680/2, rc 0, transno 17179875991 00000100:00100000:2.0:1762167010.490252:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454514816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.490254:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454513280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167010.490269:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b01180/2, rc 0, transno 17179875992 00000100:00100000:1.0:1762167010.490274:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454513792:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167010.490289:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b3100/2, rc 0, transno 21474843555 00000100:00100000:1.0:1762167010.490295:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454514304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.490322:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167010.490339:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.490343:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.490346:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167010.490348:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.490351:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:1.0:1762167010.490377:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b03800/2, rc 0, transno 17179875987 00000100:00100000:0.0:1762167010.490378:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454514560 00000100:00100000:1.0:1762167010.490386:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454513536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.490386:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454514560 00000100:00100000:2.0:1762167010.490401:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454514816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (202us total) trans 17179875993 rc 0/0 00000004:00080000:1.0:1762167010.490407:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b00700/2, rc 0, transno 17179875988 00000100:00100000:2.0:1762167010.490409:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17269 00000100:00100000:1.0:1762167010.490416:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454514048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.490425:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17270 00000004:00080000:1.0:1762167010.490433:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b02d80/2, rc 0, transno 17179875986 00000100:00100000:0.0:1762167010.490437:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454514560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.490442:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454513024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167010.490470:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b1500/2, rc 0, transno 21474843551 00000100:00100000:2.0:1762167010.490477:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454513152:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167010.490489:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b1c00/2, rc 0, transno 21474843552 00000100:00100000:2.0:1762167010.490494:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454513664:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167010.490504:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b0a80/2, rc 0, transno 21474843553 00000100:00100000:2.0:1762167010.490507:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454514176:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167010.490517:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b00e00/2, rc 0, transno 17179875990 00000100:00100000:2.0:1762167010.490521:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454514688:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167010.490543:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b00380/2, rc 0, transno 17179875993 00000100:00100000:2.0:1762167010.490548:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454514816:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167010.490560:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 239570 -> 239570 00002000:00010000:0.0:1762167010.490565:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.490567:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167010.490569:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.490571:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167010.490623:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454514560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (301us total) trans 21474843556 rc 0/0 00000100:00100000:0.0:1762167010.490635:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17270 00000100:00100000:1.0:1762167010.490658:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000004:00080000:2.0:1762167010.490664:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b2680/2, rc 0, transno 21474843556 00000004:00080000:3.0:1762167010.490665:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 8 in progress, 0 in flight, 30 done 00000100:00100000:2.0:1762167010.490676:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454514560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.490695:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451962240 00000100:00100000:0.0:1762167010.490700:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451962240 00000100:00100000:2.0:1762167010.490713:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454515072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.490736:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19984 00000100:00100000:0.0:1762167010.490746:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56218:x1847765451962240:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.490786:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762167010.490797:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167010.490805:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b961 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ee0 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.490843:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454515072 00000100:00100000:2.0:1762167010.490848:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454515072 00010000:00010000:0.0:1762167010.490854:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167010.490868:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b961 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee0 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.490876:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17271 00000100:00100000:2.0:1762167010.490886:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454515072:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762167010.490887:0:30819:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167010.490911:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b961 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee0 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.490924:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.490928:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167010.490932:0:30819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b961 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee0 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.490940:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454515200:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762167010.490941:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c600, rc 0) 00000004:00080000:3.0:1762167010.490965:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 0 in flight, 10 done 00000100:00100000:1.0:1762167010.490982:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.490989:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56218:x1847765451962240:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 244us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.490998:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19984 00000100:00100000:1.0:1762167010.491010:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762167010.491020:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454515328:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167010.491044:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 239570 -> 239570 00002000:00010000:2.0:1762167010.491052:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:1.0:1762167010.491052:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167010.491058:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167010.491061:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.491063:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167010.491082:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454515200 00000100:00100000:1.0:1762167010.491087:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454515328 00000100:00100000:3.0:1762167010.491088:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454515200 00000100:00100000:1.0:1762167010.491093:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454515328 00000100:00100000:2.0:1762167010.491101:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454515072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 216us (337us total) trans 17179875994 rc 0/0 00000100:00100000:0.0:1762167010.491104:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454515456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.491115:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17271 00000100:00100000:3.0:1762167010.491124:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17272 00000100:00100000:3.0:1762167010.491136:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454515200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.491142:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17273 00000100:00100000:0.0:1762167010.491150:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.491155:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454515328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.491229:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454515456 00000100:00100000:2.0:1762167010.491234:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454515456 00002000:00010000:3.0:1762167010.491250:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.491254:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.491257:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167010.491260:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.491263:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167010.491272:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17274 00000100:00100000:2.0:1762167010.491283:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454515456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167010.491286:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.491291:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.491294:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167010.491296:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.491298:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167010.491345:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454515328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (296us total) trans 21474843557 rc 0/0 00000100:00100000:3.0:1762167010.491353:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454515200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (370us total) trans 17179875995 rc 0/0 00000100:00100000:1.0:1762167010.491354:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17273 00000100:00100000:3.0:1762167010.491378:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17272 00000004:00080000:0.0:1762167010.491380:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d6b480/2, rc 0, transno 21474843557 00000100:00100000:0.0:1762167010.491389:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454515328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167010.491409:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b1880/2, rc 0, transno 17179875995 00002000:00010000:2.0:1762167010.491414:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 239570 -> 239570 00000100:00100000:0.0:1762167010.491415:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454515200:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1762167010.491419:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 33886 initiator: MDT0 00002000:00010000:2.0:1762167010.491421:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.491427:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167010.491434:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00010000:00010000:3.0:1762167010.491437:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 33886 initiator: MDT0 00002000:00010000:2.0:1762167010.491438:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00010000:00010000:3.0:1762167010.491449:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167010.491456:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167010.491460:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167010.491467:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167010.491482:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:3.0:1762167010.491486:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762167010.491490:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454515456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (339us total) trans 21474843558 rc 0/0 00010000:00010000:3.0:1762167010.491494:0:3279:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b961 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee0 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762167010.491499:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d6ad80/2, rc 0, transno 21474843558 00000100:00100000:2.0:1762167010.491505:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17274 00000100:00100000:0.0:1762167010.491509:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454515456:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167010.491515:0:3279:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b961 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee0 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.491525:0:3279:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b961 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee0 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.491550:0:3279:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b961 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee0 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.491566:0:3279:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1847765454515584:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167010.491620:0:3279:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000004:00080000:3.0:1762167010.491646:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e3b3b80/2, rc 0, transno 17179875994 00000100:00100000:3.0:1762167010.491651:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454515072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.492980:0:3279:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1847765454515584:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167010.493005:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 33886 initiator: MDT0 00010000:00010000:3.0:1762167010.493017:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0b95a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167010.493055:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.493108:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451962368 00000100:00100000:0.0:1762167010.493115:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451962368 00000100:00100000:0.0:1762167010.493167:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7376 00000100:00100000:0.0:1762167010.493177:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56218:x1847765451962368:12345-192.168.203.35@tcp:49:lfs.0 00000100:00100000:0.0:1762167010.493285:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56218:x1847765451962368:12345-192.168.203.35@tcp:49:lfs.0 Request processed in 110us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.493293:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7376 00000100:00100000:1.0:1762167010.495034:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.495088:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451962624 00000100:00100000:0.0:1762167010.495096:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451962624 00000100:00100000:0.0:1762167010.495137:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7377 00000100:00100000:0.0:1762167010.495145:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56218:x1847765451962624:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167010.495378:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56218:x1847765451962624:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 227us (344us total) trans 8589953080 rc 0/0 00000100:00100000:0.0:1762167010.495386:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7377 00000100:00100000:1.0:1762167010.505922:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.505999:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451962752 00000100:00100000:0.0:1762167010.506011:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451962752 00000100:00100000:0.0:1762167010.506080:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19985 00000100:00100000:0.0:1762167010.506092:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56219:x1847765451962752:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.506115:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.506140:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b968 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ee7 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.506209:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b96f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506223:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b96f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506234:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b96f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506248:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b976 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506255:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b976 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506261:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b976 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506381:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506389:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506396:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.506430:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:0.0:1762167010.506435:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167010.506453:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506463:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506471:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b96f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506477:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b96f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506483:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b96f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506489:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167010.506492:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b96f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506499:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b96f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506509:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167010.506512:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167010.506516:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b96f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506522:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0b96f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506535:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b976 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506541:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b976 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506546:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b976 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506550:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167010.506552:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b976 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506557:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b976 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506563:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2477eff00) 00010000:00010000:0.0:1762167010.506566:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167010.506568:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b976 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506595:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0b976 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.506634:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0b968 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee7 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.506648:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee7 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.506656:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.506658:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167010.506661:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30cc00, rc 0) 00000100:00100000:0.0:1762167010.506735:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56219:x1847765451962752:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 646us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.506744:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19985 00000100:00100000:2.0:1762167010.510697:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.510790:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451963008 00000100:00100000:0.0:1762167010.510801:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451963008 00000100:00100000:0.0:1762167010.510859:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19986 00000100:00100000:0.0:1762167010.510870:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56219:x1847765451963008:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.510892:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.510908:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b984 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3eee expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.511003:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b98b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.511016:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b98b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.511026:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b98b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.511035:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00010000:00010000:0.0:1762167010.511153:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b984 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eee expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.511171:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b98b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eee expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.511180:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.511183:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762167010.511186:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d200, rc 0) 00000100:00100000:0.0:1762167010.511245:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56219:x1847765451963008:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 377us (558us total) trans 8589953081 rc 0/0 00000100:00100000:0.0:1762167010.511253:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19986 00000100:00100000:1.0:1762167010.513023:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.514025:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451963264 00000100:00100000:0.0:1762167010.514036:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451963264 00000100:00100000:0.0:1762167010.514099:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19987 00000100:00100000:0.0:1762167010.514109:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56219:x1847765451963264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.514130:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.514147:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b999 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ef5 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.514231:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b9a0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.514245:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b9a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.514254:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b9a0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.514265:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00010000:00010000:0.0:1762167010.514393:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b999 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ef5 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.514410:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b9a0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ef5 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.514415:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.514418:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167010.514420:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c000, rc 0) 00000100:00100000:0.0:1762167010.514470:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56219:x1847765451963264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 363us (1454us total) trans 8589953082 rc 0/0 00000100:00100000:0.0:1762167010.514477:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19987 00000100:00100000:1.0:1762167010.540509:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.540591:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451963392 00000100:00100000:0.0:1762167010.540603:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451963392 00000100:00100000:0.0:1762167010.540677:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3112 00000100:00100000:0.0:1762167010.540690:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451963392:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167010.540725:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b9ae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.540740:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.540742:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.540748:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b9ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.540787:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b9ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.542888:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b9ae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.542907:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b9ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.542915:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b9ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.542922:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167010.542927:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b9ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.542939:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b9ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.542956:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b9ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.542963:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0b9ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.543039:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451963392:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2350us (2537us total) trans 0 rc 239570/239570 00000100:00100000:0.0:1762167010.543050:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3112 00000100:00100000:1.0:1762167010.545385:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.545456:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451963520 00000100:00100000:0.0:1762167010.545477:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451963520 00000100:00100000:0.0:1762167010.545547:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3113 00000100:00100000:0.0:1762167010.545558:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451963520:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167010.545591:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.545608:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0b888 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e77 expref: 35 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.545616:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167010.545618:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167010.545622:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.545665:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0b888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e77 expref: 35 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.545679:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0b888 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e77 expref: 35 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1762167010.545693:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242cea680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454515712:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167010.545807:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a300 going to sleep for 11 seconds 00000100:00100000:0.0:1762167010.546891:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242cea680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454515712:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167010.546915:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.547013:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.547052:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451963648 00000100:00100000:0.0:1762167010.547057:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451963648 00010000:00010000:0.0:1762167010.547082:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0b888 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e77 expref: 36 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1762167010.547115:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7603 00000100:00100000:0.0:1762167010.547122:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765451963648:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167010.547132:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167010.547148:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0b888 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e77 expref: 36 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.547157:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0b888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e77 expref: 36 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.547173:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7aa00/0xf915a5bdf3d0b888 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e77 expref: 36 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.547183:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.547185:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.547187:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.547194:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.547214:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167010.547245:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451963648:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 123us (232us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167010.547247:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.547254:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7603 00010000:00010000:3.0:1762167010.547264:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.548675:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.548690:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.548698:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.548704:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.548708:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.548716:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.548729:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.548736:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0b9b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.548834:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451963520:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3275us (3453us total) trans 0 rc 239570/239570 00000100:00100000:3.0:1762167010.548845:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3113 00000100:00100000:1.0:1762167010.551208:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.551277:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451963776 00000100:00100000:3.0:1762167010.551295:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451963776 00000100:00100000:3.0:1762167010.551399:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3114 00000100:00100000:3.0:1762167010.551411:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451963776:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167010.551455:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.551477:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b8a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e85 expref: 30 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.551486:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.551488:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.551492:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.551539:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e85 expref: 30 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.551554:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b8a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e85 expref: 30 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167010.551571:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454515840:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167010.551672:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167010.553060:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454515840:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167010.553089:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.553276:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.553394:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451963904 00000100:00100000:0.0:1762167010.553411:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451963904 00010000:00010000:0.0:1762167010.553462:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b8a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e85 expref: 31 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1762167010.553515:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7604 00000100:00100000:0.0:1762167010.553526:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451963904:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167010.553543:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167010.553567:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b8a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e85 expref: 31 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.553585:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e85 expref: 31 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.553608:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7a600/0xf915a5bdf3d0b8a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e85 expref: 31 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.553624:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.553626:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.553630:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.553638:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.553676:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167010.553709:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.553722:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.553741:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451963904:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 215us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.553754:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7604 00010000:00010000:3.0:1762167010.555499:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.555514:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.555523:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.555539:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.555544:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.555553:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.555567:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.555575:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.555649:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451963776:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4237us (4446us total) trans 0 rc 239570/239570 00000100:00100000:3.0:1762167010.555664:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3114 00000100:00100000:0.0:1762167010.557950:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.558019:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451964032 00000100:00100000:3.0:1762167010.558032:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451964032 00000100:00100000:3.0:1762167010.558110:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3115 00000100:00100000:3.0:1762167010.558121:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765451964032:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167010.558158:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.558174:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e93 expref: 34 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.558186:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.558188:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.558191:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.558224:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e93 expref: 34 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.558237:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e93 expref: 34 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167010.558252:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454515968:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167010.558330:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167010.559697:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454515968:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167010.559722:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.559795:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.559943:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451964160 00000100:00100000:2.0:1762167010.559963:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451964160 00010000:00010000:2.0:1762167010.560017:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e93 expref: 35 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.560069:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7605 00000100:00100000:2.0:1762167010.560082:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451964160:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.560104:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.560136:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e93 expref: 35 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.560158:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e93 expref: 35 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.560191:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a000/0xf915a5bdf3d0b8c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e93 expref: 35 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.560212:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.560215:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.560220:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.560233:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.560270:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167010.560339:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.560352:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451964160:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 267us (552us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167010.560370:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.560385:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7605 00010000:00010000:3.0:1762167010.562305:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.562330:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.562339:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.562347:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.562353:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.562381:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.562401:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.562406:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.562496:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2358:x1847765451964032:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4374us (4551us total) trans 0 rc 239570/239570 00000100:00100000:3.0:1762167010.562507:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3115 00000100:00100000:1.0:1762167010.565122:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.565203:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451964288 00000100:00100000:3.0:1762167010.565216:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451964288 00000100:00100000:3.0:1762167010.565288:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3116 00000100:00100000:3.0:1762167010.565299:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765451964288:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167010.565332:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.565352:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b8dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea1 expref: 33 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.565384:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.565386:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.565390:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.565430:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b8dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea1 expref: 33 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.565443:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b8dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea1 expref: 33 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167010.565458:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454516096:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167010.565534:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167010.567053:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454516096:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167010.567079:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.567106:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.567161:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451964416 00000100:00100000:2.0:1762167010.567167:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451964416 00010000:00010000:2.0:1762167010.567197:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b8dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea1 expref: 34 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.567236:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7606 00000100:00100000:2.0:1762167010.567246:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451964416:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.567266:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.567296:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b8dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea1 expref: 34 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.567313:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b8dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea1 expref: 34 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.567338:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a400/0xf915a5bdf3d0b8dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ea1 expref: 34 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.567355:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.567368:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.567372:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.567381:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.567411:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167010.567462:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451964416:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 218us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.567471:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7606 00010000:00010000:3.0:1762167010.567474:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.567485:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.569176:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.569194:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.569204:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.569211:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.569217:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.569225:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.569240:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.569248:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0b9ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.569331:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451964288:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4032us (4218us total) trans 0 rc 239570/239570 00000100:00100000:3.0:1762167010.569339:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3116 00000100:00100000:1.0:1762167010.571934:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.571989:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451964544 00000100:00100000:3.0:1762167010.572000:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451964544 00000100:00100000:3.0:1762167010.572071:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3117 00000100:00100000:3.0:1762167010.572082:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451964544:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167010.572118:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.572135:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eaf expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.572143:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.572145:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.572148:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.572181:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eaf expref: 29 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.572194:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eaf expref: 29 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167010.572210:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454516224:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167010.572292:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167010.573387:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454516224:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167010.573410:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.573548:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.573621:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451964672 00000100:00100000:2.0:1762167010.573628:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451964672 00010000:00010000:2.0:1762167010.573658:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eaf expref: 30 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.573699:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7607 00000100:00100000:2.0:1762167010.573708:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451964672:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.573719:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.573739:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eaf expref: 30 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.573752:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eaf expref: 30 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.573805:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7ae00/0xf915a5bdf3d0b8f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eaf expref: 30 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.573821:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.573823:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.573827:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.573838:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.573868:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167010.573877:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.573892:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.573907:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451964672:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 199us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.573916:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7607 00010000:00010000:3.0:1762167010.575615:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.575627:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.575633:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.575637:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.575640:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.575645:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.575656:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.575660:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.575724:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451964544:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3642us (3796us total) trans 0 rc 239570/239570 00000100:00100000:3.0:1762167010.575746:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3117 00000100:00100000:0.0:1762167010.578432:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.578499:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451964800 00000100:00100000:3.0:1762167010.578509:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451964800 00000100:00100000:3.0:1762167010.578579:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3118 00000100:00100000:3.0:1762167010.578588:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451964800:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167010.578627:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.578646:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ebd expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.578655:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.578660:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.578665:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.578702:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ebd expref: 28 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.578715:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b914 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ebd expref: 28 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167010.578730:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454516352:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167010.578847:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167010.580007:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454516352:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167010.580030:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.580032:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.580095:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451964928 00000100:00100000:2.0:1762167010.580102:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451964928 00010000:00010000:2.0:1762167010.580131:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b914 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ebd expref: 29 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.580167:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7608 00000100:00100000:2.0:1762167010.580176:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451964928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.580192:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.580216:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b914 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ebd expref: 29 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.580227:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ebd expref: 29 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.580247:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b000/0xf915a5bdf3d0b914 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ebd expref: 29 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.580261:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.580262:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.580266:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.580280:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.580304:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167010.580321:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.580328:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.580347:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451964928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 171us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.580354:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7608 00010000:00010000:3.0:1762167010.582820:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.582847:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.582857:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.582865:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.582870:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.582880:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.582899:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.582907:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0b9d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.583025:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451964800:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4433us (4598us total) trans 0 rc 239570/239570 00000100:00100000:3.0:1762167010.583037:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3118 00000100:00100000:1.0:1762167010.586050:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.586103:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451965056 00000100:00100000:3.0:1762167010.586113:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451965056 00000100:00100000:3.0:1762167010.586177:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3119 00000100:00100000:3.0:1762167010.586187:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451965056:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:3.0:1762167010.586219:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.586236:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ecb expref: 32 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.586241:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.586243:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167010.586245:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 4/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.586274:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ecb expref: 32 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.586285:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ecb expref: 32 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167010.586295:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454516480:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167010.586369:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167010.587563:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454516480:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167010.587589:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.587669:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.587714:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451965184 00000100:00100000:1.0:1762167010.587722:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451965184 00010000:00010000:1.0:1762167010.587753:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ecb expref: 33 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1762167010.587814:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7609 00000100:00100000:1.0:1762167010.587826:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451965184:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167010.587853:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.587877:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ecb expref: 33 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1762167010.587889:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ecb expref: 33 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1762167010.587910:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ba00/0xf915a5bdf3d0b930 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ecb expref: 33 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1762167010.587928:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.587929:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.587933:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.587941:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.587981:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167010.588028:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.588028:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451965184:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 204us (358us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167010.588045:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.588045:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7609 00010000:00010000:3.0:1762167010.589658:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.589674:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.589682:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.589689:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.589694:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.589701:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.589712:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.589720:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923600/0xf915a5bdf3d0b9df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.589859:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451965056:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3669us (3816us total) trans 0 rc 239570/239570 00000100:00100000:2.0:1762167010.589871:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3119 00000100:00100000:0.0:1762167010.592419:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.592531:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451965312 00000100:00100000:2.0:1762167010.592541:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451965312 00000100:00100000:2.0:1762167010.592613:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3120 00000100:00100000:2.0:1762167010.592623:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451965312:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167010.592659:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.592677:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b94c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed9 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.592686:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167010.592689:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167010.592692:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.592725:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed9 expref: 27 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.592739:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b94c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed9 expref: 27 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.592754:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454516608:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167010.592888:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167010.594004:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454516608:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167010.594034:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.594413:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.594460:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451965440 00000100:00100000:1.0:1762167010.594468:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451965440 00010000:00010000:1.0:1762167010.594499:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b94c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed9 expref: 28 pid: 33894 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1762167010.594637:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7610 00000100:00100000:0.0:1762167010.594648:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451965440:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167010.594666:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167010.594689:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b94c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed9 expref: 28 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.594702:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed9 expref: 28 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.594724:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37fb7b200/0xf915a5bdf3d0b94c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ed9 expref: 28 pid: 33894 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.594738:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.594740:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.594744:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.594753:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.594807:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.594891:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.594900:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.594915:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451965440:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 267us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.594924:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7610 00010000:00010000:2.0:1762167010.596830:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.596845:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.596854:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.596861:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.596866:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.596875:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.596891:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.596899:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0b9e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->241663] (req 0->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.596971:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451965312:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4347us (4558us total) trans 0 rc 239570/239570 00000100:00100000:2.0:1762167010.596983:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3120 00000100:00100000:0.0:1762167010.604626:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.604714:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451965568 00000100:00100000:2.0:1762167010.604725:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451965568 00000100:00100000:2.0:1762167010.604804:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 659 00000100:00100000:2.0:1762167010.604815:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56219:x1847765451965568:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762167010.604832:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.604856:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0b9a0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ef5 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.604876:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.604880:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167010.604940:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56219:x1847765451965568:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 127us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.604948:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 659 00000100:00100000:1.0:1762167010.606136:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.606203:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451965824 00000100:00100000:0.0:1762167010.606213:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451965824 00000100:00100000:0.0:1762167010.606265:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7378 00000100:00100000:0.0:1762167010.606276:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56219:x1847765451965824:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167010.606587:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56219:x1847765451965824:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 312us (461us total) trans 8589953083 rc 0/0 00000100:00100000:0.0:1762167010.606601:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7378 00000100:00100000:0.0:1762167010.608859:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.608943:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451966080 00000100:00100000:1.0:1762167010.608953:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451966080 00000100:00100000:1.0:1762167010.609016:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19988 00000100:00100000:1.0:1762167010.609027:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451966080:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167010.609051:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.609071:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b9ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3efc expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.609169:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.609184:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee7 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.609194:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.609226:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee7 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.609238:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee7 expref: 897 pid: 30819 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1762167010.609251:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454516736:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167010.609330:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167010.610606:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454516736:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167010.610634:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.610731:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.610824:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451966208 00000100:00100000:2.0:1762167010.610831:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451966208 00010000:00010000:2.0:1762167010.610857:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee7 expref: 898 pid: 30819 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.611125:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7611 00000100:00100000:2.0:1762167010.611135:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765451966208:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.611148:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.611154:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee7 expref: 898 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.611166:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee7 expref: 898 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.611186:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0b97d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee7 expref: 898 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.611202:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.611206:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.611214:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.611222:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.611251:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.611287:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.611297:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167010.611304:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2360:x1847765451966208:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 169us (571us total) trans 0 rc 0/0 00000004:00200000:0.0:1762167010.611317:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000100:00100000:2.0:1762167010.611328:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7611 00010000:00010000:0.0:1762167010.611472:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0b9ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3efc expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.611490:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3efc expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.611497:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.611500:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167010.611503:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29000, rc 0) 00000100:00100000:0.0:1762167010.611545:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451966080:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2520us (2694us total) trans 8589953084 rc 0/0 00000100:00100000:0.0:1762167010.611552:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19988 00000100:00100000:0.0:1762167010.613437:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.613546:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451966336 00000100:00100000:1.0:1762167010.613555:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451966336 00000100:00100000:1.0:1762167010.613609:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19989 00000100:00100000:1.0:1762167010.613619:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451966336:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167010.613645:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.613672:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0ba02 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f03 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.613742:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.613755:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3efc expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.613801:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.613845:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3efc expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.613860:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3efc expref: 898 pid: 30819 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1762167010.613874:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454516864:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167010.613950:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e180 going to sleep for 11 seconds 00000100:00100000:0.0:1762167010.615353:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454516864:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167010.615387:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.616473:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.616551:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451966464 00000100:00100000:2.0:1762167010.616560:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451966464 00010000:00010000:2.0:1762167010.616607:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3efc expref: 899 pid: 30819 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.616647:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7612 00000100:00100000:2.0:1762167010.616656:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765451966464:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.616672:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.616679:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3efc expref: 899 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.616691:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3efc expref: 899 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.616717:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0b9f4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3efc expref: 899 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.616735:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.616740:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.616749:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.616756:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.616811:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167010.616870:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765451966464:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 214us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.616881:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7612 00010000:00010000:0.0:1762167010.616952:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.616960:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.617003:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:0.0:1762167010.617008:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167010.617027:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.617056:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0ba02 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f03 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.617073:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f03 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.617080:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.617083:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167010.617086:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29c00, rc 0) 00000100:00100000:0.0:1762167010.617284:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451966336:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 3666us (3853us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.617292:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19989 00000100:00100000:0.0:1762167010.619091:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.619150:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451966592 00000100:00100000:3.0:1762167010.619158:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451966592 00000100:00100000:3.0:1762167010.619205:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17275 00000100:00100000:3.0:1762167010.619216:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451966592:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167010.619233:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167010.619267:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ba10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f0a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167010.619292:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 239570, mtime: 0x690888e2, atime: 0x690888de, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167010.619308:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.619310:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.619318:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ba10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f0a expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167010.619332:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ba10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f0a expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167010.619343:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167010.619407:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451966592:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 193us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167010.619413:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17275 00000100:00100000:1.0:1762167010.621496:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.621550:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451966720 00000100:00100000:2.0:1762167010.621559:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451966720 00002000:00100000:2.0:1762167010.621603:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (217088->221183) req@ffff9ee372a4f480 x1847765451966720/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.621613:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4f480 with x1847765451966720 ext(217088->221183) 00002000:00010000:2.0:1762167010.621618:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4f480 00000100:00100000:2.0:1762167010.621649:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3121 00000100:00100000:2.0:1762167010.621658:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451966720:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167010.621898:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451966720:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 241us (408us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167010.621906:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3121 00002000:00100000:2.0:1762167010.621913:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (217088->221183) req@ffff9ee372a4f480 x1847765451966720/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/4536 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.621921:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4f480 with x1847765451966720 ext(217088->221183) 00002000:00010000:2.0:1762167010.621925:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4f480 00000100:00100000:1.0:1762167010.623495:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.623578:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451966848 00000100:00100000:2.0:1762167010.623586:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451966848 00002000:00100000:2.0:1762167010.623626:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (221184->225279) req@ffff9ee372a4df80 x1847765451966848/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.623638:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4df80 with x1847765451966848 ext(221184->225279) 00002000:00010000:2.0:1762167010.623642:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4df80 00000100:00100000:2.0:1762167010.623684:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3122 00000100:00100000:2.0:1762167010.623694:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451966848:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167010.623899:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451966848:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 206us (409us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167010.623907:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3122 00002000:00100000:2.0:1762167010.623915:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (221184->225279) req@ffff9ee372a4df80 x1847765451966848/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/4536 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.623924:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4df80 with x1847765451966848 ext(221184->225279) 00002000:00010000:2.0:1762167010.623928:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4df80 00000100:00100000:0.0:1762167010.625500:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.625581:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451966976 00000100:00100000:2.0:1762167010.625590:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451966976 00002000:00100000:2.0:1762167010.625630:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (196608->241663) req@ffff9ee36de00700 x1847765451966976/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 504/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.625638:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de00700 with x1847765451966976 ext(196608->241663) 00002000:00010000:2.0:1762167010.625642:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de00700 00000100:00100000:2.0:1762167010.625667:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3123 00000100:00100000:2.0:1762167010.625673:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451966976:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167010.626927:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451966976:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1248us (1428us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1762167010.626937:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3123 00002000:00100000:2.0:1762167010.626947:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (196608->241663) req@ffff9ee36de00700 x1847765451966976/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 504/440 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 36864/36864 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.626956:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de00700 with x1847765451966976 ext(196608->241663) 00002000:00010000:2.0:1762167010.626961:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de00700 00000100:00100000:1.0:1762167010.628920:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.628991:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451967232 00000100:00100000:0.0:1762167010.629001:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451967232 00000100:00100000:0.0:1762167010.629053:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19990 00000100:00100000:0.0:1762167010.629063:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451967232:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167010.629116:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167010.629144:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0ba09 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f03 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.629165:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:0.0:1762167010.629170:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.629423:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.629439:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.629448:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167010.629503:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953085 00000004:00010000:0.0:1762167010.629524:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e72c3127 reply state 0000000083da05bd transno 8589953086 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.629532:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167010.629622:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451967232:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 559us (709us total) trans 8589953086 rc 0/0 00000100:00100000:0.0:1762167010.629629:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19990 00000020:00080000:0.0:1762167010.629634:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167010.630502:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.630512:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.630520:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.630526:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167010.630530:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.630544:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.630556:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:2.0:1762167010.630559:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167010.630563:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.630569:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba17 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.631054:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.631246:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451967488 00000100:00100000:0.0:1762167010.631254:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451967488 00000100:00100000:0.0:1762167010.631308:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7379 00000100:00100000:0.0:1762167010.631318:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451967488:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167010.631607:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451967488:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 289us (554us total) trans 8589953087 rc 0/0 00000100:00100000:0.0:1762167010.631615:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7379 00000100:00100000:0.0:1762167010.632983:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.633056:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451967744 00000100:00100000:1.0:1762167010.633063:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451967744 00000100:00100000:1.0:1762167010.633113:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19991 00000100:00100000:1.0:1762167010.633125:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451967744:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167010.633145:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.633148:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762167010.633170:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0b98b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3eee expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.633190:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0b961 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ee0 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.633200:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee35075d000) 00010000:00010000:1.0:1762167010.633210:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167010.633225:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0ba1e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f11 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.633268:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0ba25 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.633280:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0ba25 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.633290:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0ba25 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:1.0:1762167010.633861:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5576, 88 off450912 00000004:00080000:1.0:1762167010.633874:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631426110269ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167010.633925:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5584, 88 off451968 00000004:00080000:1.0:1762167010.633930:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631426167609ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167010.633972:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5585, 88 off452056 00000004:00080000:1.0:1762167010.633976:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631426213349ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167010.633999:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5577, 88 off451000 00000004:00080000:1.0:1762167010.634004:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631426241181ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167010.634049:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5586, 88 off452144 00000004:00080000:1.0:1762167010.634054:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631426291468ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167010.634083:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5578, 88 off451088 00000004:00080000:1.0:1762167010.634089:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631426326006ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167010.634110:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5579, 88 off451176 00000004:00080000:1.0:1762167010.634113:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631426350631ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167010.634143:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5587, 88 off452232 00000004:00080000:1.0:1762167010.634147:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631426384345ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167010.634175:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5588, 88 off452320 00000004:00080000:1.0:1762167010.634179:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631426416441ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167010.634206:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5580, 88 off451264 00000004:00080000:1.0:1762167010.634210:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631426447100ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167010.634243:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5589, 88 off452408 00000004:00080000:1.0:1762167010.634248:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631426484846ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167010.634274:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5581, 88 off451352 00000004:00080000:1.0:1762167010.634279:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631426516360ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167010.634302:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5582, 88 off451440 00000004:00080000:1.0:1762167010.634307:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631426543995ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167010.634329:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5590, 88 off452496 00000004:00080000:1.0:1762167010.634334:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631426571038ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167010.634366:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5583, 88 off451528 00000004:00080000:1.0:1762167010.634371:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631426607830ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167010.634395:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5591, 88 off452584 00000004:00080000:1.0:1762167010.634400:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631426637656ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167010.634426:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5592, 88 off452672 00000004:00080000:1.0:1762167010.634430:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631426667343ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167010.634451:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5584, 88 off451616 00000004:00080000:1.0:1762167010.634456:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631426693316ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167010.634478:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5585, 88 off451704 00000004:00080000:1.0:1762167010.634482:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631426719646ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167010.634498:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5593, 88 off452760 00000004:00080000:1.0:1762167010.634502:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631426739141ns, next at 630703976179ns, rc = 0 00000001:00080000:3.0:1762167010.645427:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953087 is committed 00000001:00080000:3.0:1762167010.645460:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953088 is committed 00000004:00080000:3.0:1762167010.645466:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3704 committed 00000004:00080000:3.0:1762167010.645480:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3691 committed 00000004:00080000:3.0:1762167010.645490:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3690 committed 00000004:00080000:3.0:1762167010.645493:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3703 committed 00010000:00010000:0.0:1762167010.645493:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0ba25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f11 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762167010.645499:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3702 committed 00000004:00080000:3.0:1762167010.645503:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3689 committed 00000004:00080000:3.0:1762167010.645508:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3701 committed 00000004:00080000:3.0:1762167010.645513:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3688 committed 00000004:00080000:3.0:1762167010.645518:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3687 committed 00010000:00010000:0.0:1762167010.645519:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c02100) 00000004:00080000:3.0:1762167010.645521:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3700 committed 00010000:00010000:0.0:1762167010.645524:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:3.0:1762167010.645526:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3686 committed 00000004:00080000:3.0:1762167010.645532:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3699 committed 00000004:00080000:3.0:1762167010.645534:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3698 committed 00000004:00080000:3.0:1762167010.645537:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3685 committed 00000004:00080000:3.0:1762167010.645540:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3684 committed 00000004:00080000:3.0:1762167010.645542:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3697 committed 00000004:00080000:3.0:1762167010.645544:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3683 committed 00010000:00010000:0.0:1762167010.645548:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0ba1e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f11 expref: 891 pid: 30819 timeout: 0 lvb_type: 3 00000004:00080000:3.0:1762167010.645549:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3696 committed 00000004:00080000:3.0:1762167010.645553:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3695 committed 00000004:00080000:3.0:1762167010.645559:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3682 committed 00010000:00010000:0.0:1762167010.645577:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0ba25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f11 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.645611:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167010.645615:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762167010.645618:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29400, rc 0) 00000100:00100000:1.0:1762167010.645644:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454516992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.645697:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451967744:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 12573us (12718us total) trans 8589953088 rc 0/0 00000100:00100000:0.0:1762167010.645710:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19991 00000100:00100000:1.0:1762167010.645717:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.645796:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454517504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.645798:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454517248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.645842:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.645850:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454517376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.645863:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454516992 00000100:00100000:3.0:1762167010.645871:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454516992 00000100:00100000:1.0:1762167010.645873:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454518016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.645881:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.645922:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454517888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.645923:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454517504 00000100:00100000:3.0:1762167010.645928:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454517504 00000100:00100000:1.0:1762167010.645930:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.645951:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454517376 00000100:00100000:0.0:1762167010.645957:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454517376 00000100:00100000:3.0:1762167010.645962:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17276 00000100:00100000:2.0:1762167010.645963:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.645970:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454518528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.645978:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454516992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.645992:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454518016 00000100:00100000:2.0:1762167010.645993:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454518400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.645997:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454518016 00000100:00100000:1.0:1762167010.646004:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.646028:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454517888 00000100:00100000:2.0:1762167010.646030:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.646033:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454517888 00000100:00100000:2.0:1762167010.646054:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454518912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.646055:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454518528 00000100:00100000:0.0:1762167010.646055:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454518400 00000100:00100000:1.0:1762167010.646062:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454518528 00000100:00100000:0.0:1762167010.646063:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454518400 00000100:00100000:2.0:1762167010.646091:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.646096:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454518912 00000100:00100000:0.0:1762167010.646097:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17277 00000100:00100000:1.0:1762167010.646107:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454518912 00000100:00100000:0.0:1762167010.646108:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454517504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.646138:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17278 00000100:00100000:2.0:1762167010.646150:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454517376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.646155:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17279 00000100:00100000:1.0:1762167010.646169:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454518016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167010.646262:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.646262:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.646268:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167010.646269:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.646275:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762167010.646276:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.646282:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:0.0:1762167010.646283:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.646289:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167010.646290:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167010.646345:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3294:x1847765454516992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 371us (630us total) trans 17179875996 rc 0/0 00000100:00100000:2.0:1762167010.646354:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454517376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (471us total) trans 17179875997 rc 0/0 00000100:00100000:3.0:1762167010.646368:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17276 00000100:00100000:0.0:1762167010.646374:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454517504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 266us (530us total) trans 21474843559 rc 0/0 00000100:00100000:2.0:1762167010.646379:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17278 00000100:00100000:0.0:1762167010.646389:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17277 00000100:00100000:1.0:1762167010.646394:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3294:x1847765454518016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (466us total) trans 17179875998 rc 0/0 00000100:00100000:3.0:1762167010.646402:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17280 00000100:00100000:1.0:1762167010.646409:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17279 00000100:00100000:3.0:1762167010.646415:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454517888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.646419:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17281 00000100:00100000:0.0:1762167010.646431:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17282 00000100:00100000:2.0:1762167010.646434:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454518528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.646439:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17283 00000100:00100000:0.0:1762167010.646445:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454518400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.646455:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454518912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167010.646553:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.646557:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.646560:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167010.646563:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.646565:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167010.646592:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.646597:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.646601:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167010.646602:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167010.646603:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454517888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (640us total) trans 21474843560 rc 0/0 00002000:00010000:2.0:1762167010.646608:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.646609:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.646614:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 239570 -> 239570 00002000:00010000:2.0:1762167010.646616:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167010.646617:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:3.0:1762167010.646620:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17280 00002000:00010000:1.0:1762167010.646622:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.646624:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.646629:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167010.646630:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167010.646637:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.646641:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167010.646655:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454518528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (650us total) trans 17179875999 rc 0/0 00000100:00100000:2.0:1762167010.646663:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17281 00000100:00100000:0.0:1762167010.646685:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3293:x1847765454518400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (655us total) trans 21474843561 rc 0/0 00000100:00100000:1.0:1762167010.646693:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3293:x1847765454518912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 242us (602us total) trans 21474843562 rc 0/0 00000100:00100000:0.0:1762167010.646696:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17282 00000100:00100000:2.0:1762167010.646701:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.646710:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17283 00000100:00100000:0.0:1762167010.646719:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454517248 00000100:00100000:0.0:1762167010.646724:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454517248 00000100:00100000:2.0:1762167010.646729:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454517760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.646747:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17284 00000100:00100000:2.0:1762167010.646783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.646790:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454517248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.646799:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454517760 00000100:00100000:0.0:1762167010.646803:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454517760 00000100:00100000:2.0:1762167010.646814:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454518272:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167010.646816:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d69880/2, rc 0, transno 21474843559 00000100:00100000:0.0:1762167010.646829:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17285 00000100:00100000:3.0:1762167010.646833:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454517504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.646840:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454517760:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167010.646852:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc4380/2, rc 0, transno 17179875998 00000100:00100000:2.0:1762167010.646852:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167010.646869:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454518016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.646881:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454518784:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167010.646887:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc5f80/2, rc 0, transno 17179875999 00000100:00100000:3.0:1762167010.646895:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454518528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.646910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167010.646911:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc5180/2, rc 0, transno 17179875996 00000100:00100000:3.0:1762167010.646919:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454516992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.646933:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00002000:00010000:1.0:1762167010.646934:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.646940:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.646943:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00000100:00100000:2.0:1762167010.646945:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454517120:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167010.646947:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.646952:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167010.646981:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454519040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.646989:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.646994:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454517760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (235us total) trans 17179876001 rc 0/0 00000100:00100000:0.0:1762167010.647003:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17285 00000100:00100000:1.0:1762167010.647008:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454517248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (311us total) trans 17179876000 rc 0/0 00000100:00100000:2.0:1762167010.647014:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454517632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.647019:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454518272 00000100:00100000:1.0:1762167010.647021:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17284 00000100:00100000:3.0:1762167010.647024:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.647025:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454518272 00000100:00100000:1.0:1762167010.647046:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454518784 00000100:00100000:1.0:1762167010.647052:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454518784 00000100:00100000:0.0:1762167010.647053:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454517120 00000100:00100000:2.0:1762167010.647054:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.647060:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454517120 00000100:00100000:2.0:1762167010.647076:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee381d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454518144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.647078:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454519040 00000100:00100000:0.0:1762167010.647083:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454517632 00000100:00100000:1.0:1762167010.647084:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454519040 00000100:00100000:0.0:1762167010.647088:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454517632 00000100:00100000:2.0:1762167010.647102:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.647113:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454518144 00000100:00100000:0.0:1762167010.647118:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17286 00000100:00100000:1.0:1762167010.647119:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454518144 00000100:00100000:2.0:1762167010.647121:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454518656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.647131:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454518272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.647147:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17287 00000100:00100000:2.0:1762167010.647153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.647160:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454518784:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167010.647180:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc7800/2, rc 0, transno 17179876000 00000100:00100000:2.0:1762167010.647187:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454517248:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167010.647199:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc4000/2, rc 0, transno 17179876001 00000100:00100000:2.0:1762167010.647203:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454517760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.647223:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454518656 00000100:00100000:2.0:1762167010.647227:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454518656 00002000:00010000:0.0:1762167010.647249:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167010.647253:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17288 00002000:00010000:0.0:1762167010.647256:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.647261:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000100:00100000:2.0:1762167010.647263:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454517120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167010.647265:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.647273:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.647329:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454518272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (478us total) trans 17179876002 rc 0/0 00000100:00100000:1.0:1762167010.647331:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454518784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (420us total) trans 21474843563 rc 0/0 00000100:00100000:0.0:1762167010.647342:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17286 00000100:00100000:1.0:1762167010.647349:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17287 00000100:00100000:0.0:1762167010.647376:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17289 00000100:00100000:1.0:1762167010.647385:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17290 00000100:00100000:0.0:1762167010.647390:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454519040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167010.647391:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 239570 -> 239570 00002000:00010000:2.0:1762167010.647398:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:1.0:1762167010.647400:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454517632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167010.647402:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.647407:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.647410:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 373 -> 373 00000100:00100000:2.0:1762167010.647439:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454517120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (452us total) trans 21474843564 rc 0/0 00000100:00100000:2.0:1762167010.647445:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17288 00000100:00100000:2.0:1762167010.647460:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17291 00000100:00100000:2.0:1762167010.647468:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454518144:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167010.647496:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d6aa00/2, rc 0, transno 21474843564 00000100:00100000:3.0:1762167010.647509:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454517120:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167010.647528:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccfb80/2, rc 0, transno 21474843563 00000100:00100000:3.0:1762167010.647533:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454518784:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167010.647540:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.647544:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.647547:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000004:00080000:3.0:1762167010.647548:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc5500/2, rc 0, transno 17179876002 00002000:00010000:0.0:1762167010.647550:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000100:00100000:3.0:1762167010.647556:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454518272:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167010.647556:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167010.647557:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.647565:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.647569:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167010.647572:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.647575:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.647607:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3294:x1847765454519040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (588us total) trans 21474843565 rc 0/0 00000100:00100000:0.0:1762167010.647616:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17289 00000100:00100000:3.0:1762167010.647637:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454519168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.647638:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454517632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (584us total) trans 17179876003 rc 0/0 00000100:00100000:0.0:1762167010.647640:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17292 00000100:00100000:2.0:1762167010.647642:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454518144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (535us total) trans 21474843566 rc 0/0 00000100:00100000:0.0:1762167010.647655:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454518656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.647659:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17290 00000100:00100000:2.0:1762167010.647668:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17291 00000100:00100000:3.0:1762167010.647681:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.647694:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454519168 00000100:00100000:2.0:1762167010.647699:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454519168 00000004:00080000:3.0:1762167010.647731:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccd180/2, rc 0, transno 21474843565 00000100:00100000:2.0:1762167010.647732:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17293 00000100:00100000:3.0:1762167010.647740:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454519040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.647742:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454519168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167010.647799:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:3.0:1762167010.647800:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc7100/2, rc 0, transno 17179876003 00002000:00010000:0.0:1762167010.647804:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:3.0:1762167010.647809:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454517632:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167010.647810:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167010.647816:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.647820:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:3.0:1762167010.647829:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d6b800/2, rc 0, transno 21474843566 00000100:00100000:3.0:1762167010.647835:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454518144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.647857:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3296:x1847765454518656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (706us total) trans 21474843567 rc 0/0 00000004:00080000:3.0:1762167010.647861:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccdf80/2, rc 0, transno 21474843567 00000100:00100000:0.0:1762167010.647866:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17292 00000100:00100000:3.0:1762167010.647868:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454518656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.647904:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454519168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (225us total) trans 21474843568 rc 0/0 00000100:00100000:2.0:1762167010.647913:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17293 00000004:00080000:1.0:1762167010.647919:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc6a00/2, rc 0, transno 17179875997 00000100:00100000:1.0:1762167010.647924:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454517376:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167010.647933:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcce300/2, rc 0, transno 21474843568 00000100:00100000:3.0:1762167010.647940:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454519168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167010.647940:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee381d6a680/2, rc 0, transno 21474843560 00000100:00100000:1.0:1762167010.647949:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee381d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454517888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.647951:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1762167010.647960:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454519296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167010.647962:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccca80/2, rc 0, transno 21474843561 00000100:00100000:1.0:1762167010.647968:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454518400:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167010.647979:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccc700/2, rc 0, transno 21474843562 00000100:00100000:1.0:1762167010.647983:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454518912:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.647985:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762167010.647993:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24785a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454519424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.648018:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.648045:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454519424 00000100:00100000:1.0:1762167010.648049:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454519424 00000100:00100000:3.0:1762167010.648059:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.648085:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454519296 00000100:00100000:1.0:1762167010.648089:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454519296 00000100:00100000:0.0:1762167010.648091:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17294 00000100:00100000:0.0:1762167010.648103:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454519424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.648124:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17295 00000100:00100000:1.0:1762167010.648134:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454519296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.648136:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.648161:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451967872 00000100:00100000:3.0:1762167010.648167:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451967872 00002000:00010000:0.0:1762167010.648212:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.648215:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.648217:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167010.648220:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.648222:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.648257:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3294:x1847765454519424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (236us total) trans 17179876004 rc 0/0 00000100:00100000:3.0:1762167010.648261:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17296 00000100:00100000:0.0:1762167010.648270:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17294 00000100:00100000:3.0:1762167010.648276:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451967872:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167010.648288:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167010.648299:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454519296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (240us total) trans 17179876005 rc 0/0 00010000:00010000:3.0:1762167010.648302:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f18 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.648311:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17295 00010000:00010000:3.0:1762167010.648332:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b82d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e62 expref: 28 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167010.648347:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.648352:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.648365:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.648393:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e62 expref: 28 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167010.648408:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b82d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e62 expref: 28 pid: 6533 timeout: 731 lvb_type: 1 00000100:00100000:3.0:1762167010.648420:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454519552:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167010.648487:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427206c0 going to sleep for 11 seconds 00000004:00080000:3.0:1762167010.648518:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24785a300/2, rc 0, transno 17179876005 00000100:00100000:3.0:1762167010.648524:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454519296:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167010.648530:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24785a680/2, rc 0, transno 17179876004 00000100:00100000:2.0:1762167010.648537:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24785a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454519424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.649485:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454519552:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167010.649516:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.649535:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000100:00100000:3.0:1762167010.649577:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56065:x1847765451967872:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1306us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167010.649584:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17296 00000100:00100000:2.0:1762167010.649595:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.649658:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968000 00000100:00100000:1.0:1762167010.649665:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968000 00010000:00010000:1.0:1762167010.649687:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b82d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e62 expref: 28 pid: 6533 timeout: 731 lvb_type: 1 00000100:00100000:1.0:1762167010.649719:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7613 00000100:00100000:1.0:1762167010.649727:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451968000:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167010.649739:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.649755:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b82d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e62 expref: 28 pid: 6533 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1762167010.649804:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e62 expref: 28 pid: 6533 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1762167010.649826:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0b82d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e62 expref: 28 pid: 6533 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1762167010.649838:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.649839:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.649847:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.649856:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.649881:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.649892:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454519680:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167010.649947:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e240 going to sleep for 11 seconds 00000100:00100000:1.0:1762167010.651398:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454519680:192.168.203.35@tcp:105: 00010000:00010000:1.0:1762167010.651417:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167010.651460:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451968000:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1733us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.651467:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7613 00000100:00100000:2.0:1762167010.651550:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.651599:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968128 00000100:00100000:3.0:1762167010.651606:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968128 00000100:00100000:3.0:1762167010.651709:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17297 00000100:00100000:3.0:1762167010.651719:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56065:x1847765451968128:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167010.651737:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167010.651753:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f1f expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.651800:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b834 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e69 expref: 32 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167010.651809:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.651812:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.651818:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.651846:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b834 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e69 expref: 32 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167010.651859:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b834 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e69 expref: 32 pid: 12400 timeout: 731 lvb_type: 1 00000100:00100000:3.0:1762167010.651878:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454519808:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167010.651937:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427206c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167010.653228:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454519808:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167010.653248:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.653309:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167010.653368:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56065:x1847765451968128:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1639us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167010.653375:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17297 00000100:00100000:2.0:1762167010.653390:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.653445:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968256 00000100:00100000:1.0:1762167010.653453:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968256 00010000:00010000:1.0:1762167010.653480:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b834 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e69 expref: 32 pid: 12400 timeout: 731 lvb_type: 1 00000100:00100000:1.0:1762167010.653511:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7614 00000100:00100000:1.0:1762167010.653521:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451968256:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167010.653532:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167010.653557:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b834 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e69 expref: 32 pid: 12400 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1762167010.653572:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b834 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e69 expref: 32 pid: 12400 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1762167010.653593:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0b834 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e69 expref: 32 pid: 12400 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1762167010.653613:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.653615:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.653622:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.653632:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.653661:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.653674:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765454519936:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167010.653734:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1762167010.655062:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.655109:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968384 00000100:00100000:1.0:1762167010.655115:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968384 00000100:00100000:1.0:1762167010.655167:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17298 00000100:00100000:1.0:1762167010.655177:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451968384:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167010.655194:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167010.655210:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f26 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.655233:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b83b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e70 expref: 28 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167010.655240:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.655243:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167010.655246:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.655270:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b83b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e70 expref: 28 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167010.655282:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b83b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e70 expref: 28 pid: 33894 timeout: 731 lvb_type: 1 00000100:00100000:1.0:1762167010.655294:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454520064:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167010.655370:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167010.655382:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765454519936:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167010.655401:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167010.655429:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451968256:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1911us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.655439:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7614 00000100:00100000:1.0:1762167010.656504:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454520064:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167010.656523:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.656545:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29000, rc 0) 00000100:00100000:1.0:1762167010.656593:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56065:x1847765451968384:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1417us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167010.656600:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17298 00000100:00100000:0.0:1762167010.656843:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.656921:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968512 00000100:00100000:2.0:1762167010.656940:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968512 00010000:00010000:2.0:1762167010.656971:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b83b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e70 expref: 28 pid: 33894 timeout: 731 lvb_type: 1 00000100:00100000:2.0:1762167010.657006:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7615 00000100:00100000:2.0:1762167010.657015:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451968512:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.657027:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.657054:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b83b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e70 expref: 28 pid: 33894 timeout: 731 lvb_type: 1 00010000:00010000:2.0:1762167010.657066:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b83b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e70 expref: 28 pid: 33894 timeout: 731 lvb_type: 1 00010000:00010000:2.0:1762167010.657090:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0b83b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3e70 expref: 28 pid: 33894 timeout: 731 lvb_type: 1 00010000:00010000:2.0:1762167010.657104:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.657106:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.657113:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.657123:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.657154:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.657178:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24785b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454520192:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167010.657235:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167010.658311:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24785b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454520192:192.168.203.35@tcp:105: 00010000:00010000:2.0:1762167010.658327:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167010.658378:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451968512:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1364us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.658386:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7615 00000100:00100000:0.0:1762167010.658637:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.658681:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.658732:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968640 00000100:00100000:1.0:1762167010.658739:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968640 00000100:00100000:2.0:1762167010.658745:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968768 00000100:00100000:2.0:1762167010.658750:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968768 00002000:00010000:1.0:1762167010.658799:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (57008->18446744073709551615) 00002000:00100000:1.0:1762167010.658807:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b03480 with x1847765451968640 ext(57008->18446744073709551615) 00000100:00100000:3.0:1762167010.658811:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:1.0:1762167010.658819:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b03480. 00000100:00100000:1.0:1762167010.658865:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451968896 00000100:00100000:1.0:1762167010.658870:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451968896 00002000:00010000:1.0:1762167010.658886:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.658890:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccf480 with x1847765451968896 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167010.658895:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fccf480. 00002000:00010000:3.0:1762167010.658905:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167010.658910:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b02300 with x1847765451968768 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167010.658918:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee347b02300. 00000100:00100000:1.0:1762167010.658953:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3124 00000100:00100000:1.0:1762167010.658964:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451968640:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167010.658972:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3125 00000100:00100000:3.0:1762167010.658981:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3126 00000100:00100000:2.0:1762167010.658987:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451968896:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167010.658996:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451968768:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167010.659259:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.659264:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.659266:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.659267:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.659274:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.659275:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.659280:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.659284:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.659287:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167010.659289:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167010.659337:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451968768:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 343us (653us total) trans 17179876006 rc 0/0 00000100:00100000:2.0:1762167010.659339:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451968896:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 354us (528us total) trans 21474843569 rc 0/0 00000100:00100000:3.0:1762167010.659355:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3126 00002000:00010000:3.0:1762167010.659371:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:2.0:1762167010.659374:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3125 00002000:00100000:3.0:1762167010.659377:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b02300 with x1847765451968768 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.659380:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:3.0:1762167010.659386:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee347b02300. 00002000:00100000:2.0:1762167010.659386:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccf480 with x1847765451968896 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.659394:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fccf480. 00002000:00010000:1.0:1762167010.659513:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 239570 -> 57008 00002000:00010000:1.0:1762167010.659516:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.659518:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.659519:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.659521:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 373 -> 373 00000100:00100000:1.0:1762167010.659556:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451968640:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 594us (919us total) trans 21474843570 rc 0/0 00000100:00100000:1.0:1762167010.659563:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3124 00002000:00010000:1.0:1762167010.659566:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (57008->18446744073709551615) 00002000:00100000:1.0:1762167010.659570:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b03480 with x1847765451968640 ext(57008->18446744073709551615) 00002000:00010000:1.0:1762167010.659575:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b03480. 00000100:00100000:3.0:1762167010.661713:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.661890:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451969024 00000100:00100000:0.0:1762167010.661906:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451969024 00000100:00100000:0.0:1762167010.661971:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19992 00000100:00100000:0.0:1762167010.661982:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451969024:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167010.662003:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.662021:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ba41 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f2d expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.662102:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba48 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.662116:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.662126:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.662154:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 239570 00000004:00200000:0.0:1762167010.662159:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167010.662177:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.662201:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ba41 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f2d expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.662226:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba48 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f2d expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.662235:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:0.0:1762167010.662238:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167010.662241:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167010.662300:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451969024:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 321us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.662305:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19992 00000100:00100000:0.0:1762167010.665464:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.665578:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451969280 00000100:00100000:1.0:1762167010.665590:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451969280 00000100:00100000:1.0:1762167010.665654:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19993 00000100:00100000:1.0:1762167010.665667:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451969280:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167010.665732:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762167010.665799:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0ba48 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f2d expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.665825:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0ba25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f11 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.665841:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c02100) 00010000:00010000:1.0:1762167010.665851:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167010.666182:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.666196:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167010.666205:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:1.0:1762167010.666277:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953089 00000004:00010000:1.0:1762167010.666301:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000466cd147 reply state 00000000105c5e49 transno 8589953090 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.666310:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167010.666419:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451969280:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 754us (965us total) trans 8589953090 rc 0/0 00000100:00100000:1.0:1762167010.666427:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19993 00000020:00080000:1.0:1762167010.666432:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762167010.668577:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.668663:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451969408 00000100:00100000:0.0:1762167010.668672:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451969408 00010000:00010000:3.0:1762167010.668683:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.668695:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.668703:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.668709:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a28800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167010.668714:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.668721:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.668732:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19994 00010000:00010000:3.0:1762167010.668736:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167010.668741:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762167010.668745:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451969408:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167010.668747:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.668758:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0ba4f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.668791:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.668808:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ba56 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f34 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.668870:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ba56 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f34 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.668885:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ba56 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f34 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.668905:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167010.668909:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167010.668912:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c400, rc 0) 00000100:00100000:0.0:1762167010.668976:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451969408:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 234us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.668983:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19994 00000100:00100000:3.0:1762167010.670757:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.670886:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451969664 00000100:00100000:1.0:1762167010.670895:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451969664 00002000:00010000:1.0:1762167010.670936:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.670942:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccdc00 with x1847765451969664 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167010.670967:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fccdc00. 00000100:00100000:1.0:1762167010.670997:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3127 00000100:00100000:1.0:1762167010.671008:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451969664:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167010.671081:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.671124:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451969536 00000100:00100000:3.0:1762167010.671131:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451969536 00000100:00100000:2.0:1762167010.671137:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:3.0:1762167010.671156:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (14981->18446744073709551615) 00002000:00100000:3.0:1762167010.671161:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24785b100 with x1847765451969536 ext(14981->18446744073709551615) 00000100:00100000:2.0:1762167010.671167:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451969792 00002000:00010000:3.0:1762167010.671169:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24785b100. 00000100:00100000:2.0:1762167010.671173:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451969792 00002000:00010000:2.0:1762167010.671195:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:3.0:1762167010.671199:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3128 00002000:00100000:2.0:1762167010.671201:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247859500 with x1847765451969792 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.671211:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee247859500. 00000100:00100000:3.0:1762167010.671214:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451969536:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167010.671241:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3129 00000100:00100000:0.0:1762167010.671251:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451969792:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:1.0:1762167010.671274:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167010.671280:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.671283:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.671286:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.671289:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167010.671372:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765451969664:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 353us (609us total) trans 17179876007 rc 0/0 00000100:00100000:1.0:1762167010.671381:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3127 00002000:00010000:1.0:1762167010.671386:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.671389:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccdc00 with x1847765451969664 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167010.671394:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fccdc00. 00002000:00010000:0.0:1762167010.671439:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.671444:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.671447:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.671450:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.671452:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.671496:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451969792:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 246us (360us total) trans 21474843571 rc 0/0 00000100:00100000:0.0:1762167010.671504:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3129 00002000:00010000:0.0:1762167010.671509:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:0.0:1762167010.671512:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247859500 with x1847765451969792 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167010.671518:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee247859500. 00002000:00010000:2.0:1762167010.671623:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 57008 -> 14981 00002000:00010000:2.0:1762167010.671626:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.671628:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.671629:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.671631:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 373 -> 373 00000100:00100000:2.0:1762167010.671660:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451969536:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 451us (580us total) trans 21474843572 rc 0/0 00000100:00100000:2.0:1762167010.671666:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3128 00002000:00010000:2.0:1762167010.671669:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (14981->18446744073709551615) 00002000:00100000:2.0:1762167010.671678:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24785b100 with x1847765451969536 ext(14981->18446744073709551615) 00002000:00010000:2.0:1762167010.671683:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24785b100. 00000100:00100000:3.0:1762167010.673315:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.673704:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451969920 00000100:00100000:2.0:1762167010.673714:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451969920 00000100:00100000:2.0:1762167010.673799:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19995 00000100:00100000:2.0:1762167010.673833:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451969920:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167010.673852:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167010.673874:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba5d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f3b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.673981:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba64 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.673999:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.674011:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167010.674036:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 14981 00000004:00200000:2.0:1762167010.674041:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167010.674057:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.674080:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba5d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f3b expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.674097:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba64 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f3b expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.674106:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.674109:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167010.674112:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00000100:00100000:2.0:1762167010.674168:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451969920:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 361us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.674177:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19995 00000100:00100000:1.0:1762167010.676552:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.676647:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451970176 00000100:00100000:2.0:1762167010.676658:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451970176 00000100:00100000:2.0:1762167010.676718:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19996 00000100:00100000:2.0:1762167010.676728:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765451970176:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167010.676816:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.676860:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba64 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f3b expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.676882:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.676887:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.677129:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.677142:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.677153:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167010.677205:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953091 00000004:00010000:2.0:1762167010.677231:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000831e915b reply state 0000000048f880e8 transno 8589953092 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167010.677241:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167010.677338:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451970176:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 611us (795us total) trans 8589953092 rc 0/0 00000100:00100000:2.0:1762167010.677346:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19996 00000020:00080000:2.0:1762167010.677351:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167010.678447:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.678460:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.678466:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.678472:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167010.678476:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.678484:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.678497:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.678500:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167010.678503:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.678509:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba6b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167010.679230:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.679263:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.679293:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451970304 00000100:00100000:1.0:1762167010.679298:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.679302:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451970304 00002000:00010000:2.0:1762167010.679333:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (171566->18446744073709551615) 00000100:00100000:0.0:1762167010.679333:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451970432 00002000:00100000:2.0:1762167010.679339:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4e680 with x1847765451970304 ext(171566->18446744073709551615) 00000100:00100000:0.0:1762167010.679341:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451970432 00002000:00010000:2.0:1762167010.679349:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4e680. 00002000:00010000:0.0:1762167010.679378:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167010.679384:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4fb80 with x1847765451970432 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167010.679389:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451970560 00002000:00010000:0.0:1762167010.679392:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee372a4fb80. 00000100:00100000:2.0:1762167010.679395:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451970560 00002000:00010000:2.0:1762167010.679409:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:2.0:1762167010.679413:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4ed80 with x1847765451970560 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.679419:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4ed80. 00000100:00100000:0.0:1762167010.679422:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3130 00000100:00100000:0.0:1762167010.679435:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451970304:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167010.679448:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3131 00000100:00100000:3.0:1762167010.679462:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3132 00000100:00100000:2.0:1762167010.679463:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451970432:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167010.679479:0:6539:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451970560:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:2.0:1762167010.679726:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.679726:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 14981 -> 171566 00002000:00010000:2.0:1762167010.679735:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.679735:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.679740:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.679741:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.679746:0:6539:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.679747:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.679753:0:6539:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.679754:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 373 -> 373 00002000:00010000:2.0:1762167010.679793:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.679798:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167010.679799:0:6539:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.679804:0:6539:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.679807:0:6539:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.679845:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451970304:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 413us (618us total) trans 21474843573 rc 0/0 00000100:00100000:2.0:1762167010.679847:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451970432:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 389us (581us total) trans 17179876008 rc 0/0 00000100:00100000:3.0:1762167010.679853:0:6539:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451970560:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 377us (553us total) trans 21474843574 rc 0/0 00000100:00100000:0.0:1762167010.679864:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3130 00002000:00010000:0.0:1762167010.679869:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (171566->18446744073709551615) 00000100:00100000:2.0:1762167010.679872:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3131 00002000:00100000:0.0:1762167010.679874:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4e680 with x1847765451970304 ext(171566->18446744073709551615) 00002000:00010000:2.0:1762167010.679878:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:3.0:1762167010.679881:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3132 00002000:00010000:0.0:1762167010.679882:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4e680. 00002000:00100000:2.0:1762167010.679885:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4fb80 with x1847765451970432 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167010.679887:0:6539:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:3.0:1762167010.679891:0:6539:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4ed80 with x1847765451970560 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.679892:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee372a4fb80. 00002000:00010000:3.0:1762167010.679897:0:6539:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4ed80. 00000100:00100000:1.0:1762167010.682157:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.682227:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451970688 00000100:00100000:3.0:1762167010.682235:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451970688 00002000:00100000:3.0:1762167010.682277:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (135168->172031) req@ffff9ee372a4c700 x1847765451970688/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.682285:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4c700 with x1847765451970688 ext(135168->172031) 00002000:00010000:3.0:1762167010.682290:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4c700 00000100:00100000:3.0:1762167010.682323:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3133 00000100:00100000:3.0:1762167010.682332:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765451970688:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:3.0:1762167010.684332:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765451970688:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1991us (2174us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1762167010.684345:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3133 00002000:00100000:3.0:1762167010.684368:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (135168->172031) req@ffff9ee372a4c700 x1847765451970688/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/440 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 36864/36864 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.684379:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4c700 with x1847765451970688 ext(135168->172031) 00002000:00010000:3.0:1762167010.684386:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4c700 00000100:00100000:1.0:1762167010.686510:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.686567:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451970816 00000100:00100000:3.0:1762167010.686577:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451970816 00002000:00100000:3.0:1762167010.686622:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (163840->171565) req@ffff9ee372a4ea00 x1847765451970816/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 8216/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167010.686633:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4ea00 with x1847765451970816 ext(163840->171565) 00002000:00010000:3.0:1762167010.686637:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4ea00 00000100:00100000:3.0:1762167010.686664:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3134 00000100:00100000:3.0:1762167010.686671:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2358:x1847765451970816:12345-192.168.203.35@tcp:4:lfs.0 00000100:00100000:2.0:1762167010.687419:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2358:x1847765451970816:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 735us (903us total) trans 21474843575 rc 0/0 00000100:00100000:2.0:1762167010.687437:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3134 00002000:00100000:2.0:1762167010.687462:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (163840->171565) req@ffff9ee372a4ea00 x1847765451970816/t21474843575(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 8216/448 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.687473:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4ea00 with x1847765451970816 ext(163840->171565) 00002000:00010000:2.0:1762167010.687479:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4ea00 00000100:00100000:1.0:1762167010.689441:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.689540:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451970944 00000100:00100000:3.0:1762167010.689551:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451970944 00000100:00100000:3.0:1762167010.689617:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17299 00000100:00100000:3.0:1762167010.689629:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765451970944:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:3.0:1762167010.707141:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843573 is committed 00000001:00080000:3.0:1762167010.707161:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843567 is committed 00000001:00080000:3.0:1762167010.707208:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843575 is committed 00000001:00080000:3.0:1762167010.707219:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843568 is committed 00000100:00100000:2.0:1762167010.707250:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2359:x1847765451970944:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 17616us (17813us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.707264:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17299 00000100:00100000:1.0:1762167010.709647:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.709732:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451971072 00000100:00100000:2.0:1762167010.709744:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451971072 00000100:00100000:2.0:1762167010.709823:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19997 00000100:00100000:2.0:1762167010.709832:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765451971072:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167010.709856:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167010.709876:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba72 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f42 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.709951:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba79 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.709970:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba79 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.709982:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba79 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167010.710008:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 171566 00000004:00200000:2.0:1762167010.710012:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167010.710030:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba79 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.710127:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba72 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f42 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.710159:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba79 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f42 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.710169:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.710172:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167010.710175:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00000100:00100000:2.0:1762167010.710297:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451971072:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 450us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.710305:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19997 00000100:00100000:1.0:1762167010.713456:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.713548:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451971328 00000100:00100000:2.0:1762167010.713560:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451971328 00000100:00100000:2.0:1762167010.713628:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19998 00000100:00100000:2.0:1762167010.713639:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765451971328:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167010.713699:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.713725:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba79 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f42 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.713757:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.713779:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.714019:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.714033:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.714042:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167010.714091:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953093 00000004:00010000:2.0:1762167010.714115:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c074bee0 reply state 00000000144e7e0c transno 8589953094 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167010.714125:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167010.714218:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451971328:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 578us (769us total) trans 8589953094 rc 0/0 00000100:00100000:2.0:1762167010.714226:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19998 00000020:00080000:2.0:1762167010.714232:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167010.715485:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.715498:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.715505:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.715510:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167010.715514:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.715521:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.715533:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167010.715536:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167010.715539:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.715544:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0ba80 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167010.716313:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167010.716371:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.716395:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451971456 00000100:00100000:2.0:1762167010.716404:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451971456 00000100:00100000:1.0:1762167010.716415:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:2.0:1762167010.716451:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (262144->18446744073709551615) 00002000:00100000:2.0:1762167010.716457:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b1f80 with x1847765451971456 ext(262144->18446744073709551615) 00000100:00100000:0.0:1762167010.716459:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451971712 00000100:00100000:0.0:1762167010.716468:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451971712 00002000:00010000:2.0:1762167010.716475:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b1f80. 00002000:00010000:0.0:1762167010.716489:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:0.0:1762167010.716495:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242cead80 with x1847765451971712 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167010.716503:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242cead80. 00000100:00100000:2.0:1762167010.716509:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451971584 00000100:00100000:2.0:1762167010.716515:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451971584 00002000:00010000:2.0:1762167010.716534:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:0.0:1762167010.716539:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3135 00002000:00100000:2.0:1762167010.716540:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de02d80 with x1847765451971584 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167010.716552:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36de02d80. 00000100:00100000:1.0:1762167010.716552:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3136 00000100:00100000:0.0:1762167010.716554:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451971456:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167010.716571:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451971712:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167010.716581:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3137 00000100:00100000:2.0:1762167010.716591:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451971584:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:2.0:1762167010.716822:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.716827:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.716830:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.716832:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.716835:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167010.716895:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451971584:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 304us (478us total) trans 17179876009 rc 0/0 00002000:00010000:0.0:1762167010.716903:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 171566 -> 262144 00000100:00100000:2.0:1762167010.716904:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3137 00002000:00010000:0.0:1762167010.716910:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.716913:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:0.0:1762167010.716914:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.716917:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00100000:2.0:1762167010.716919:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de02d80 with x1847765451971584 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167010.716920:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.716924:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.716927:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 373 -> 55 00002000:00010000:2.0:1762167010.716929:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36de02d80. 00002000:00010000:1.0:1762167010.716939:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.716945:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.716948:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.716959:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451971456:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 409us (649us total) trans 21474843576 rc 0/0 00000100:00100000:0.0:1762167010.716967:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3135 00002000:00010000:0.0:1762167010.716971:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (262144->18446744073709551615) 00002000:00100000:0.0:1762167010.716974:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b1f80 with x1847765451971456 ext(262144->18446744073709551615) 00002000:00010000:0.0:1762167010.716980:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b1f80. 00000100:00100000:1.0:1762167010.716982:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451971712:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 417us (609us total) trans 21474843577 rc 0/0 00000100:00100000:1.0:1762167010.716992:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3136 00002000:00010000:1.0:1762167010.716996:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167010.716999:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee242cead80 with x1847765451971712 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167010.717006:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee242cead80. 00000100:00100000:1.0:1762167010.719337:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.719411:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451971840 00000100:00100000:2.0:1762167010.719420:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451971840 00002000:00100000:2.0:1762167010.719463:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (208896->262143) req@ffff9ee36de00380 x1847765451971840/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.719474:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de00380 with x1847765451971840 ext(208896->262143) 00002000:00010000:2.0:1762167010.719481:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de00380 00000100:00100000:2.0:1762167010.719517:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3138 00000100:00100000:2.0:1762167010.719526:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451971840:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:2.0:1762167010.721519:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451971840:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1986us (2181us total) trans 0 rc 53248/53248 00000100:00100000:2.0:1762167010.721533:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3138 00002000:00100000:2.0:1762167010.721546:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (208896->262143) req@ffff9ee36de00380 x1847765451971840/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/440 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 53248/53248 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.721556:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de00380 with x1847765451971840 ext(208896->262143) 00002000:00010000:2.0:1762167010.721562:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de00380 00000100:00100000:1.0:1762167010.724682:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.724797:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451971968 00000100:00100000:2.0:1762167010.724809:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451971968 00002000:00100000:2.0:1762167010.724871:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (237568->262143) req@ffff9ee36de02a00 x1847765451971968/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/0 e 0 to 0 dl 1762167021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.724884:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de02a00 with x1847765451971968 ext(237568->262143) 00002000:00010000:2.0:1762167010.724890:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de02a00 00000100:00100000:2.0:1762167010.724931:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3139 00000100:00100000:2.0:1762167010.724942:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451971968:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:2.0:1762167010.727964:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762167010.728542:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451971968:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 3595us (3864us total) trans 21474843578 rc 0/0 00000100:00100000:2.0:1762167010.728555:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3139 00002000:00100000:2.0:1762167010.728568:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (237568->262143) req@ffff9ee36de02a00 x1847765451971968/t21474843578(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:41/0 lens 488/448 e 0 to 0 dl 1762167021 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167010.728579:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de02a00 with x1847765451971968 ext(237568->262143) 00002000:00010000:2.0:1762167010.728586:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de02a00 00000100:00100000:3.0:1762167010.730218:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.730288:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451972096 00000100:00100000:2.0:1762167010.730297:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451972096 00000100:00100000:2.0:1762167010.730349:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17300 00000100:00100000:2.0:1762167010.730371:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2358:x1847765451972096:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:3.0:1762167010.744901:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843576 is committed 00000001:00080000:3.0:1762167010.744920:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843577 is committed 00000001:00080000:3.0:1762167010.744936:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843578 is committed 00000100:00100000:2.0:1762167010.745052:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451972096:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 14688us (14838us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.745064:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17300 00000100:00100000:1.0:1762167010.747431:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.747523:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451972224 00000100:00100000:2.0:1762167010.747539:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451972224 00000100:00100000:2.0:1762167010.747613:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 19999 00000100:00100000:2.0:1762167010.747625:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451972224:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167010.747648:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167010.747668:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba87 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f49 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.747757:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.747801:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.747813:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167010.747851:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167010.747856:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167010.747874:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.747898:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0ba87 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f49 expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.747915:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f49 expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.747928:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.747932:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167010.747935:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167010.747993:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451972224:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 372us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.748000:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 19999 00000100:00100000:1.0:1762167010.751851:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.752158:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451972480 00000100:00100000:0.0:1762167010.752169:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451972480 00000100:00100000:0.0:1762167010.752225:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7380 00000100:00100000:0.0:1762167010.752236:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451972480:12345-192.168.203.35@tcp:35:fsx.0 00000001:00080000:0.0:1762167010.752529:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953095 00000100:00100000:0.0:1762167010.752658:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765451972480:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 424us (826us total) trans 8589953096 rc 0/0 00000100:00100000:0.0:1762167010.752666:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7380 00000020:00080000:0.0:1762167010.752671:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762167010.762056:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.762157:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451972608 00000100:00100000:0.0:1762167010.762168:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451972608 00000100:00100000:0.0:1762167010.762222:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20000 00000100:00100000:0.0:1762167010.762230:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56220:x1847765451972608:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.762262:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.762283:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0ba95 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f50 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.762346:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ba9c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762369:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ba9c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762380:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ba9c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762395:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0baa3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762401:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0baa3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762408:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0baa3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762517:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0baaa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762531:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0baaa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762538:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0baaa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.762572:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:0.0:1762167010.762575:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167010.762591:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0baaa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762602:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0baaa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762610:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ba9c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762617:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ba9c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762624:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ba9c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762629:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167010.762633:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ba9c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762640:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ba9c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762651:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:0.0:1762167010.762654:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167010.762658:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ba9c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762664:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0ba9c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762677:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0baa3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762682:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0baa3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762687:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0baa3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762692:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167010.762695:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0baa3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762700:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0baa3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762707:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2477ef200) 00010000:00010000:0.0:1762167010.762709:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167010.762711:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0baa3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762716:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0baa3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.762745:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0ba95 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f50 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.762758:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0baaa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f50 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.762818:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167010.762820:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167010.762823:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167010.762889:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56220:x1847765451972608:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 654us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.762896:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20000 00000100:00100000:1.0:1762167010.764952:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.765033:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451972736 00000100:00100000:2.0:1762167010.765044:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451972736 00000100:00100000:2.0:1762167010.765103:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 660 00000100:00100000:2.0:1762167010.765114:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2360:x1847765451972736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.765128:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.765150:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0baaa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f50 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.765168:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.765173:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167010.765216:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765451972736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.765224:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 660 00000100:00100000:3.0:1762167010.765338:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.765390:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451972992 00000100:00100000:0.0:1762167010.765395:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451972992 00000100:00100000:0.0:1762167010.765441:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20001 00000100:00100000:0.0:1762167010.765450:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56220:x1847765451972992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.765465:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.765478:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bab1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f57 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.765572:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.765587:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f49 expref: 900 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.765595:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.765627:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f49 expref: 900 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.765641:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f49 expref: 900 pid: 30817 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1762167010.765658:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454520320:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167010.765712:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167010.766729:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454520320:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167010.766750:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167010.767108:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.767156:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451973120 00000100:00100000:2.0:1762167010.767162:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451973120 00010000:00010000:2.0:1762167010.767188:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f49 expref: 901 pid: 30817 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.767217:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7616 00000100:00100000:2.0:1762167010.767225:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:2360:x1847765451973120:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.767237:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.767243:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f49 expref: 901 pid: 30817 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.767254:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f49 expref: 901 pid: 30817 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.767270:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0ba8e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f49 expref: 901 pid: 30817 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.767283:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.767288:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.767296:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.767310:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.767336:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.767373:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.767382:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167010.767396:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2360:x1847765451973120:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 170us (287us total) trans 0 rc 0/0 00000004:00200000:0.0:1762167010.767397:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000100:00100000:2.0:1762167010.767409:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7616 00010000:00010000:0.0:1762167010.767560:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bab1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f57 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.767575:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f57 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.767583:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167010.767585:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762167010.767588:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167010.767622:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56220:x1847765451972992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2174us (2287us total) trans 8589953097 rc 0/0 00000100:00100000:0.0:1762167010.767629:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20001 00000100:00100000:1.0:1762167010.769945:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.770020:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451973248 00000100:00100000:0.0:1762167010.770028:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451973248 00000100:00100000:0.0:1762167010.770079:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20002 00000100:00100000:0.0:1762167010.770089:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56220:x1847765451973248:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.770108:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.770126:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bac6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f5e expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.770200:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.770226:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f57 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.770235:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.770264:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f57 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.770282:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f57 expref: 901 pid: 30819 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1762167010.770295:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454520448:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167010.770381:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a900 going to sleep for 11 seconds 00000100:00100000:1.0:1762167010.771666:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.771736:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451973376 00000100:00100000:2.0:1762167010.771743:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451973376 00010000:00010000:2.0:1762167010.771814:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f57 expref: 902 pid: 30819 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.771849:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7617 00000100:00100000:2.0:1762167010.771860:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2361:x1847765451973376:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.771875:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.771882:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f57 expref: 902 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.771897:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f57 expref: 902 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.771920:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.771925:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.771934:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.771942:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.771959:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.771991:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bab8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f57 expref: 902 pid: 30819 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.772002:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:2361:x1847765451973376:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 142us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.772012:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b03100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454520448:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167010.772013:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7617 00010000:00010000:0.0:1762167010.772037:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.772051:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.772057:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.772091:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:0.0:1762167010.772096:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167010.772113:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.772141:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bac6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f5e expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.772156:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f5e expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.772163:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167010.772166:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167010.772169:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c200, rc 0) 00000100:00100000:0.0:1762167010.772204:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56220:x1847765451973248:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2117us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.772211:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20002 00000100:00100000:1.0:1762167010.774158:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.774212:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451973632 00000100:00100000:0.0:1762167010.774232:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451973632 00000100:00100000:0.0:1762167010.774283:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20003 00000100:00100000:0.0:1762167010.774290:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56220:x1847765451973632:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.774306:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167010.774319:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0bad4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f65 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.774409:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0badb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.774425:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0badb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.774436:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0badb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167010.774449:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:0.0:1762167010.774573:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0bad4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f65 expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.774592:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0badb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f65 expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.774601:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167010.774603:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167010.774606:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30cc00, rc 0) 00000100:00100000:0.0:1762167010.774661:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56220:x1847765451973632:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 370us (508us total) trans 8589953098 rc 0/0 00000100:00100000:0.0:1762167010.774666:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20003 00000100:00100000:3.0:1762167010.776150:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.776177:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.776199:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.776214:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451973888 00000100:00100000:0.0:1762167010.776222:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451973760 00000100:00100000:2.0:1762167010.776223:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451973888 00000100:00100000:0.0:1762167010.776230:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451973760 00000100:00100000:1.0:1762167010.776253:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451974016 00000100:00100000:1.0:1762167010.776259:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451974016 00000100:00100000:2.0:1762167010.776288:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17301 00000100:00100000:0.0:1762167010.776299:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17302 00000100:00100000:2.0:1762167010.776305:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451973888:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:0.0:1762167010.776315:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451973760:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167010.776316:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17303 00000100:00100000:1.0:1762167010.776332:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451974016:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:0.0:1762167010.776354:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.776365:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.776373:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.776393:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 18 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.776404:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 18 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.776413:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167010.776416:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 35 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.776416:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167010.776422:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.776442:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167010.776445:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167010.776446:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167010.776449:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167010.776452:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.776454:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.776472:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 18 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.776488:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 35 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.776492:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 18 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1762167010.776495:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 18 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.776511:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 35 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1762167010.776524:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 18 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1762167010.776529:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454520576:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167010.776532:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24785ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454520704:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167010.776549:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454520832:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167010.776620:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9300 going to sleep for 11 seconds 00000100:00100000:1.0:1762167010.776621:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1762167010.776621:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a900 going to sleep for 11 seconds 00000100:00100000:0.0:1762167010.777986:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454520576:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167010.777988:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24785ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454520704:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167010.778004:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167010.778019:0:33892:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.778019:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.778041:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.778084:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451974272 00000100:00100000:2.0:1762167010.778086:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454520832:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167010.778089:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451974272 00010000:00010000:2.0:1762167010.778101:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.778115:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 19 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1762167010.778139:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451974144 00000100:00100000:0.0:1762167010.778142:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451974144 00000100:00100000:1.0:1762167010.778151:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.778155:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7618 00010000:00010000:0.0:1762167010.778155:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 36 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.778177:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451974400 00000100:00100000:3.0:1762167010.778178:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451974272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167010.778184:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451974400 00000100:00100000:0.0:1762167010.778189:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7619 00010000:00010000:3.0:1762167010.778195:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762167010.778199:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765451974144:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.778208:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 20 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.778208:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167010.778222:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 36 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167010.778232:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 20 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.778233:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 36 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167010.778244:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7620 00000100:00100000:2.0:1762167010.778264:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451974400:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167010.778265:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 20 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.778273:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0ba33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f1f expref: 36 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167010.778275:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1762167010.778286:0:5742:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167010.778291:0:5742:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00010000:00010000:3.0:1762167010.778292:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0ba3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f26 expref: 20 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.778292:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1762167010.778293:0:5742:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 55 -> 105 00010000:00010000:0.0:1762167010.778296:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.778303:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 20 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.778303:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.778325:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.778325:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.778327:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 19 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167010.778329:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.778336:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.778351:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.778354:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922e00/0xf915a5bdf3d0ba2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f18 expref: 19 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1762167010.778375:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.778386:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.778388:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.778391:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.778392:0:33892:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.778397:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.778402:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.778405:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.778413:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765451974144:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 215us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.778422:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7619 00010000:00010000:2.0:1762167010.778426:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167010.778428:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451974272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 254us (423us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167010.778433:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.778440:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7618 00010000:00010000:1.0:1762167010.778442:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.778450:0:33892:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.778452:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451974400:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 195us (303us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167010.778454:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.778464:0:33892:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167010.778470:0:33892:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.778472:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7620 00010000:00010000:0.0:1762167010.778472:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.778484:0:33892:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.778489:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.778495:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.778497:0:33892:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.778502:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.778515:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167010.778521:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0baf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.778537:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.778538:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.778546:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167010.778551:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.778564:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.778567:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.778574:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.778585:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.778589:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.778591:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.778594:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.778602:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451973888:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2303us (2456us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167010.778605:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.778622:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17301 00010000:00010000:3.0:1762167010.778624:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bae9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.778624:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0baf7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.778697:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451974016:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2369us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167010.778705:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17303 00000100:00100000:3.0:1762167010.778733:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2360:x1847765451973760:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2422us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167010.778743:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17302 00000100:00100000:2.0:1762167010.779791:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.779872:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451974656 00000100:00100000:0.0:1762167010.779879:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451974656 00000100:00100000:0.0:1762167010.779923:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20004 00000100:00100000:0.0:1762167010.779933:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56220:x1847765451974656:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167010.779982:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167010.780004:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bacd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f5e expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.780023:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0ba56 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f34 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.780033:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167010.780037:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167010.780068:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.780079:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167010.780087:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:0.0:1762167010.780678:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5586, 88 off451792 00000004:00080000:0.0:1762167010.780684:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631572921321ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.780742:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5594, 88 off452848 00000004:00080000:0.0:1762167010.780749:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631572985451ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.780815:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5595, 88 off452936 00000004:00080000:0.0:1762167010.780822:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631573058730ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.780858:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5587, 88 off451880 00000004:00080000:0.0:1762167010.780863:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631573100461ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.780885:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5596, 88 off453024 00000004:00080000:0.0:1762167010.780888:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631573125572ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.780915:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5588, 88 off451968 00000004:00080000:0.0:1762167010.780920:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631573157140ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.780950:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5589, 88 off452056 00000004:00080000:0.0:1762167010.780955:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631573192122ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.780980:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5597, 88 off453112 00000004:00080000:0.0:1762167010.780984:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631573220910ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.781005:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5598, 88 off453200 00000004:00080000:0.0:1762167010.781009:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631573246032ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.781028:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5590, 88 off452144 00000004:00080000:0.0:1762167010.781032:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631573269710ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.781061:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5599, 88 off453288 00000004:00080000:0.0:1762167010.781066:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631573303372ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.781094:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5591, 88 off452232 00000004:00080000:0.0:1762167010.781098:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631573335752ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.781121:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5592, 88 off452320 00000004:00080000:0.0:1762167010.781126:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631573363167ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.781149:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5600, 88 off453376 00000004:00080000:0.0:1762167010.781153:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631573390784ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.781180:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5593, 88 off452408 00000004:00080000:0.0:1762167010.781185:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631573422267ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.781211:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5601, 88 off453464 00000004:00080000:0.0:1762167010.781215:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631573452297ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.781239:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5602, 88 off453552 00000004:00080000:0.0:1762167010.781242:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631573479592ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167010.781264:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5594, 88 off452496 00000004:00080000:0.0:1762167010.781267:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631573504440ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.781290:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5595, 88 off452584 00000004:00080000:0.0:1762167010.781294:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631573531660ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167010.781316:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5603, 88 off453640 00000004:00080000:0.0:1762167010.781320:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631573557717ns, next at 630703976179ns, rc = 0 00000004:00010000:0.0:1762167010.793186:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007e17c772 reply state 000000004e13c7b8 transno 8589953099 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762167010.793202:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953099 is committed 00000100:00100000:0.0:1762167010.793202:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:3.0:1762167010.793212:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3714 committed 00000004:00080000:3.0:1762167010.793224:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3701 committed 00000004:00080000:3.0:1762167010.793242:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3700 committed 00000004:00080000:3.0:1762167010.793245:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3713 committed 00000004:00080000:3.0:1762167010.793248:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3712 committed 00000004:00080000:3.0:1762167010.793250:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3699 committed 00000004:00080000:3.0:1762167010.793253:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3711 committed 00000004:00080000:3.0:1762167010.793255:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3698 committed 00000004:00080000:3.0:1762167010.793258:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3697 committed 00000004:00080000:3.0:1762167010.793259:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3710 committed 00000004:00080000:3.0:1762167010.793262:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3696 committed 00000004:00080000:3.0:1762167010.793266:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3709 committed 00000004:00080000:3.0:1762167010.793270:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3708 committed 00000004:00080000:3.0:1762167010.793273:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3695 committed 00000004:00080000:3.0:1762167010.793276:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3694 committed 00000004:00080000:3.0:1762167010.793277:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3707 committed 00000004:00080000:3.0:1762167010.793279:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3693 committed 00000004:00080000:3.0:1762167010.793280:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3706 committed 00000004:00080000:3.0:1762167010.793283:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3705 committed 00000004:00080000:3.0:1762167010.793285:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3692 committed 00010000:00080000:0.0:1762167010.793307:0:30819:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762167010.793331:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56220:x1847765451974656:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 13394us (13537us total) trans 8589953099 rc 0/0 00000100:00100000:0.0:1762167010.793342:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20004 00000100:00100000:1.0:1762167010.793468:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454521344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.793482:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24785bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454520960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.793523:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.793569:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454521856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.793573:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454521344 00000100:00100000:3.0:1762167010.793581:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454521344 00000100:00100000:0.0:1762167010.793586:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.793606:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454521088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.793635:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454520960 00000100:00100000:0.0:1762167010.793635:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454521472:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762167010.793638:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167010.793641:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454520960 00000100:00100000:1.0:1762167010.793644:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167010.793653:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.793661:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167010.793667:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167010.793672:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167010.793676:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454521088 00000100:00100000:1.0:1762167010.793678:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454521600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.793679:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454521088 00010000:00010000:2.0:1762167010.793681:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167010.793687:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167010.793704:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.793708:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762167010.793713:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454521472 00010000:00010000:2.0:1762167010.793713:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167010.793718:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454521472 00000100:00100000:0.0:1762167010.793719:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454521984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.793722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167010.793728:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bafe lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167010.793748:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454521600 00000100:00100000:3.0:1762167010.793751:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454521600 00000100:00100000:1.0:1762167010.793752:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454522112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.793760:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167010.793796:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17304 00000100:00100000:3.0:1762167010.793808:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454521344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.793813:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454522496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.793817:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.793824:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454521984 00000100:00100000:2.0:1762167010.793830:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454521984 00000100:00100000:1.0:1762167010.793839:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454522624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.793851:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.793855:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454522112 00000100:00100000:2.0:1762167010.793860:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454522112 00000100:00100000:2.0:1762167010.793876:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454522496 00000100:00100000:1.0:1762167010.793878:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.793881:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454522496 00000100:00100000:0.0:1762167010.793882:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1762167010.793893:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454522880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.793897:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454522624 00000100:00100000:2.0:1762167010.793901:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454522624 00000100:00100000:1.0:1762167010.793901:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1762167010.793911:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454521216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.793920:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17305 00000100:00100000:0.0:1762167010.793931:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.793932:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3294:x1847765454520960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.793968:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167010.793984:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454522880 00000100:00100000:0.0:1762167010.793989:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454522880 00000100:00100000:1.0:1762167010.793990:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454521728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.794018:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454521216 00000100:00100000:0.0:1762167010.794022:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454521216 00000100:00100000:1.0:1762167010.794028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167010.794038:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167010.794040:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3293:x1847765454521344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 233us (516us total) trans 17179876010 rc 0/0 00002000:00010000:2.0:1762167010.794042:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00000100:00100000:0.0:1762167010.794042:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454521728 00002000:00010000:2.0:1762167010.794046:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1762167010.794047:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454522240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167010.794048:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454521728 00002000:00010000:2.0:1762167010.794049:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000100:00100000:3.0:1762167010.794052:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17304 00002000:00010000:2.0:1762167010.794055:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.794070:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17306 00000100:00100000:3.0:1762167010.794078:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17307 00000100:00100000:0.0:1762167010.794083:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454521088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.794091:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454521472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.794092:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.794097:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454520960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (512us total) trans 17179876011 rc 0/0 00000100:00100000:2.0:1762167010.794104:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17305 00000100:00100000:1.0:1762167010.794113:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454522752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.794118:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454522240 00000100:00100000:2.0:1762167010.794122:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454522240 00000100:00100000:1.0:1762167010.794143:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.794147:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17308 00000100:00100000:2.0:1762167010.794155:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454521600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.794178:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454522752 00000100:00100000:1.0:1762167010.794184:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454522752 00000100:00100000:1.0:1762167010.794211:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17309 00000100:00100000:1.0:1762167010.794220:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454521984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167010.794339:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.794343:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.794345:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167010.794347:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.794350:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.794375:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454521088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 278us (717us total) trans 21474843579 rc 0/0 00000100:00100000:0.0:1762167010.794384:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17306 00000100:00100000:2.0:1762167010.794400:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454521600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 245us (683us total) trans 21474843580 rc 0/0 00000100:00100000:1.0:1762167010.794407:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3294:x1847765454521984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (650us total) trans 17179876012 rc 0/0 00000100:00100000:0.0:1762167010.794409:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17310 00000100:00100000:2.0:1762167010.794419:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17308 00000100:00100000:0.0:1762167010.794424:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454522112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.794428:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17309 00000100:00100000:2.0:1762167010.794441:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17311 00000100:00100000:3.0:1762167010.794443:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454521472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 358us (761us total) trans 21474843581 rc 0/0 00000100:00100000:1.0:1762167010.794450:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17312 00000100:00100000:2.0:1762167010.794451:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454522496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.794456:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17307 00000100:00100000:1.0:1762167010.794465:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3295:x1847765454522624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.794476:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17313 00000100:00100000:3.0:1762167010.794483:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454522880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167010.794609:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.794614:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.794617:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167010.794620:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.794622:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167010.794623:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167010.794630:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.794631:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167010.794636:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167010.794638:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.794640:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000100:00100000:2.0:1762167010.794642:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454522496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (790us total) trans 21474843583 rc 0/0 00002000:00010000:1.0:1762167010.794645:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167010.794646:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167010.794651:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17311 00002000:00010000:1.0:1762167010.794652:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.794656:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.794668:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454522112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 247us (854us total) trans 21474843582 rc 0/0 00000100:00100000:2.0:1762167010.794671:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17314 00000100:00100000:0.0:1762167010.794680:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17310 00000100:00100000:2.0:1762167010.794684:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3295:x1847765454521216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.794686:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3294:x1847765454522880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (757us total) trans 17179876013 rc 0/0 00000100:00100000:3.0:1762167010.794693:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17313 00000100:00100000:1.0:1762167010.794698:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3295:x1847765454522624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (820us total) trans 17179876014 rc 0/0 00000100:00100000:0.0:1762167010.794708:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17315 00000100:00100000:1.0:1762167010.794716:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17312 00000100:00100000:0.0:1762167010.794721:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454521728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.794723:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17316 00000100:00100000:3.0:1762167010.794737:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3295:x1847765454522240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.794741:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17317 00000100:00100000:1.0:1762167010.794753:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454522752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.794821:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454521216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 140us (853us total) trans 17179876015 rc 0/0 00000100:00100000:2.0:1762167010.794827:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17314 00000004:00080000:2.0:1762167010.794878:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242cebb80/2, rc 0, transno 17179876013 00000100:00100000:2.0:1762167010.794891:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454522880:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167010.794901:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:2.0:1762167010.794903:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24785bb80/2, rc 0, transno 17179876011 00002000:00010000:0.0:1762167010.794905:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000100:00100000:2.0:1762167010.794911:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24785bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454520960:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167010.794911:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167010.794917:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:0.0:1762167010.794921:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167010.794931:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3295:x1847765454522240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 196us (843us total) trans 17179876017 rc 0/0 00000100:00100000:2.0:1762167010.794931:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843568 gen 2 00000004:00080000:2.0:1762167010.794936:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b3480, transno 21474843549 00000100:00100000:3.0:1762167010.794938:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17316 00002000:00010000:1.0:1762167010.794940:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 239570 -> 239570 00002000:00010000:1.0:1762167010.794945:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00000004:00080000:2.0:1762167010.794946:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b3800, transno 21474843550 00002000:00010000:1.0:1762167010.794949:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000004:00080000:2.0:1762167010.794952:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b1500, transno 21474843551 00002000:00010000:1.0:1762167010.794954:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00000004:00080000:2.0:1762167010.794959:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b1c00, transno 21474843552 00002000:00010000:1.0:1762167010.794959:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167010.794961:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454521728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (932us total) trans 17179876016 rc 0/0 00000004:00080000:2.0:1762167010.794967:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b0a80, transno 21474843553 00000004:00080000:2.0:1762167010.794972:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b1180, transno 21474843554 00000100:00100000:0.0:1762167010.794973:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17315 00000004:00080000:2.0:1762167010.794975:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b3100, transno 21474843555 00000004:00080000:2.0:1762167010.794979:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b2680, transno 21474843556 00000004:00080000:2.0:1762167010.794985:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d6b480, transno 21474843557 00000004:00080000:2.0:1762167010.794989:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d6ad80, transno 21474843558 00000004:00080000:2.0:1762167010.794993:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d69880, transno 21474843559 00000004:00080000:2.0:1762167010.794997:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d6a680, transno 21474843560 00000100:00100000:1.0:1762167010.795002:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454522752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (858us total) trans 21474843584 rc 0/0 00000004:00080000:2.0:1762167010.795004:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccca80, transno 21474843561 00000004:00080000:2.0:1762167010.795009:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccc700, transno 21474843562 00000004:00080000:2.0:1762167010.795014:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccfb80, transno 21474843563 00000100:00100000:1.0:1762167010.795015:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17317 00000004:00080000:2.0:1762167010.795019:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d6aa00, transno 21474843564 00000004:00080000:2.0:1762167010.795023:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccd180, transno 21474843565 00000004:00080000:2.0:1762167010.795026:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee381d6b800, transno 21474843566 00000004:00080000:2.0:1762167010.795030:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccdf80, transno 21474843567 00000004:00080000:2.0:1762167010.795033:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcce300, transno 21474843568 00000100:00100000:2.0:1762167010.795042:0:3294:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36e473b80 x1847765454521472/t21474843581(21474843581) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167026 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762167010.795051:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167010.795058:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e473b80/2, rc 0, transno 21474843581 00000100:00100000:2.0:1762167010.795063:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454521472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167010.795075:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247859880/2, rc 0, transno 17179876012 00000100:00100000:2.0:1762167010.795079:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454521984:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167010.795093:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b07b80/2, rc 0, transno 21474843583 00000100:00100000:1.0:1762167010.795098:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454522368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.795099:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454522496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.795126:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167010.795168:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247858700/2, rc 0, transno 17179876010 00000100:00100000:1.0:1762167010.795175:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454521344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.795178:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454523008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.795191:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762167010.795201:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454523136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167010.795207:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167010.795233:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167010.795249:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454521856 00000100:00100000:2.0:1762167010.795254:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454521856 00000100:00100000:1.0:1762167010.795269:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454522368 00000100:00100000:1.0:1762167010.795275:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454522368 00000100:00100000:2.0:1762167010.795281:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454523008 00000100:00100000:2.0:1762167010.795285:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454523008 00000100:00100000:1.0:1762167010.795304:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454523136 00000100:00100000:1.0:1762167010.795309:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454523136 00000100:00100000:2.0:1762167010.795313:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17318 00000100:00100000:2.0:1762167010.795323:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454521856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.795338:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17319 00000100:00100000:1.0:1762167010.795347:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454522368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167010.795430:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17320 00000100:00100000:0.0:1762167010.795439:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3294:x1847765454523008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167010.795488:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167010.795494:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454521856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (442us total) trans 21474843585 rc 0/0 00002000:00010000:1.0:1762167010.795494:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.795499:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167010.795505:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:1.0:1762167010.795511:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167010.795516:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17318 00000100:00100000:2.0:1762167010.795537:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17321 00000100:00100000:1.0:1762167010.795543:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454522368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (415us total) trans 21474843586 rc 0/0 00000100:00100000:0.0:1762167010.795544:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3294:x1847765454523008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (337us total) trans 17179876018 rc 0/0 00000100:00100000:2.0:1762167010.795549:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3296:x1847765454523136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.795555:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17319 00000100:00100000:0.0:1762167010.795560:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17320 00002000:00010000:2.0:1762167010.795653:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167010.795656:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.795659:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167010.795661:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:2.0:1762167010.795664:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167010.795697:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3296:x1847765454523136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (466us total) trans 17179876019 rc 0/0 00000100:00100000:2.0:1762167010.795704:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17321 00000004:00080000:2.0:1762167010.795739:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242ce8000/2, rc 0, transno 17179876019 00000100:00100000:2.0:1762167010.795744:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454523136:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167010.795808:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242ce9880/2, rc 0, transno 17179876018 00000100:00100000:2.0:1762167010.795814:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454523008:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167010.795821:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 6 in flight, 20 done 00000100:00100000:0.0:1762167010.795821:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.795860:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454523264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167010.795879:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454523392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167010.795892:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167010.795917:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454523264 00000100:00100000:3.0:1762167010.795923:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454523264 00000004:00080000:1.0:1762167010.795929:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24785b800/2, rc 0, transno 17179876015 00000100:00100000:1.0:1762167010.795937:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454521216:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167010.795950:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247858e00/2, rc 0, transno 17179876016 00000100:00100000:1.0:1762167010.795955:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454521728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.795963:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17322 00000004:00080000:1.0:1762167010.795969:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247859c00/2, rc 0, transno 17179876017 00000100:00100000:1.0:1762167010.795976:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454522240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167010.795977:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454523264:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167010.795992:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b05c00/2, rc 0, transno 21474843584 00000100:00100000:1.0:1762167010.795997:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454522752:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167010.796006:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc7b80/2, rc 0, transno 21474843579 00000100:00100000:1.0:1762167010.796009:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454521088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167010.796020:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e472a00/2, rc 0, transno 21474843580 00000100:00100000:1.0:1762167010.796024:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454521600:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167010.796033:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b06680/2, rc 0, transno 21474843582 00000100:00100000:1.0:1762167010.796036:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454522112:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167010.796044:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247858a80/2, rc 0, transno 17179876014 00000100:00100000:1.0:1762167010.796047:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454522624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167010.796064:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167010.796101:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e471880/2, rc 0, transno 21474843585 00000100:00100000:1.0:1762167010.796106:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454521856:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167010.796107:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167010.796108:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454523392 00000100:00100000:0.0:1762167010.796113:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454523392 00002000:00010000:3.0:1762167010.796114:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.796119:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000004:00080000:1.0:1762167010.796119:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b04e00/2, rc 0, transno 21474843586 00000100:00100000:1.0:1762167010.796125:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454522368:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167010.796131:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167010 00002000:00010000:3.0:1762167010.796134:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167010.796147:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17323 00000100:00100000:0.0:1762167010.796158:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454523392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.796179:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454523264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (287us total) trans 21474843587 rc 0/0 00000100:00100000:3.0:1762167010.796188:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17322 00000004:00080000:3.0:1762167010.796222:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee359065f80/2, rc 0, transno 21474843587 00000100:00100000:3.0:1762167010.796228:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454523264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167010.796248:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451974784 00000100:00100000:3.0:1762167010.796252:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451974784 00000100:00100000:0.0:1762167010.796287:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454523392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (221us total) trans 21474843588 rc 0/0 00000100:00100000:3.0:1762167010.796290:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20005 00000100:00100000:0.0:1762167010.796301:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17323 00000004:00080000:1.0:1762167010.796302:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee359064700/2, rc 0, transno 21474843588 00000100:00100000:3.0:1762167010.796303:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56220:x1847765451974784:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:1.0:1762167010.796312:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454523392:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167010.796321:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167010.796338:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bb05 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f6c expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.796400:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bb05 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f6c expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.796419:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bb05 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f6c expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.796437:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167010.796440:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167010.796443:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:3.0:1762167010.796489:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56220:x1847765451974784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 190us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167010.796495:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20005 00000100:00100000:2.0:1762167010.798521:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.798624:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451974912 00000100:00100000:3.0:1762167010.798632:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451974912 00000100:00100000:3.0:1762167010.798688:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20006 00000100:00100000:3.0:1762167010.798697:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56220:x1847765451974912:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167010.798714:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167010.798731:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bb0c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f73 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.798848:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0bb13 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.798863:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0bb13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.798874:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0bb13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167010.798903:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:3.0:1762167010.798913:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167010.798932:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0bb13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167010.798958:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bb0c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f73 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.798976:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0bb13 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f73 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.798985:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167010.798988:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167010.798991:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:3.0:1762167010.799048:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56220:x1847765451974912:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 351us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167010.799055:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20006 00000100:00100000:2.0:1762167010.800876:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.800907:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.800925:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451975040 00000100:00100000:2.0:1762167010.800933:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.800936:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451975040 00000100:00100000:0.0:1762167010.800989:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451975168 00000100:00100000:1.0:1762167010.800990:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451975296 00000100:00100000:0.0:1762167010.800993:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451975168 00000100:00100000:1.0:1762167010.800999:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451975296 00000100:00100000:2.0:1762167010.801005:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17324 00000100:00100000:2.0:1762167010.801018:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451975040:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:0.0:1762167010.801031:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17325 00010000:00010000:2.0:1762167010.801037:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167010.801044:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17326 00000100:00100000:0.0:1762167010.801044:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765451975168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.801055:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167010.801058:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0bb1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f7a expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.801064:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765451975296:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167010.801068:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bb21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f81 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.801080:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1762167010.801091:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888e2, ctime: 0x690888e3, blocks: 0x69 00002000:00010000:0.0:1762167010.801093:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888e2, atime: 0x690888e2, ctime: 0x690888e2, blocks: 0x3 00010000:00010000:3.0:1762167010.801095:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bb28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f88 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.801111:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.801112:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.801115:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1762167010.801116:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888e2, atime: 0x690888e2, ctime: 0x690888e2, blocks: 0x3 00010000:00010000:2.0:1762167010.801117:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.801126:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f81 expref: 35 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167010.801128:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0bb1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f7a expref: 18 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167010.801130:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.801134:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.801143:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bb28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f88 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167010.801148:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f81 expref: 35 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167010.801152:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0bb1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f7a expref: 18 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167010.801160:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bb28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f88 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167010.801174:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c200, rc 0) 00010000:00010000:2.0:1762167010.801178:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00010000:00010000:3.0:1762167010.801179:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:0.0:1762167010.801297:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765451975168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 251us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167010.801298:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2358:x1847765451975296:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 236us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.801298:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451975040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 278us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167010.801317:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17326 00000100:00100000:0.0:1762167010.801324:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17325 00000100:00100000:2.0:1762167010.801332:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17324 00000100:00100000:0.0:1762167010.829616:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.829743:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451975424 00000100:00100000:2.0:1762167010.829809:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451975424 00000100:00100000:2.0:1762167010.829909:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3140 00000100:00100000:2.0:1762167010.829925:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451975424:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167010.829977:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb2f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.829995:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.829998:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.830004:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.830019:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.833272:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.833287:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.833295:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.833301:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.833306:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.833313:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.833338:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.833344:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.833431:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451975424:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3508us (3824us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1762167010.833441:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3140 00000100:00100000:3.0:1762167010.835708:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.835792:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451975552 00000100:00100000:2.0:1762167010.835802:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451975552 00000100:00100000:2.0:1762167010.835894:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3141 00000100:00100000:2.0:1762167010.835905:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451975552:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167010.835961:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 239570, mtime: 0x690888e2, atime: 0x690888d5, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:2.0:1762167010.835970:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bb36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.835984:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.835986:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.835992:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bb36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.836005:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bb36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.851581:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876018 is committed 00000001:00080000:1.0:1762167010.851610:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875983 is committed 00002000:00010000:3.0:1762167010.851621:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 239570 -> 262144 00000001:00080000:1.0:1762167010.851623:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876007 is committed 00002000:00010000:3.0:1762167010.851629:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:3.0:1762167010.851634:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00010000:00010000:3.0:1762167010.851650:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bb36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.851654:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876020 is committed 00010000:00010000:3.0:1762167010.851665:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bb36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.851668:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876019 is committed 00010000:00010000:3.0:1762167010.851678:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bb36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.851686:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.851692:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bb36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.851702:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bb36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.851723:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bb36 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.851735:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bb36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.851902:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765451975552:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 15994us (16199us total) trans 17179876020 rc 0/0 00000100:00100000:3.0:1762167010.851913:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3141 00000100:00100000:0.0:1762167010.854757:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.854841:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451975680 00000100:00100000:3.0:1762167010.854852:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451975680 00000100:00100000:3.0:1762167010.854926:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3142 00000100:00100000:3.0:1762167010.854937:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451975680:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167010.854984:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 239570, mtime: 0x690888e2, atime: 0x690888db, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167010.854993:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.855005:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.855007:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.855011:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.855023:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.868647:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843588 is committed 00000001:00080000:1.0:1762167010.868686:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843589 is committed 00002000:00010000:3.0:1762167010.868739:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 239570 -> 262144 00002000:00010000:3.0:1762167010.868744:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:3.0:1762167010.868746:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00010000:00010000:3.0:1762167010.868759:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.868810:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.868819:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.868826:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.868839:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.868849:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.868872:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.868883:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.869002:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451975680:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14062us (14248us total) trans 21474843589 rc 0/0 00000100:00100000:3.0:1762167010.869014:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3142 00000100:00100000:1.0:1762167010.871850:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.871912:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451975808 00000100:00100000:3.0:1762167010.871922:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451975808 00000100:00100000:3.0:1762167010.871998:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3143 00000100:00100000:3.0:1762167010.872005:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451975808:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167010.872050:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 239570, mtime: 0x690888e2, atime: 0x690888db, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167010.872061:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.872075:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.872077:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.872083:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.872097:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.887651:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876021 is committed 00002000:00010000:3.0:1762167010.887710:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 239570 -> 262144 00002000:00010000:3.0:1762167010.887716:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:3.0:1762167010.887718:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00010000:00010000:3.0:1762167010.887729:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.887739:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.887748:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.887755:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.887794:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.887803:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.887827:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.887834:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.887928:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451975808:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 15920us (16081us total) trans 17179876021 rc 0/0 00000100:00100000:3.0:1762167010.887939:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3143 00000100:00100000:0.0:1762167010.891068:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.891121:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451975936 00000100:00100000:3.0:1762167010.891132:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451975936 00000100:00100000:3.0:1762167010.891211:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3144 00000100:00100000:3.0:1762167010.891222:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451975936:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167010.891290:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 239570, mtime: 0x690888e2, atime: 0x690888dd, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167010.891299:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.891312:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.891314:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.891319:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.891334:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.907113:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876022 is committed 00002000:00010000:3.0:1762167010.907131:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 239570 -> 262144 00002000:00010000:3.0:1762167010.907137:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:3.0:1762167010.907141:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00010000:00010000:3.0:1762167010.907155:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.907167:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.907177:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.907183:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167010.907188:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.907197:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.907215:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.907221:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bb4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167010.907316:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451975936:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16093us (16253us total) trans 17179876022 rc 0/0 00000100:00100000:3.0:1762167010.907327:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3144 00000100:00100000:1.0:1762167010.910739:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167010.910885:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451976064 00000100:00100000:3.0:1762167010.910898:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451976064 00000100:00100000:3.0:1762167010.910970:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3145 00000100:00100000:3.0:1762167010.910981:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451976064:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167010.911035:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 239570, mtime: 0x690888e2, atime: 0x690888dd, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:3.0:1762167010.911045:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.911059:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.911062:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167010.911069:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.911083:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.923622:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843590 is committed 00002000:00010000:2.0:1762167010.923634:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 239570 -> 262144 00002000:00010000:2.0:1762167010.923641:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167010.923644:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00010000:00010000:2.0:1762167010.923658:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.923670:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.923679:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.923686:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.923691:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.923700:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.923718:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.923725:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0bb52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.923865:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451976064:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 12882us (13130us total) trans 21474843590 rc 0/0 00000100:00100000:2.0:1762167010.923876:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3145 00000100:00100000:1.0:1762167010.926567:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.926619:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451976192 00000100:00100000:2.0:1762167010.926631:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451976192 00000100:00100000:2.0:1762167010.926702:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3146 00000100:00100000:2.0:1762167010.926714:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451976192:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:2.0:1762167010.926790:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.926810:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ba10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f0a expref: 17 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167010.926818:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.926820:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.926823:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.926864:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ba10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f0a expref: 17 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167010.926878:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ba10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f0a expref: 17 pid: 6532 timeout: 731 lvb_type: 1 00000100:00100000:2.0:1762167010.926893:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454523520:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167010.926958:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34392ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167010.928139:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454523520:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167010.928164:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167010.928387:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.928470:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451976320 00000100:00100000:2.0:1762167010.928476:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451976320 00010000:00010000:2.0:1762167010.928506:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ba10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f0a expref: 18 pid: 6532 timeout: 731 lvb_type: 1 00000100:00100000:2.0:1762167010.928540:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7621 00000100:00100000:2.0:1762167010.928548:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765451976320:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167010.928562:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.928585:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ba10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f0a expref: 18 pid: 6532 timeout: 731 lvb_type: 1 00010000:00010000:2.0:1762167010.928598:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ba10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f0a expref: 18 pid: 6532 timeout: 731 lvb_type: 1 00010000:00010000:2.0:1762167010.928623:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0ba10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f0a expref: 18 pid: 6532 timeout: 731 lvb_type: 1 00010000:00010000:2.0:1762167010.928641:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.928644:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.928647:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.928656:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.928683:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167010.928720:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167010.928731:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.928733:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451976320:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 185us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.928751:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7621 00000001:00080000:1.0:1762167010.944343:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843591 is committed 00002000:00010000:2.0:1762167010.944350:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 239570 -> 262144 00002000:00010000:2.0:1762167010.944366:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167010.944369:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00010000:00010000:2.0:1762167010.944387:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.944398:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.944407:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.944420:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.944425:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.944438:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.944458:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.944466:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.944571:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451976192:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 17855us (18008us total) trans 21474843591 rc 0/0 00000100:00100000:2.0:1762167010.944583:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3146 00000100:00100000:1.0:1762167010.947345:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.947408:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451976448 00000100:00100000:2.0:1762167010.947420:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451976448 00000100:00100000:2.0:1762167010.947501:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3147 00000100:00100000:2.0:1762167010.947512:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451976448:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167010.947570:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 239570, mtime: 0x690888e2, atime: 0x690888de, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:2.0:1762167010.947579:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.947593:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.947596:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.947601:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.947616:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.961728:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876023 is committed 00002000:00010000:0.0:1762167010.961787:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 239570 -> 262144 00002000:00010000:0.0:1762167010.961792:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:0.0:1762167010.961795:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00010000:00010000:0.0:1762167010.961810:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.961822:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.961830:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.961848:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167010.961852:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.961864:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.961885:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.961893:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167010.962000:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451976448:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14484us (14655us total) trans 17179876023 rc 0/0 00000100:00100000:0.0:1762167010.962011:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3147 00000100:00100000:1.0:1762167010.965533:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167010.965624:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451976576 00000100:00100000:0.0:1762167010.965635:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451976576 00000100:00100000:0.0:1762167010.965717:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3148 00000100:00100000:0.0:1762167010.965728:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451976576:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167010.965828:0:14118:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 239570, mtime: 0x690888e2, atime: 0x690888e0, ctime: 0x690888e2, blocks: 0x203 00010000:00010000:0.0:1762167010.965838:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bb67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.965852:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.965854:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167010.965860:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bb67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167010.965874:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bb67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167010.985121:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843592 is committed 00002000:00010000:2.0:1762167010.985190:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 239570 -> 262144 00002000:00010000:2.0:1762167010.985196:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167010.985199:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00010000:00010000:2.0:1762167010.985216:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bb67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.985227:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bb67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.985236:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bb67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.985243:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167010.985248:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bb67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.985256:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bb67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.985275:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bb67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.985282:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bb67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167010.985404:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451976576:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 19673us (19877us total) trans 21474843592 rc 0/0 00000100:00100000:2.0:1762167010.985415:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3148 00000100:00100000:3.0:1762167010.995365:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167010.995478:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451976832 00000100:00100000:2.0:1762167010.995494:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451976832 00000100:00100000:2.0:1762167010.995569:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20007 00000100:00100000:2.0:1762167010.995581:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56220:x1847765451976832:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167010.995651:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167010.995698:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0bb13 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f73 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.995723:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167010.995728:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167010.996107:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.996122:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167010.996132:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167010.996187:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953100 00000004:00010000:2.0:1762167010.996210:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b7087c41 reply state 00000000cc7cde47 transno 8589953101 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167010.996219:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167010.996320:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56220:x1847765451976832:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 741us (979us total) trans 8589953101 rc 0/0 00000100:00100000:2.0:1762167010.996330:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20007 00000020:00080000:2.0:1762167010.996336:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167010.998406:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167010.998425:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167010.998427:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.998438:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.998445:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167010.998454:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.998464:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.998487:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167010.998491:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167010.998497:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167010.998503:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bb6e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167010.998509:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451976960 00000100:00100000:2.0:1762167010.998520:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451976960 00000100:00100000:2.0:1762167010.998579:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17327 00000100:00100000:2.0:1762167010.998590:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56220:x1847765451976960:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167010.998609:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167010.998631:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bb75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f8f expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167010.998654:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888d5, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:2.0:1762167010.998675:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.998677:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167010.998684:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bb75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f8f expref: 23 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.998697:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bb75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f8f expref: 23 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167010.998707:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d400, rc 0) 00000100:00100000:2.0:1762167010.998783:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56220:x1847765451976960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 195us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167010.998790:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17327 00000100:00100000:1.0:1762167011.003728:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.003818:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.004022:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451977216 00000100:00100000:2.0:1762167011.004037:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451977216 00002000:00010000:2.0:1762167011.004124:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.004130:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359064000 with x1847765451977216 ext(0->18446744073709551615) 00000100:00080000:1.0:1762167011.004133:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1762167011.004150:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359064000. 00000100:00100000:2.0:1762167011.004191:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451977088 00000100:00100000:2.0:1762167011.004195:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451977088 00002000:00010000:2.0:1762167011.004221:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (262144->18446744073709551615) 00002000:00100000:2.0:1762167011.004226:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359064e00 with x1847765451977088 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.004235:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359064e00. 00000100:00080000:1.0:1762167011.004245:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762167011.004267:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3149 00000100:00100000:3.0:1762167011.004280:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3150 00000100:00100000:2.0:1762167011.004281:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451977216:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167011.004299:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765451977088:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167011.004813:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762167011.004818:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.004821:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167011.004822:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.004824:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167011.004827:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.004832:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.004834:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167011.004836:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.004838:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.004988:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451977088:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 689us (1164us total) trans 17179876024 rc 0/0 00000100:00100000:2.0:1762167011.004989:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451977216:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 705us (1270us total) trans 21474843593 rc 0/0 00000100:00100000:3.0:1762167011.005008:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3150 00002000:00010000:3.0:1762167011.005013:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (262144->18446744073709551615) 00002000:00100000:3.0:1762167011.005016:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359064e00 with x1847765451977088 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762167011.005021:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359064e00. 00000100:00100000:2.0:1762167011.005229:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3149 00002000:00010000:2.0:1762167011.005235:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.005238:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359064000 with x1847765451977216 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.005243:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee359064000. 00000100:00100000:3.0:1762167011.008080:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.008168:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451977344 00000100:00100000:2.0:1762167011.008181:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451977344 00000100:00080000:1.0:1762167011.008241:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762167011.008369:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20008 00000100:00100000:2.0:1762167011.008383:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56220:x1847765451977344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.008415:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.008439:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb7c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f96 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.008548:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bb83 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.008564:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bb83 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.008577:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bb83 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167011.008622:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.008627:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.008644:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bb83 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.008674:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb7c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f96 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.008712:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bb83 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f96 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.008724:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.008727:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.008731:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167011.008856:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56220:x1847765451977344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 474us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.008865:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20008 00000100:00100000:1.0:1762167011.011392:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.011491:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451977600 00000100:00100000:2.0:1762167011.011501:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451977600 00000100:00100000:2.0:1762167011.011558:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20009 00000100:00100000:2.0:1762167011.011567:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56220:x1847765451977600:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.011622:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.011648:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bb83 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f96 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.011668:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.011672:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.011942:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.011954:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.011962:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167011.012003:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953102 00000004:00010000:2.0:1762167011.012026:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005e235a9f reply state 000000004014e35f transno 8589953103 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167011.012036:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.012148:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56220:x1847765451977600:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 582us (766us total) trans 8589953103 rc 0/0 00000100:00100000:2.0:1762167011.012155:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20009 00000020:00080000:2.0:1762167011.012161:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167011.013339:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.013352:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.013370:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.013379:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.013383:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.013389:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.013403:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.013405:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.013408:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.013412:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bb8a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167011.014572:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.014716:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451977728 00000100:00100000:2.0:1762167011.014728:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451977728 00000100:00100000:2.0:1762167011.014883:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17328 00000100:00100000:2.0:1762167011.014897:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56220:x1847765451977728:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.014919:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.015057:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3f9d expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167011.015086:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888db, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:2.0:1762167011.015111:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.015114:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.015122:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f9d expref: 18 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.015146:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f9d expref: 18 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.015159:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:2.0:1762167011.015222:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56220:x1847765451977728:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 328us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.015229:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17328 00000100:00100000:3.0:1762167011.016812:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.016849:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.016935:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451977856 00000100:00100000:0.0:1762167011.016946:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451977856 00002000:00010000:0.0:1762167011.016999:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (262144->18446744073709551615) 00002000:00100000:0.0:1762167011.017006:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348257480 with x1847765451977856 ext(262144->18446744073709551615) 00002000:00010000:0.0:1762167011.017020:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348257480. 00000100:00100000:2.0:1762167011.017025:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451977984 00000100:00100000:2.0:1762167011.017041:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451977984 00000100:00100000:0.0:1762167011.017070:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3151 00000100:00100000:0.0:1762167011.017087:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451977856:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167011.017096:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.017104:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348256300 with x1847765451977984 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.017120:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee348256300. 00000100:00100000:2.0:1762167011.017170:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3152 00000100:00100000:2.0:1762167011.017189:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451977984:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167011.017523:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762167011.017531:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.017534:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167011.017537:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.017541:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167011.017624:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.017629:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.017634:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167011.017641:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451977856:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 553us (870us total) trans 21474843594 rc 0/0 00002000:00010000:2.0:1762167011.017644:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.017653:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.017672:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3151 00002000:00010000:0.0:1762167011.017680:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (262144->18446744073709551615) 00002000:00100000:0.0:1762167011.017684:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348257480 with x1847765451977856 ext(262144->18446744073709551615) 00002000:00010000:0.0:1762167011.017694:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348257480. 00000100:00100000:2.0:1762167011.017731:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765451977984:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 538us (868us total) trans 17179876025 rc 0/0 00000100:00100000:2.0:1762167011.017743:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3152 00002000:00010000:2.0:1762167011.017748:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.017751:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348256300 with x1847765451977984 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.017758:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee348256300. 00000100:00100000:3.0:1762167011.021594:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.021726:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451978112 00000100:00100000:2.0:1762167011.021752:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451978112 00000100:00100000:2.0:1762167011.021888:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20010 00000100:00100000:2.0:1762167011.021901:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56220:x1847765451978112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.021934:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.021977:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bb98 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fa4 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.022088:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb9f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.022108:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.022123:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167011.022160:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.022166:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.022188:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.022222:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bb98 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fa4 expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.022245:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb9f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fa4 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.022254:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.022258:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.022263:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:2.0:1762167011.022350:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56220:x1847765451978112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 452us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.022369:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20010 00000100:00100000:1.0:1762167011.025583:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.025653:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451978368 00000100:00100000:3.0:1762167011.025665:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451978368 00000100:00100000:3.0:1762167011.025725:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20011 00000100:00100000:3.0:1762167011.025737:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56220:x1847765451978368:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167011.025825:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.025860:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bb9f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fa4 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.025880:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167011.025885:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167011.026102:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.026118:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.026127:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762167011.026185:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953104 00000004:00010000:3.0:1762167011.026212:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c05268f7 reply state 000000001a8f3845 transno 8589953105 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167011.026221:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167011.026333:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56220:x1847765451978368:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 597us (759us total) trans 8589953105 rc 0/0 00000100:00100000:3.0:1762167011.026341:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20011 00000020:00080000:3.0:1762167011.026347:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167011.027639:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.027654:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.027662:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.027667:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167011.027672:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.027679:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.027692:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167011.027695:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167011.027699:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.027704:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0bba6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167011.027932:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.028053:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451978496 00000100:00100000:2.0:1762167011.028061:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451978496 00000100:00100000:2.0:1762167011.028111:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17329 00000100:00100000:2.0:1762167011.028132:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56220:x1847765451978496:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.028151:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.028169:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bbad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fab expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167011.028193:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888db, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:2.0:1762167011.028216:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.028219:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.028226:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bbad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fab expref: 26 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.028241:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bbad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fab expref: 26 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.028250:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167011.028307:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56220:x1847765451978496:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 186us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.028315:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17329 00000100:00100000:1.0:1762167011.029586:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.029625:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.029640:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451978624 00000100:00100000:2.0:1762167011.029646:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451978624 00000100:00100000:0.0:1762167011.029676:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451978752 00002000:00010000:2.0:1762167011.029679:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (262144->18446744073709551615) 00000100:00100000:0.0:1762167011.029683:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451978752 00002000:00100000:2.0:1762167011.029685:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0a80 with x1847765451978624 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.029696:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b0a80. 00002000:00010000:0.0:1762167011.029705:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167011.029711:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b1180 with x1847765451978752 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167011.029720:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b1180. 00000100:00100000:2.0:1762167011.029726:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3153 00000100:00100000:2.0:1762167011.029738:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451978624:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167011.029798:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3154 00000100:00100000:1.0:1762167011.029812:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451978752:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167011.030065:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762167011.030067:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.030069:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.030072:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.030073:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167011.030080:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.030080:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167011.030086:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167011.030087:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00002000:00010000:1.0:1762167011.030091:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.030135:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451978624:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 401us (554us total) trans 17179876026 rc 0/0 00000100:00100000:2.0:1762167011.030145:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3153 00000100:00100000:1.0:1762167011.030145:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451978752:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 336us (518us total) trans 21474843595 rc 0/0 00002000:00010000:2.0:1762167011.030149:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (262144->18446744073709551615) 00002000:00100000:2.0:1762167011.030155:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b0a80 with x1847765451978624 ext(262144->18446744073709551615) 00000100:00100000:1.0:1762167011.030158:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3154 00002000:00010000:2.0:1762167011.030163:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b0a80. 00002000:00010000:1.0:1762167011.030163:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:1.0:1762167011.030170:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b1180 with x1847765451978752 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167011.030176:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b1180. 00000100:00100000:0.0:1762167011.031393:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.031443:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451978880 00000100:00100000:3.0:1762167011.031450:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451978880 00000100:00100000:3.0:1762167011.031511:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20012 00000100:00100000:3.0:1762167011.031520:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56220:x1847765451978880:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167011.031549:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.031568:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bbb4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fb2 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.031644:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bbbb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.031664:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bbbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.031677:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bbbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167011.031707:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:3.0:1762167011.031712:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167011.031728:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bbbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.031754:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bbb4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb2 expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.031799:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bbbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb2 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.031808:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167011.031811:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167011.031815:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:3.0:1762167011.031861:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56220:x1847765451978880:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 343us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.031868:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20012 00000100:00100000:0.0:1762167011.033596:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.033685:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451979136 00000100:00100000:3.0:1762167011.033694:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451979136 00000100:00100000:3.0:1762167011.033757:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20013 00000100:00100000:3.0:1762167011.033796:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56220:x1847765451979136:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167011.033852:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.033883:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bbbb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb2 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.033903:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167011.033907:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167011.034126:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.034140:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.034149:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762167011.034201:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953106 00000004:00010000:3.0:1762167011.034233:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002f34fe20 reply state 000000006998d5ba transno 8589953107 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167011.034253:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167011.034346:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56220:x1847765451979136:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 580us (757us total) trans 8589953107 rc 0/0 00000100:00100000:3.0:1762167011.034366:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20013 00000020:00080000:3.0:1762167011.034374:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167011.035279:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.035291:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.035298:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.035303:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.035308:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.035327:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.035343:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.035346:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.035349:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.035366:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bbc2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.035603:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.035647:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451979264 00000100:00100000:2.0:1762167011.035654:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451979264 00000100:00100000:2.0:1762167011.035698:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17330 00000100:00100000:2.0:1762167011.035709:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56220:x1847765451979264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.035721:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.035738:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bbc9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fb9 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167011.035759:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888dd, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:2.0:1762167011.035802:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.035805:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.035812:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bbc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb9 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.035826:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bbc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb9 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.035837:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00000100:00100000:2.0:1762167011.035886:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56220:x1847765451979264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 179us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.035893:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17330 00000100:00100000:1.0:1762167011.037165:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.037199:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.037216:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451979392 00000100:00100000:3.0:1762167011.037223:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451979392 00000100:00100000:2.0:1762167011.037238:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451979520 00000100:00100000:2.0:1762167011.037243:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451979520 00002000:00010000:3.0:1762167011.037255:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (262144->18446744073709551615) 00002000:00010000:2.0:1762167011.037259:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:3.0:1762167011.037261:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b3100 with x1847765451979392 ext(262144->18446744073709551615) 00002000:00100000:2.0:1762167011.037264:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b2680 with x1847765451979520 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.037276:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b2680. 00002000:00010000:3.0:1762167011.037277:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b3100. 00000100:00100000:2.0:1762167011.037312:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3155 00000100:00100000:2.0:1762167011.037324:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451979520:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167011.037329:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3156 00000100:00100000:3.0:1762167011.037340:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451979392:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167011.037673:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762167011.037673:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.037679:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:3.0:1762167011.037681:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.037685:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167011.037690:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00002000:00010000:3.0:1762167011.037691:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167011.037693:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167011.037696:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.037700:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167011.037758:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451979520:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 434us (555us total) trans 21474843596 rc 0/0 00000100:00100000:3.0:1762167011.037759:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451979392:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 417us (594us total) trans 17179876027 rc 0/0 00000100:00100000:3.0:1762167011.037806:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3156 00002000:00010000:3.0:1762167011.037811:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (262144->18446744073709551615) 00002000:00100000:3.0:1762167011.037813:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b3100 with x1847765451979392 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762167011.037817:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b3100. 00000100:00100000:2.0:1762167011.037863:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3155 00002000:00010000:2.0:1762167011.037867:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.037870:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b2680 with x1847765451979520 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.037875:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b2680. 00000100:00100000:0.0:1762167011.040187:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.040257:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451979648 00000100:00100000:3.0:1762167011.040266:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451979648 00000100:00100000:3.0:1762167011.040319:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20014 00000100:00100000:3.0:1762167011.040329:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56220:x1847765451979648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167011.040352:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.040400:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bbd0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fc0 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.040485:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bbd7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.040500:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.040511:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167011.040539:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:3.0:1762167011.040543:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167011.040559:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.040583:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bbd0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc0 expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.040600:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc0 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.040608:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167011.040611:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167011.040614:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:3.0:1762167011.040672:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56220:x1847765451979648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 344us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.040680:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20014 00000100:00100000:0.0:1762167011.042607:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.042657:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451979904 00000100:00100000:3.0:1762167011.042663:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451979904 00000100:00100000:2.0:1762167011.042729:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20015 00000100:00100000:2.0:1762167011.042742:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56220:x1847765451979904:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.042832:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.042855:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bbd7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc0 expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.042871:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.042875:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.043082:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.043094:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.043103:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167011.043172:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953108 00000004:00010000:2.0:1762167011.043195:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003cf78471 reply state 000000000588efe3 transno 8589953109 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167011.043203:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.043296:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56220:x1847765451979904:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 557us (695us total) trans 8589953109 rc 0/0 00000100:00100000:2.0:1762167011.043302:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20015 00000020:00080000:2.0:1762167011.043308:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167011.044267:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.044278:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.044285:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.044291:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167011.044349:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.044368:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.044385:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167011.044389:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167011.044393:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.044400:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bbde lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167011.044447:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.044516:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451980032 00000100:00100000:2.0:1762167011.044524:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451980032 00000100:00100000:2.0:1762167011.044573:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17331 00000100:00100000:2.0:1762167011.044588:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56220:x1847765451980032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.044603:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.044633:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bbe5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fc7 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167011.044660:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888dd, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:2.0:1762167011.044679:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.044682:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.044689:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bbe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc7 expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.044709:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bbe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc7 expref: 22 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.044720:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167011.044805:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56220:x1847765451980032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 219us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.044814:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17331 00000100:00100000:1.0:1762167011.046001:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.046042:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.046044:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451980160 00000100:00100000:2.0:1762167011.046052:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451980160 00002000:00010000:2.0:1762167011.046083:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (262144->18446744073709551615) 00002000:00100000:2.0:1762167011.046088:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6b480 with x1847765451980160 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.046097:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d6b480. 00000100:00100000:3.0:1762167011.046127:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451980288 00000100:00100000:3.0:1762167011.046133:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451980288 00000100:00100000:2.0:1762167011.046141:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3157 00002000:00010000:3.0:1762167011.046152:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00000100:00100000:2.0:1762167011.046154:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451980160:12345-192.168.203.35@tcp:10:lfs.0 00002000:00100000:3.0:1762167011.046158:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6ad80 with x1847765451980288 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167011.046167:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d6ad80. 00000100:00100000:3.0:1762167011.046193:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3158 00000100:00100000:3.0:1762167011.046203:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451980288:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167011.046504:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.046504:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762167011.046511:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.046512:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.046517:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167011.046519:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167011.046523:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.046524:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.046529:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167011.046531:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167011.046592:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451980160:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 440us (593us total) trans 21474843597 rc 0/0 00000100:00100000:3.0:1762167011.046594:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451980288:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 391us (549us total) trans 17179876028 rc 0/0 00000100:00100000:3.0:1762167011.046610:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3158 00002000:00010000:3.0:1762167011.046615:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00000100:00100000:2.0:1762167011.046619:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3157 00002000:00100000:3.0:1762167011.046621:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6ad80 with x1847765451980288 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.046625:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (262144->18446744073709551615) 00002000:00010000:3.0:1762167011.046628:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d6ad80. 00002000:00100000:2.0:1762167011.046630:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6b480 with x1847765451980160 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.046639:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d6b480. 00000100:00100000:0.0:1762167011.048207:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.048286:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451980416 00000100:00100000:2.0:1762167011.048292:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451980416 00000100:00100000:2.0:1762167011.048340:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20016 00000100:00100000:2.0:1762167011.048348:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56220:x1847765451980416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.048379:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.048400:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bbec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fce expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.048479:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bbf3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.048495:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.048506:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167011.048529:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.048533:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.048547:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.048570:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bbec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fce expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.048585:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fce expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.048594:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.048597:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.048600:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167011.048647:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56220:x1847765451980416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 299us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.048654:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20016 00000100:00100000:0.0:1762167011.051227:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.051294:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451980672 00000100:00100000:2.0:1762167011.051308:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451980672 00000100:00100000:2.0:1762167011.051390:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20017 00000100:00100000:2.0:1762167011.051403:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56220:x1847765451980672:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.051477:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.051516:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bbf3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fce expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.051540:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.051547:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.051903:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.051923:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.051946:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167011.052022:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953110 00000004:00010000:2.0:1762167011.052050:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002a5a7e22 reply state 000000003bbf32c6 transno 8589953111 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167011.052065:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.052185:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56220:x1847765451980672:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 783us (974us total) trans 8589953111 rc 0/0 00000100:00100000:2.0:1762167011.052195:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20017 00000020:00080000:2.0:1762167011.052203:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167011.053120:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.053135:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.053143:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.053150:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.053154:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.053162:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.053178:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.053181:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.053185:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.053191:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bbfa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167011.053380:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.053484:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451980800 00000100:00100000:2.0:1762167011.053495:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451980800 00000100:00100000:2.0:1762167011.053557:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17332 00000100:00100000:2.0:1762167011.053569:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56220:x1847765451980800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.053592:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.053614:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bc01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fd5 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167011.053643:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888de, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:2.0:1762167011.053664:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.053665:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.053671:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bc01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fd5 expref: 24 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.053684:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bc01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fd5 expref: 24 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.053697:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d200, rc 0) 00000100:00100000:2.0:1762167011.053755:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56220:x1847765451980800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 187us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.053802:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17332 00000100:00100000:1.0:1762167011.055071:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.055103:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.055129:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451980928 00000100:00100000:2.0:1762167011.055136:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451980928 00000100:00100000:3.0:1762167011.055158:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451981056 00000100:00100000:3.0:1762167011.055165:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451981056 00002000:00010000:2.0:1762167011.055165:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (262144->18446744073709551615) 00002000:00100000:2.0:1762167011.055172:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d69880 with x1847765451980928 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.055180:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d69880. 00002000:00010000:3.0:1762167011.055188:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00100000:3.0:1762167011.055193:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6a680 with x1847765451981056 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167011.055201:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d6a680. 00000100:00100000:2.0:1762167011.055214:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3159 00000100:00100000:2.0:1762167011.055223:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765451980928:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167011.055231:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3160 00000100:00100000:3.0:1762167011.055243:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451981056:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167011.055536:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.055537:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762167011.055543:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.055544:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.055549:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167011.055550:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167011.055555:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.055556:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.055559:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167011.055560:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167011.055620:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765451981056:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 378us (513us total) trans 17179876029 rc 0/0 00000100:00100000:2.0:1762167011.055621:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765451980928:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 397us (551us total) trans 21474843598 rc 0/0 00000100:00100000:3.0:1762167011.055635:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3160 00002000:00010000:3.0:1762167011.055640:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00000100:00100000:2.0:1762167011.055643:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3159 00002000:00100000:3.0:1762167011.055645:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6a680 with x1847765451981056 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.055652:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (262144->18446744073709551615) 00002000:00010000:3.0:1762167011.055653:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d6a680. 00002000:00100000:2.0:1762167011.055659:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d69880 with x1847765451980928 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.055667:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d69880. 00000100:00100000:0.0:1762167011.058376:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.058430:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451981184 00000100:00100000:2.0:1762167011.058441:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451981184 00000100:00100000:2.0:1762167011.058498:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20018 00000100:00100000:2.0:1762167011.058508:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56220:x1847765451981184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.058532:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.058551:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc08 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fdc expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.058634:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc0f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.058649:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.058659:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167011.058683:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.058688:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.058704:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.058728:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc08 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fdc expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.058745:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fdc expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.058753:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.058756:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.058785:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167011.058839:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56220:x1847765451981184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 332us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.058846:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20018 00000100:00100000:0.0:1762167011.061198:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.061263:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451981440 00000100:00100000:2.0:1762167011.061277:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451981440 00000100:00100000:2.0:1762167011.061334:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20019 00000100:00100000:2.0:1762167011.061349:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56220:x1847765451981440:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.061418:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.061448:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc0f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fdc expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.061471:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.061475:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.061690:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.061703:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.061713:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167011.061790:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953112 00000004:00010000:2.0:1762167011.061814:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000448d29bd reply state 000000006bf1290c transno 8589953113 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167011.061822:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.061899:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56220:x1847765451981440:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 551us (708us total) trans 8589953113 rc 0/0 00000100:00100000:2.0:1762167011.061906:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20019 00000020:00080000:2.0:1762167011.061912:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762167011.063412:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.063426:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.063432:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.063439:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167011.063443:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.063451:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.063467:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:3.0:1762167011.063470:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167011.063474:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.063480:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc16 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167011.063811:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.063852:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451981568 00000100:00100000:2.0:1762167011.063871:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451981568 00000100:00100000:2.0:1762167011.063925:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17333 00000100:00100000:2.0:1762167011.063935:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56220:x1847765451981568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.063950:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.063968:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bc1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fe3 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167011.063991:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888de, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:2.0:1762167011.064011:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.064013:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.064019:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bc1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fe3 expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.064033:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bc1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fe3 expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.064048:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167011.064109:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56220:x1847765451981568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 175us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.064117:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17333 00000100:00100000:1.0:1762167011.065711:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.065749:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.065802:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451981696 00000100:00100000:3.0:1762167011.065806:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451981824 00000100:00100000:2.0:1762167011.065809:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451981696 00000100:00100000:3.0:1762167011.065813:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451981824 00002000:00010000:3.0:1762167011.065842:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00010000:2.0:1762167011.065842:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (262144->18446744073709551615) 00002000:00100000:3.0:1762167011.065850:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6b800 with x1847765451981824 ext(0->18446744073709551615) 00002000:00100000:2.0:1762167011.065850:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6aa00 with x1847765451981696 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762167011.065862:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d6b800. 00002000:00010000:2.0:1762167011.065872:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d6aa00. 00000100:00100000:3.0:1762167011.066103:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3161 00000100:00100000:2.0:1762167011.066113:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3162 00000100:00100000:3.0:1762167011.066116:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765451981824:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167011.066127:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765451981696:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167011.066423:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.066424:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762167011.066429:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.066430:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.066436:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167011.066437:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167011.066443:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.066445:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.066447:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:3.0:1762167011.066450:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.066502:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765451981824:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 389us (751us total) trans 21474843599 rc 0/0 00000100:00100000:2.0:1762167011.066504:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765451981696:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 379us (794us total) trans 17179876030 rc 0/0 00000100:00100000:3.0:1762167011.066520:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3161 00002000:00010000:3.0:1762167011.066525:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00000100:00100000:2.0:1762167011.066528:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3162 00002000:00100000:3.0:1762167011.066530:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6b800 with x1847765451981824 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.066533:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (262144->18446744073709551615) 00002000:00010000:3.0:1762167011.066537:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee381d6b800. 00002000:00100000:2.0:1762167011.066538:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee381d6aa00 with x1847765451981696 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.066545:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee381d6aa00. 00000100:00100000:3.0:1762167011.069129:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.069209:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451981952 00000100:00100000:2.0:1762167011.069217:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451981952 00000100:00100000:2.0:1762167011.069272:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20020 00000100:00100000:2.0:1762167011.069282:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56220:x1847765451981952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.069304:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.069323:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc24 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fea expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.069423:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bc2b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.069437:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bc2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.069453:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bc2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167011.069479:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.069483:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.069499:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bc2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.069524:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc24 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fea expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.069546:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bc2b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fea expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.069554:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.069557:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.069560:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167011.069615:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56220:x1847765451981952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 335us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.069621:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20020 00000100:00100000:3.0:1762167011.071499:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.071629:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451982208 00000100:00100000:2.0:1762167011.071637:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451982208 00000100:00100000:2.0:1762167011.071687:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20021 00000100:00100000:2.0:1762167011.071699:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56220:x1847765451982208:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.071742:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.071781:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bc2b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fea expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.071798:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.071802:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.072014:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.072026:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.072036:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167011.072087:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953114 00000004:00010000:2.0:1762167011.072114:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000021f3f870 reply state 00000000ee9e8831 transno 8589953115 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167011.072122:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.072224:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56220:x1847765451982208:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 527us (730us total) trans 8589953115 rc 0/0 00000100:00100000:2.0:1762167011.072231:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20021 00000020:00080000:2.0:1762167011.072236:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167011.073328:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.073340:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.073347:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.073352:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.073370:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.073378:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.073390:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.073394:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.073398:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.073404:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc32 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167011.073541:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.073610:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451982336 00000100:00100000:0.0:1762167011.073620:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451982336 00000100:00100000:0.0:1762167011.073674:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17334 00000100:00100000:0.0:1762167011.073684:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56220:x1847765451982336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167011.073699:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167011.073717:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bc39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ff1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167011.073747:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888e0, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:0.0:1762167011.073833:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.073836:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.073843:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bc39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff1 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.073866:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bc39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff1 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.073877:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167011.073923:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56220:x1847765451982336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 241us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167011.073928:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17334 00000100:00100000:1.0:1762167011.075401:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.075446:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.075527:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451982592 00000100:00100000:0.0:1762167011.075527:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451982464 00000100:00100000:2.0:1762167011.075534:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451982592 00000100:00100000:0.0:1762167011.075535:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451982464 00002000:00010000:2.0:1762167011.075567:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00010000:0.0:1762167011.075567:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (262144->18446744073709551615) 00002000:00100000:2.0:1762167011.075573:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccf100 with x1847765451982592 ext(0->18446744073709551615) 00002000:00100000:0.0:1762167011.075574:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccea00 with x1847765451982464 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.075583:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fccf100. 00002000:00010000:0.0:1762167011.075583:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fccea00. 00000100:00100000:0.0:1762167011.075616:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3163 00000100:00100000:2.0:1762167011.075623:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3164 00000100:00100000:0.0:1762167011.075629:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451982464:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167011.075636:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451982592:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167011.075905:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762167011.075910:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.075912:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.075913:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167011.075919:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:0.0:1762167011.075919:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.075926:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167011.075930:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.075932:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167011.075939:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167011.075992:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451982464:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 366us (593us total) trans 21474843600 rc 0/0 00000100:00100000:2.0:1762167011.075994:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451982592:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 361us (545us total) trans 17179876031 rc 0/0 00000100:00100000:0.0:1762167011.076004:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3163 00002000:00010000:0.0:1762167011.076008:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (262144->18446744073709551615) 00000100:00100000:2.0:1762167011.076013:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3164 00002000:00100000:0.0:1762167011.076014:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccea00 with x1847765451982464 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.076019:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.076024:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fccf100 with x1847765451982592 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167011.076024:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fccea00. 00002000:00010000:2.0:1762167011.076033:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fccf100. 00000100:00100000:3.0:1762167011.077600:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.077681:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451982848 00000100:00100000:2.0:1762167011.077691:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451982848 00000100:00100000:2.0:1762167011.077747:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20022 00000100:00100000:2.0:1762167011.077758:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56220:x1847765451982848:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.077892:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.077908:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.077920:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:2.0:1762167011.078036:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c8bbc0f5 reply state 00000000256bd64e transno 8589953116 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167011.078045:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.078122:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56220:x1847765451982848:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 367us (532us total) trans 8589953116 rc 0/0 00000100:00100000:2.0:1762167011.078133:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20022 00010000:00010000:0.0:1762167011.079241:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167011.079254:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167011.079259:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167011.079263:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167011.079267:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167011.079274:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167011.079294:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167011.079297:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167011.079302:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167011.079308:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc40 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167011.079637:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.079692:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451982976 00000100:00100000:0.0:1762167011.079701:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451982976 00000100:00100000:3.0:1762167011.079707:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.079760:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451983104 00000100:00100000:0.0:1762167011.079797:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17335 00000100:00100000:0.0:1762167011.079814:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451982976:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167011.079815:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.079817:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451983104 00000100:00100000:1.0:1762167011.079868:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451983232 00000100:00100000:2.0:1762167011.079874:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17336 00000100:00100000:1.0:1762167011.079882:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451983232 00000100:00100000:2.0:1762167011.079889:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451983104:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167011.079953:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17337 00000100:00100000:1.0:1762167011.079972:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451983232:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762167011.080137:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.080142:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762167011.080143:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.080150:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.080153:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00002000:00010000:2.0:1762167011.080155:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167011.080160:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.080165:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167010 -> 1762167011 00002000:00010000:0.0:1762167011.080169:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.080171:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 105 -> 105 00002000:00010000:1.0:1762167011.080220:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.080226:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167010 -> 1762167011 00002000:00010000:1.0:1762167011.080230:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167010 -> 1762167011 00002000:00010000:1.0:1762167011.080235:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167010 -> 1762167011 00000100:00100000:2.0:1762167011.080239:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451983104:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 348us (526us total) trans 17179876032 rc 0/0 00000100:00100000:0.0:1762167011.080239:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451982976:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 426us (599us total) trans 21474843601 rc 0/0 00002000:00010000:1.0:1762167011.080242:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.080264:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17335 00000100:00100000:2.0:1762167011.080274:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17336 00000100:00100000:1.0:1762167011.080317:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451983232:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 350us (506us total) trans 21474843602 rc 0/0 00000100:00100000:1.0:1762167011.080331:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17337 00000100:00100000:3.0:1762167011.081543:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.081594:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451983488 00000100:00100000:0.0:1762167011.081601:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451983488 00000100:00100000:0.0:1762167011.081652:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7381 00000100:00100000:0.0:1762167011.081667:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f653050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56220:x1847765451983488:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:0.0:1762167011.081732:0:30820:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0badb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f65 expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.081825:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167011.081847:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bb05 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f6c expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.081857:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167011.081900:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bb05 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f6c expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.081920:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bb05 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f6c expref: 908 pid: 30819 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1762167011.081935:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454523648:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167011.082003:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762167011.082987:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454523648:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167011.083013:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167011.083245:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.083304:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451983616 00000100:00100000:2.0:1762167011.083317:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451983616 00010000:00010000:2.0:1762167011.083372:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bb05 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f6c expref: 909 pid: 30819 timeout: 731 lvb_type: 0 00000100:00100000:2.0:1762167011.083420:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7622 00000100:00100000:2.0:1762167011.083431:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:2360:x1847765451983616:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167011.083446:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.083453:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bb05 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f6c expref: 909 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167011.083463:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bb05 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f6c expref: 909 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167011.083484:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bb05 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f6c expref: 909 pid: 30819 timeout: 731 lvb_type: 0 00010000:00010000:2.0:1762167011.083499:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:2.0:1762167011.083502:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167011.083508:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167011.083513:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167011.083537:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167011.083565:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167011.083577:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167011.083585:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2360:x1847765451983616:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 153us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.083602:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7622 00000040:00080000:0.0:1762167011.084339:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5596, 88 off452672 00000004:00080000:0.0:1762167011.084352:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631876588656ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167011.084457:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5604, 88 off453728 00000004:00080000:0.0:1762167011.084466:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631876702744ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167011.084507:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5605, 88 off453816 00000004:00080000:0.0:1762167011.084512:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631876749278ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167011.084528:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5597, 88 off452760 00000004:00080000:0.0:1762167011.084532:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631876769154ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167011.084556:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5606, 88 off453904 00000004:00080000:0.0:1762167011.084560:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631876797575ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167011.084578:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5598, 88 off452848 00000004:00080000:0.0:1762167011.084582:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631876819420ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167011.084620:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5599, 88 off452936 00000004:00080000:0.0:1762167011.084625:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631876862494ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167011.084656:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5607, 88 off453992 00000004:00080000:0.0:1762167011.084660:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631876897494ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167011.084686:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5608, 88 off454080 00000004:00080000:0.0:1762167011.084691:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631876928658ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167011.084719:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5600, 88 off453024 00000004:00080000:0.0:1762167011.084725:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631876961843ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167011.084751:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5609, 88 off454168 00000004:00080000:0.0:1762167011.084754:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631876991738ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167011.084804:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5601, 88 off453112 00000004:00080000:0.0:1762167011.084810:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631877046554ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167011.084834:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5602, 88 off453200 00000004:00080000:0.0:1762167011.084840:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631877077184ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167011.084870:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5610, 88 off454256 00000004:00080000:0.0:1762167011.084875:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631877112091ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167011.084908:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5603, 88 off453288 00000004:00080000:0.0:1762167011.084913:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631877149954ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167011.084950:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5611, 88 off454344 00000004:00080000:0.0:1762167011.084955:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631877192286ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167011.084990:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5612, 88 off454432 00000004:00080000:0.0:1762167011.084995:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631877232118ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167011.085011:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5604, 88 off453376 00000004:00080000:0.0:1762167011.085016:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631877252749ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167011.085046:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5605, 88 off453464 00000004:00080000:0.0:1762167011.085051:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631877288144ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167011.085075:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5613, 88 off454520 00000004:00080000:0.0:1762167011.085079:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631877316218ns, next at 630703976179ns, rc = 0 00000001:00080000:1.0:1762167011.096262:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953117 is committed 00000004:00080000:1.0:1762167011.096279:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3724 committed 00000004:00010000:0.0:1762167011.096295:0:30820:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000009fa63ba reply state 000000002bb47c78 transno 8589953117 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000004:00080000:1.0:1762167011.096297:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3711 committed 00000004:00080000:1.0:1762167011.096311:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3710 committed 00000100:00100000:0.0:1762167011.096311:0:30820:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1762167011.096317:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3723 committed 00000004:00080000:1.0:1762167011.096321:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3722 committed 00000004:00080000:1.0:1762167011.096324:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3709 committed 00010000:00010000:0.0:1762167011.096324:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00000004:00080000:1.0:1762167011.096329:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3721 committed 00010000:00010000:0.0:1762167011.096331:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1762167011.096333:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3708 committed 00000004:00080000:1.0:1762167011.096339:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3707 committed 00000004:00080000:1.0:1762167011.096343:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3720 committed 00010000:00010000:0.0:1762167011.096345:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0badb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f65 expref: 907 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167011.096347:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3706 committed 00000004:00080000:1.0:1762167011.096352:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3719 committed 00000004:00080000:1.0:1762167011.096370:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3718 committed 00000004:00080000:1.0:1762167011.096376:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3705 committed 00000004:00080000:1.0:1762167011.096381:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3704 committed 00000004:00080000:1.0:1762167011.096384:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3717 committed 00000004:00080000:1.0:1762167011.096386:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3703 committed 00000004:00080000:1.0:1762167011.096389:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3716 committed 00000004:00080000:1.0:1762167011.096392:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3715 committed 00000004:00080000:1.0:1762167011.096396:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3702 committed 00010000:00080000:0.0:1762167011.096510:0:30820:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762167011.096530:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f653050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56220:x1847765451983488:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 14867us (14990us total) trans 8589953117 rc 0/0 00000100:00100000:0.0:1762167011.096545:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7381 00000100:00100000:3.0:1762167011.096577:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454523904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.096578:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454524160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.096622:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454523776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.096651:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167011.096685:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167011.096688:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454523904 00000100:00100000:1.0:1762167011.096697:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454523904 00010000:00010000:0.0:1762167011.096698:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167011.096699:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454524416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.096703:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167011.096712:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167011.096720:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167011.096725:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167011.096735:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454524288:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1762167011.096740:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167011.096742:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454523776 00000100:00100000:1.0:1762167011.096747:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454523776 00000100:00100000:2.0:1762167011.096790:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167011.096796:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8800) 00010000:00010000:0.0:1762167011.096801:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167011.096806:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167011.096811:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454524288 00000100:00100000:3.0:1762167011.096813:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454524032:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762167011.096814:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bc47 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167011.096817:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454524288 00000100:00100000:2.0:1762167011.096831:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454524800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.096849:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.096853:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17338 00000100:00100000:1.0:1762167011.096865:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3295:x1847765454523904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.096867:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454524032 00000100:00100000:0.0:1762167011.096874:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454524032 00000100:00100000:2.0:1762167011.096880:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17339 00000100:00100000:3.0:1762167011.096886:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454524544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.096894:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454523776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.096909:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17340 00000100:00100000:3.0:1762167011.096915:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.096923:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454524288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.096959:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454525056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.096991:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.097006:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454525568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.097034:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.097072:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454524544 00000100:00100000:3.0:1762167011.097077:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454524544 00002000:00010000:1.0:1762167011.097101:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762167011.097106:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.097109:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.097110:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00000100:00100000:3.0:1762167011.097115:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454525056 00002000:00010000:2.0:1762167011.097115:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00000100:00100000:3.0:1762167011.097121:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454525056 00002000:00010000:2.0:1762167011.097124:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762167011.097125:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.097130:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.097132:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:1.0:1762167011.097132:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 105 -> 105 00002000:00010000:0.0:1762167011.097136:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:3.0:1762167011.097137:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454525568 00002000:00010000:2.0:1762167011.097138:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.097142:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454525568 00002000:00010000:0.0:1762167011.097143:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.097148:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.097151:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.097168:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17341 00000100:00100000:3.0:1762167011.097179:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454524032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.097185:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454523904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 322us (534us total) trans 21474843603 rc 0/0 00000100:00100000:1.0:1762167011.097194:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17338 00000100:00100000:2.0:1762167011.097201:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765454523776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 309us (499us total) trans 17179876033 rc 0/0 00000100:00100000:0.0:1762167011.097201:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454524288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 280us (410us total) trans 21474843604 rc 0/0 00000100:00100000:1.0:1762167011.097216:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17342 00000100:00100000:0.0:1762167011.097223:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17340 00000100:00100000:1.0:1762167011.097228:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454524544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.097234:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17339 00000100:00100000:0.0:1762167011.097247:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17343 00000100:00100000:0.0:1762167011.097259:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3296:x1847765454525056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.097263:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17344 00000100:00100000:2.0:1762167011.097275:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454525568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167011.097300:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.097303:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.097305:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.097307:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.097309:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.097343:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454524032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (493us total) trans 17179876034 rc 0/0 00000100:00100000:3.0:1762167011.097350:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17341 00002000:00010000:1.0:1762167011.097378:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.097382:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.097385:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167011.097388:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.097390:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.097417:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876019 gen 2 00002000:00010000:0.0:1762167011.097421:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00000100:00100000:1.0:1762167011.097423:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454524544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (508us total) trans 21474843605 rc 0/0 00000004:00080000:3.0:1762167011.097425:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b02d80, transno 17179875986 00002000:00010000:0.0:1762167011.097427:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.097433:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000100:00100000:1.0:1762167011.097436:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17342 00000004:00080000:3.0:1762167011.097439:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b03800, transno 17179875987 00002000:00010000:2.0:1762167011.097440:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762167011.097440:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000004:00080000:3.0:1762167011.097448:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b00700, transno 17179875988 00002000:00010000:2.0:1762167011.097449:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.097449:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000004:00080000:3.0:1762167011.097455:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b02a00, transno 17179875989 00002000:00010000:2.0:1762167011.097457:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000004:00080000:3.0:1762167011.097462:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b00e00, transno 17179875990 00002000:00010000:2.0:1762167011.097462:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.097467:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000004:00080000:3.0:1762167011.097469:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b02680, transno 17179875991 00000004:00080000:3.0:1762167011.097474:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b01180, transno 17179875992 00000004:00080000:3.0:1762167011.097479:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b00380, transno 17179875993 00000004:00080000:3.0:1762167011.097484:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b3b80, transno 17179875994 00000004:00080000:3.0:1762167011.097488:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e3b1880, transno 17179875995 00000004:00080000:3.0:1762167011.097492:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc5180, transno 17179875996 00000100:00100000:0.0:1762167011.097496:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454525056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 239us (501us total) trans 17179876035 rc 0/0 00000004:00080000:3.0:1762167011.097498:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc6a00, transno 17179875997 00000004:00080000:3.0:1762167011.097506:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc4380, transno 17179875998 00000100:00100000:0.0:1762167011.097511:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17343 00000100:00100000:2.0:1762167011.097512:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454525568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 235us (473us total) trans 21474843606 rc 0/0 00000004:00080000:3.0:1762167011.097513:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc5f80, transno 17179875999 00000004:00080000:3.0:1762167011.097520:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc7800, transno 17179876000 00000004:00080000:3.0:1762167011.097525:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc4000, transno 17179876001 00000100:00100000:2.0:1762167011.097526:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17344 00000004:00080000:3.0:1762167011.097531:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc5500, transno 17179876002 00000004:00080000:3.0:1762167011.097536:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc7100, transno 17179876003 00000004:00080000:3.0:1762167011.097540:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24785a680, transno 17179876004 00000004:00080000:3.0:1762167011.097545:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24785a300, transno 17179876005 00000004:00080000:3.0:1762167011.097549:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247858700, transno 17179876010 00000004:00080000:3.0:1762167011.097553:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24785bb80, transno 17179876011 00000004:00080000:3.0:1762167011.097556:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247859880, transno 17179876012 00000004:00080000:3.0:1762167011.097561:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242cebb80, transno 17179876013 00000100:00100000:2.0:1762167011.097562:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167011.097565:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247858a80, transno 17179876014 00000004:00080000:3.0:1762167011.097568:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24785b800, transno 17179876015 00000004:00080000:3.0:1762167011.097570:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247858e00, transno 17179876016 00000004:00080000:3.0:1762167011.097572:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247859c00, transno 17179876017 00000004:00080000:3.0:1762167011.097575:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242ce9880, transno 17179876018 00000004:00080000:3.0:1762167011.097577:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242ce8000, transno 17179876019 00000100:00100000:3.0:1762167011.097585:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37fc29500 x1847765454524032/t17179876034(17179876034) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167027 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1762167011.097594:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454524672:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167011.097598:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc29500/2, rc 0, transno 17179876034 00000100:00100000:0.0:1762167011.097605:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454524160 00000100:00100000:3.0:1762167011.097606:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454524032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.097610:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454524160 00000100:00100000:3.0:1762167011.097624:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843588 gen 2 00000100:00100000:2.0:1762167011.097628:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167011.097630:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc7b80, transno 21474843579 00000004:00080000:3.0:1762167011.097641:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e472a00, transno 21474843580 00000004:00080000:3.0:1762167011.097645:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e473b80, transno 21474843581 00000004:00080000:3.0:1762167011.097648:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b06680, transno 21474843582 00000004:00080000:3.0:1762167011.097652:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b07b80, transno 21474843583 00000100:00100000:0.0:1762167011.097653:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454524672 00000100:00100000:0.0:1762167011.097659:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454524672 00000004:00080000:3.0:1762167011.097660:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b05c00, transno 21474843584 00000004:00080000:3.0:1762167011.097666:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e471880, transno 21474843585 00000004:00080000:3.0:1762167011.097672:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b04e00, transno 21474843586 00000004:00080000:3.0:1762167011.097677:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee359065f80, transno 21474843587 00000100:00100000:1.0:1762167011.097679:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17345 00000004:00080000:3.0:1762167011.097682:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee359064700, transno 21474843588 00000100:00100000:3.0:1762167011.097690:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee348255f80 x1847765454524544/t21474843605(21474843605) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167027 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762167011.097692:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765454524160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.097694:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17346 00000004:00080000:3.0:1762167011.097707:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348255f80/2, rc 0, transno 21474843605 00000100:00100000:0.0:1762167011.097709:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454524672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.097712:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454525184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.097717:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454524544:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167011.097735:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28e00/2, rc 0, transno 17179876035 00000100:00100000:3.0:1762167011.097739:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454525056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.097752:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167011.097755:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2477d1180/2, rc 0, transno 21474843606 00000100:00100000:2.0:1762167011.097798:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454525696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.097824:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167011.097853:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 262144 -> 262144 00000100:00100000:2.0:1762167011.097856:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454525184 00002000:00010000:1.0:1762167011.097859:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:2.0:1762167011.097861:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454525184 00002000:00010000:1.0:1762167011.097864:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167011.097868:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.097871:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167011.097887:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454525696 00002000:00010000:0.0:1762167011.097888:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 262144 -> 262144 00000100:00100000:2.0:1762167011.097890:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454525696 00002000:00010000:0.0:1762167011.097895:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.097898:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167011.097901:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.097906:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167011.097910:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454525568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.097916:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17347 00000100:00100000:1.0:1762167011.097917:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454524160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (353us total) trans 17179876036 rc 0/0 00000100:00100000:2.0:1762167011.097931:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454525184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.097931:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17345 00000100:00100000:1.0:1762167011.097951:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17348 00000100:00100000:1.0:1762167011.097962:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454525696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.097965:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454524672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 258us (338us total) trans 21474843607 rc 0/0 00000100:00100000:0.0:1762167011.097975:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17346 00002000:00010000:2.0:1762167011.098055:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.098059:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.098061:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167011.098064:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.098066:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167011.098097:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167011.098102:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454525184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (350us total) trans 21474843608 rc 0/0 00002000:00010000:1.0:1762167011.098103:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.098111:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:2.0:1762167011.098115:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17347 00002000:00010000:1.0:1762167011.098116:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.098119:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.098140:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.098158:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454525696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (331us total) trans 17179876037 rc 0/0 00000100:00100000:1.0:1762167011.098168:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17348 00000100:00100000:2.0:1762167011.098174:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454524928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.098183:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454524416 00000100:00100000:1.0:1762167011.098187:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454524416 00000004:00080000:3.0:1762167011.098196:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 6 in flight, 10 done 00000100:00100000:2.0:1762167011.098198:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.098211:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454524928 00000100:00100000:2.0:1762167011.098216:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454525440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.098216:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454524928 00000100:00100000:2.0:1762167011.098241:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.098246:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17349 00000100:00100000:1.0:1762167011.098256:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454524416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.098259:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:2.0:1762167011.098270:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348257b80/2, rc 0, transno 21474843603 00000100:00100000:3.0:1762167011.098271:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454525952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.098276:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454523904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.098294:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.098307:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454525312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.098313:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.098321:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454525440 00000100:00100000:0.0:1762167011.098327:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454525440 00000100:00100000:2.0:1762167011.098342:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.098367:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454524800 00000100:00100000:0.0:1762167011.098371:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454524800 00000100:00100000:2.0:1762167011.098376:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2477d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454525824:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167011.098385:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167011.098388:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454525952 00002000:00010000:1.0:1762167011.098389:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:0.0:1762167011.098394:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454525952 00002000:00010000:1.0:1762167011.098395:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167011.098399:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000100:00100000:2.0:1762167011.098405:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167011.098406:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.098412:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454525312 00000100:00100000:0.0:1762167011.098416:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454525312 00000100:00100000:0.0:1762167011.098432:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454525824 00000004:00080000:2.0:1762167011.098433:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28380/2, rc 0, transno 17179876033 00000100:00100000:0.0:1762167011.098436:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454525824 00000100:00100000:2.0:1762167011.098441:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454523776:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167011.098462:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348254700/2, rc 0, transno 21474843604 00000100:00100000:0.0:1762167011.098463:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17350 00000100:00100000:1.0:1762167011.098466:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454524416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (323us total) trans 17179876038 rc 0/0 00000100:00100000:2.0:1762167011.098470:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454524288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.098477:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454524928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.098479:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17349 00000100:00100000:1.0:1762167011.098504:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17351 00000100:00100000:2.0:1762167011.098511:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17352 00000100:00100000:1.0:1762167011.098516:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454525440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.098526:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454524800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.098535:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000004:00080000:3.0:1762167011.098576:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28000/2, rc 0, transno 17179876038 00000100:00100000:3.0:1762167011.098582:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454524416:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167011.098626:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.098629:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.098632:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167011.098634:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.098637:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167011.098640:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762167011.098644:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.098645:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167011.098647:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.098649:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167011.098674:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762167011.098678:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.098680:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167011.098683:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454524928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (484us total) trans 21474843609 rc 0/0 00002000:00010000:2.0:1762167011.098685:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.098692:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167011.098693:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454525440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (452us total) trans 21474843610 rc 0/0 00000100:00100000:0.0:1762167011.098701:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17350 00000100:00100000:1.0:1762167011.098708:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17351 00000100:00100000:0.0:1762167011.098726:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17353 00000100:00100000:1.0:1762167011.098733:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17354 00000100:00100000:2.0:1762167011.098739:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454524800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (439us total) trans 17179876039 rc 0/0 00000100:00100000:0.0:1762167011.098739:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454525952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.098748:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454525312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.098755:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17352 00000004:00080000:3.0:1762167011.098795:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348257100/2, rc 0, transno 21474843609 00000100:00100000:3.0:1762167011.098802:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454524928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.098807:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17355 00000004:00080000:3.0:1762167011.098817:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2477d1500/2, rc 0, transno 21474843610 00000100:00100000:2.0:1762167011.098820:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454525824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.098825:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454525440:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167011.098888:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.098891:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.098893:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167011.098894:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.098896:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167011.098918:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454525312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (578us total) trans 17179876040 rc 0/0 00002000:00010000:0.0:1762167011.098920:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 262144 -> 262144 00000100:00100000:1.0:1762167011.098924:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17354 00002000:00010000:0.0:1762167011.098928:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.098932:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167011.098934:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.098937:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167011.098955:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.098959:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.098962:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167011.098964:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.098966:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.098981:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454525952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 245us (667us total) trans 21474843611 rc 0/0 00000100:00100000:0.0:1762167011.098988:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17353 00000100:00100000:2.0:1762167011.099004:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454525824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (601us total) trans 21474843612 rc 0/0 00000100:00100000:2.0:1762167011.099012:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17355 00000004:00080000:3.0:1762167011.099014:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2477d0000/2, rc 0, transno 21474843611 00000100:00100000:3.0:1762167011.099022:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454525952:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167011.099207:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 8 in progress, 4 in flight, 30 done 00000100:00100000:0.0:1762167011.099273:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1762167011.099274:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454526208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.099286:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454526080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.099308:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.099338:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454526208 00000100:00100000:3.0:1762167011.099343:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454526208 00000004:00080000:2.0:1762167011.099347:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc2a680/2, rc 0, transno 17179876036 00000100:00100000:0.0:1762167011.099348:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.099366:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454524160:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167011.099383:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348256a00/2, rc 0, transno 21474843607 00000100:00100000:2.0:1762167011.099388:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454524672:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167011.099403:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2477d1f80/2, rc 0, transno 21474843608 00000100:00100000:0.0:1762167011.099404:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454526080 00000100:00100000:3.0:1762167011.099410:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17356 00000100:00100000:2.0:1762167011.099410:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454525184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.099411:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454526080 00000100:00100000:3.0:1762167011.099425:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454526208:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167011.099430:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03480/2, rc 0, transno 17179876037 00000100:00100000:2.0:1762167011.099437:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454525696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.099448:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17357 00000100:00100000:0.0:1762167011.099459:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454526080:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167011.099472:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2477d0700/2, rc 0, transno 21474843612 00000100:00100000:2.0:1762167011.099478:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2477d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454525824:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167011.099490:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc2b100/2, rc 0, transno 17179876039 00000100:00100000:2.0:1762167011.099493:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454524800:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167011.099502:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28700/2, rc 0, transno 17179876040 00000100:00100000:2.0:1762167011.099504:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454525312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.099525:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451983744 00000100:00100000:2.0:1762167011.099527:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451983744 00002000:00010000:3.0:1762167011.099562:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.099568:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:2.0:1762167011.099568:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20023 00002000:00010000:3.0:1762167011.099573:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167011.099577:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.099579:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.099584:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56220:x1847765451983744:12345-192.168.203.35@tcp:101:lfs.0 00002000:00010000:0.0:1762167011.099592:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762167011.099597:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.099600:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00010000:00010000:2.0:1762167011.099601:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1762167011.099605:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.099608:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00010000:00010000:2.0:1762167011.099622:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc4e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3ff8 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.099624:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3293:x1847765454526208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (315us total) trans 17179876041 rc 0/0 00000100:00100000:3.0:1762167011.099639:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17356 00000100:00100000:0.0:1762167011.099650:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454526080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (303us total) trans 17179876042 rc 0/0 00000004:00080000:1.0:1762167011.099658:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f286d80/2, rc 0, transno 17179876041 00000100:00100000:0.0:1762167011.099658:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17357 00000100:00100000:1.0:1762167011.099668:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454526208:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167011.099680:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff8 expref: 890 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.099697:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff8 expref: 890 pid: 30817 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762167011.099699:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f286300/2, rc 0, transno 17179876042 00000100:00100000:0.0:1762167011.099708:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454526080:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167011.099721:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee346ae3c00) 00010000:00010000:2.0:1762167011.099725:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167011.099729:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:2.0:1762167011.099797:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56220:x1847765451983744:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 217us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.099804:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20023 00000100:00100000:3.0:1762167011.101844:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.101886:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451984000 00000100:00100000:0.0:1762167011.101895:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451984000 00000100:00100000:0.0:1762167011.101938:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7382 00000100:00100000:0.0:1762167011.101946:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56220:x1847765451984000:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167011.102159:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56220:x1847765451984000:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 213us (321us total) trans 8589953118 rc 0/0 00000100:00100000:0.0:1762167011.102167:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7382 00000100:00100000:1.0:1762167011.111924:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.112015:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451984128 00000100:00100000:2.0:1762167011.112025:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451984128 00000100:00100000:2.0:1762167011.112091:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20024 00000100:00100000:2.0:1762167011.112103:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56221:x1847765451984128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.112132:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.112155:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bc55 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb3fff expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.112223:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc5c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112236:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc5c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112244:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc5c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112259:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bc63 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112270:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bc63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112276:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bc63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112405:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112414:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112421:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167011.112458:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.112463:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.112481:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112490:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112498:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc5c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112509:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc5c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112515:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112520:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.112525:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112532:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc5c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112544:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167011.112547:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.112551:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc5c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112557:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bc5c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112569:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bc63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112575:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bc63 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112580:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bc63 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112584:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1dc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.112587:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bc63 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112592:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bc63 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112598:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee346ae3400) 00010000:00010000:2.0:1762167011.112601:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.112603:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bc63 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112608:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bc63 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.112653:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bc55 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fff expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.112666:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fff expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.112673:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee346ae3c00) 00010000:00010000:2.0:1762167011.112675:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.112677:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167011.112752:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56221:x1847765451984128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 652us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.112824:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20024 00000100:00100000:3.0:1762167011.115282:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.115373:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451984384 00000100:00100000:2.0:1762167011.115383:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451984384 00000100:00100000:2.0:1762167011.115443:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20025 00000100:00100000:2.0:1762167011.115453:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56221:x1847765451984384:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.115476:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.115494:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc71 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4006 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.115588:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc78 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.115611:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc78 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.115622:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc78 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167011.115640:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:2.0:1762167011.115798:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc71 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4006 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.115815:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc78 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4006 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.115821:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee346ae3c00) 00010000:00010000:2.0:1762167011.115823:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762167011.115825:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:2.0:1762167011.115899:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56221:x1847765451984384:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 447us (625us total) trans 8589953119 rc 0/0 00000100:00100000:2.0:1762167011.115909:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20025 00000100:00100000:3.0:1762167011.117419:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.117474:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451984640 00000100:00100000:1.0:1762167011.117483:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451984640 00000100:00100000:1.0:1762167011.117536:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20026 00000100:00100000:1.0:1762167011.117546:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56221:x1847765451984640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167011.117565:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.117581:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bc86 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb400d expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.117660:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0bc8d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.117673:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0bc8d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.117682:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0bc8d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167011.117694:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:1.0:1762167011.117841:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bc86 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb400d expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.117873:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0bc8d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb400d expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.117882:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee346ae3c00) 00010000:00010000:1.0:1762167011.117885:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167011.117888:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28600, rc 0) 00000100:00100000:1.0:1762167011.117936:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56221:x1847765451984640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 391us (521us total) trans 8589953120 rc 0/0 00000100:00100000:1.0:1762167011.117943:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20026 00000100:00100000:3.0:1762167011.144716:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.144817:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451984768 00000100:00100000:2.0:1762167011.144829:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451984768 00000100:00100000:2.0:1762167011.144902:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3165 00000100:00100000:2.0:1762167011.144912:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451984768:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167011.144945:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc9b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.144960:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.144962:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.144967:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.144981:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.147488:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.147504:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.147512:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.147519:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167011.147524:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.147531:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.147548:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.147555:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bc9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.147626:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451984768:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2713us (2917us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1762167011.147635:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3165 00000100:00100000:2.0:1762167011.150909:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.151055:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451984896 00000100:00100000:1.0:1762167011.151068:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451984896 00000100:00100000:1.0:1762167011.151166:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3166 00000100:00100000:1.0:1762167011.151179:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451984896:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.151226:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.151249:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bb75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f8f expref: 35 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.151258:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.151261:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.151264:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.151308:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bb75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f8f expref: 35 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.151329:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bb75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f8f expref: 35 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1762167011.151348:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454526336:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.151472:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.153108:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454526336:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.153143:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.153270:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.153331:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451985024 00000100:00100000:3.0:1762167011.153339:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451985024 00010000:00010000:3.0:1762167011.153388:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bb75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f8f expref: 36 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167011.153504:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7623 00000100:00100000:3.0:1762167011.153516:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765451985024:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.153534:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.153560:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bb75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f8f expref: 36 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.153579:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bb75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f8f expref: 36 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.153602:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bb75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f8f expref: 36 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.153617:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.153619:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.153624:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.153638:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.153666:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.153691:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.153707:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.153731:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451985024:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 216us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.153741:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7623 00010000:00010000:1.0:1762167011.155947:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.155965:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.155974:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.155981:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a28800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.155985:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.155994:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.156010:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.156016:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bca2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.156093:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451984896:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4913us (5199us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.156103:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3166 00000100:00100000:3.0:1762167011.158308:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.158372:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451985152 00000100:00100000:1.0:1762167011.158381:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451985152 00000100:00100000:1.0:1762167011.158441:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3167 00000100:00100000:1.0:1762167011.158448:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451985152:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.158477:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.158495:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f9d expref: 30 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.158504:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.158506:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.158509:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.158544:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f9d expref: 30 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.158557:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f9d expref: 30 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1762167011.158572:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454526464:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.158652:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.160209:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454526464:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167011.160224:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167011.160251:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.160342:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451985280 00000100:00100000:3.0:1762167011.160369:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451985280 00010000:00010000:3.0:1762167011.160425:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f9d expref: 31 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167011.160469:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7624 00000100:00100000:3.0:1762167011.160481:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451985280:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.160502:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.160536:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f9d expref: 31 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.160551:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f9d expref: 31 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.160580:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bb91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f9d expref: 31 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.160600:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.160603:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.160608:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.160619:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.160659:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.160694:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.160706:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.160738:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451985280:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 253us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.160749:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7624 00010000:00010000:1.0:1762167011.162870:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.162892:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.162903:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.162911:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.162916:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.162926:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.162948:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.162956:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bca9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.163060:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451985152:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4604us (4751us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.163077:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3167 00000100:00100000:2.0:1762167011.166331:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.166421:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451985408 00000100:00100000:1.0:1762167011.166441:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451985408 00000100:00100000:1.0:1762167011.166558:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3168 00000100:00100000:1.0:1762167011.166573:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451985408:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.166636:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.166666:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bbad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fab expref: 34 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.166675:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.166677:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.166680:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.166728:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bbad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fab expref: 34 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.166743:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bbad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fab expref: 34 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1762167011.166800:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454526592:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.166933:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.168290:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454526592:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.168326:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.168966:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.169072:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451985536 00000100:00100000:3.0:1762167011.169082:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451985536 00010000:00010000:3.0:1762167011.169128:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bbad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fab expref: 35 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167011.169165:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7625 00000100:00100000:3.0:1762167011.169172:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765451985536:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.169188:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.169214:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bbad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fab expref: 35 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.169225:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bbad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fab expref: 35 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.169250:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bbad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fab expref: 35 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.169264:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.169266:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.169270:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.169278:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.169309:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167011.169380:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f286680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765451985536:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 207us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.169386:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7625 00010000:00010000:1.0:1762167011.169435:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.169442:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.172189:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.172210:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.172220:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.172227:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.172231:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.172241:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.172261:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.172272:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcb0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.172389:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451985408:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5814us (6060us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.172404:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3168 00000100:00100000:0.0:1762167011.176555:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.176632:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451985664 00000100:00100000:1.0:1762167011.176648:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451985664 00000100:00100000:1.0:1762167011.176739:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3169 00000100:00100000:1.0:1762167011.176749:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451985664:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.176821:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.176853:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bbc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb9 expref: 33 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.176864:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.176867:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.176871:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.176924:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bbc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb9 expref: 33 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.176942:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bbc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb9 expref: 33 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1762167011.176970:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454526720:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.177082:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.178554:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454526720:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.178591:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.178879:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.178999:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451985792 00000100:00100000:3.0:1762167011.179008:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451985792 00010000:00010000:3.0:1762167011.179052:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bbc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb9 expref: 34 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167011.179100:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7626 00000100:00100000:3.0:1762167011.179111:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765451985792:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.179126:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.179150:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bbc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb9 expref: 34 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.179163:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bbc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb9 expref: 34 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.179237:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bbc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fb9 expref: 34 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.179252:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.179254:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.179259:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.179268:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.179300:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.179331:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.179345:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.179371:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765451985792:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 260us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.179382:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7626 00010000:00010000:1.0:1762167011.181244:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.181264:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.181273:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.181281:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.181286:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.181295:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.181317:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.181325:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.181440:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451985664:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4687us (4895us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.181452:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3169 00000100:00100000:0.0:1762167011.184131:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.184209:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451985920 00000100:00100000:1.0:1762167011.184221:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451985920 00000100:00100000:1.0:1762167011.184306:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3170 00000100:00100000:1.0:1762167011.184319:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765451985920:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.184367:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.184385:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bbe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc7 expref: 29 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.184391:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.184393:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.184396:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.184428:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bbe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc7 expref: 29 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.184443:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bbe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc7 expref: 29 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1762167011.184455:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454526848:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.184534:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.186393:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454526848:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167011.186450:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167011.186456:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.186540:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451986048 00000100:00100000:3.0:1762167011.186549:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451986048 00010000:00010000:3.0:1762167011.186586:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bbe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc7 expref: 30 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167011.186671:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7627 00000100:00100000:3.0:1762167011.186680:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451986048:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.186694:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.186722:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bbe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc7 expref: 30 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.186736:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bbe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc7 expref: 30 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.186780:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bbe5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fc7 expref: 30 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.186798:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.186800:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.186805:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.186817:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.186848:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.186858:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.186867:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.186915:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451986048:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 235us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.186923:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7627 00010000:00010000:1.0:1762167011.189435:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.189456:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.189464:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.189471:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.189476:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.189486:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.189508:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.189515:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bcbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.189605:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2358:x1847765451985920:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5284us (5479us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.189615:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3170 00000100:00100000:2.0:1762167011.193063:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.193108:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451986176 00000100:00100000:1.0:1762167011.193119:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451986176 00000100:00100000:1.0:1762167011.193204:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3171 00000100:00100000:1.0:1762167011.193214:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451986176:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.193264:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.193284:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bc01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fd5 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.193292:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.193294:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.193299:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.193337:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bc01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fd5 expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.193350:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bc01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fd5 expref: 28 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1762167011.193378:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454526976:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.193465:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.194707:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454526976:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.194736:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.194901:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.194956:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451986304 00000100:00100000:3.0:1762167011.195011:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451986304 00010000:00010000:3.0:1762167011.195034:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bc01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fd5 expref: 29 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167011.195058:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7628 00000100:00100000:3.0:1762167011.195064:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451986304:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.195073:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.195090:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bc01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fd5 expref: 29 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.195097:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bc01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fd5 expref: 29 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.195113:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bc01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fd5 expref: 29 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.195128:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.195130:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.195133:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.195141:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.195156:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.195177:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.195187:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765451986304:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 121us (286us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167011.195190:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.195196:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7628 00010000:00010000:1.0:1762167011.196833:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.196848:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.196855:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.196866:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.196871:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.196878:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.196894:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.196901:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.196969:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451986176:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3754us (3912us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.196978:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3171 00000100:00100000:0.0:1762167011.200090:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.200145:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451986432 00000100:00100000:1.0:1762167011.200156:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451986432 00000100:00100000:1.0:1762167011.200224:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3172 00000100:00100000:1.0:1762167011.200236:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451986432:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.200276:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.200298:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bc1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fe3 expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.200312:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.200314:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.200319:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.200363:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bc1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fe3 expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.200378:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bc1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fe3 expref: 32 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1762167011.200395:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454527104:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.200487:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.201732:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454527104:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.201759:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.202128:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.202239:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451986560 00000100:00100000:3.0:1762167011.202247:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451986560 00010000:00010000:3.0:1762167011.202284:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bc1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fe3 expref: 33 pid: 33892 timeout: 731 lvb_type: 0 00000100:00100000:3.0:1762167011.202321:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7629 00000100:00100000:3.0:1762167011.202330:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765451986560:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.202344:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.202381:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bc1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fe3 expref: 33 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.202395:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bc1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fe3 expref: 33 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.202420:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bc1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fe3 expref: 33 pid: 33892 timeout: 731 lvb_type: 0 00010000:00010000:3.0:1762167011.202439:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.202442:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.202447:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.202456:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.202485:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167011.202537:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765451986560:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 207us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.202548:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7629 00010000:00010000:1.0:1762167011.202581:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.202593:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.205047:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.205075:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.205085:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.205093:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.205098:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.205107:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.205125:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.205132:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bccc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.205284:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451986432:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5044us (5196us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.205301:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3172 00000100:00100000:0.0:1762167011.208345:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.208650:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451986688 00000100:00100000:1.0:1762167011.208664:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451986688 00000100:00100000:1.0:1762167011.208754:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3173 00000100:00100000:1.0:1762167011.208784:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451986688:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.208824:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.208846:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bc39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff1 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.208854:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.208856:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.208860:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.208898:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bc39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff1 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.208913:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bc39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff1 expref: 27 pid: 6532 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.208928:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454527232:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.209034:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.211064:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454527232:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.211099:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.211121:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.211220:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451986816 00000100:00100000:3.0:1762167011.211267:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451986816 00010000:00010000:3.0:1762167011.211304:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bc39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff1 expref: 28 pid: 6532 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167011.211346:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7630 00000100:00100000:3.0:1762167011.211368:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451986816:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.211391:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.211416:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bc39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff1 expref: 28 pid: 6532 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.211429:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bc39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff1 expref: 28 pid: 6532 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.211452:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bc39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff1 expref: 28 pid: 6532 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.211467:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.211469:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.211473:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.211542:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.211569:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.211588:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.211601:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.211627:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451986816:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 272us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.211635:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7630 00010000:00010000:1.0:1762167011.213562:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.213581:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.213589:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.213596:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.213600:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.213608:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.213624:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.213632:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.213711:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451986688:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4945us (5373us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.213721:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3173 00000100:00100000:2.0:1762167011.221867:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.221999:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451986944 00000100:00100000:3.0:1762167011.222009:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451986944 00000100:00100000:3.0:1762167011.222075:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 661 00000100:00100000:3.0:1762167011.222085:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56221:x1847765451986944:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:3.0:1762167011.222107:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.222139:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0bc8d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb400d expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.222161:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee346ae3c00) 00010000:00010000:3.0:1762167011.222165:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167011.222233:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56221:x1847765451986944:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 149us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.222240:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 661 00000100:00100000:0.0:1762167011.225374:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.225466:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451987200 00000100:00100000:1.0:1762167011.225477:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451987200 00000100:00100000:1.0:1762167011.225539:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7383 00000100:00100000:1.0:1762167011.225549:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56221:x1847765451987200:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:1.0:1762167011.225880:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56221:x1847765451987200:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 331us (524us total) trans 8589953121 rc 0/0 00000100:00100000:1.0:1762167011.225888:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7383 00000100:00100000:0.0:1762167011.228732:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.228830:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451987456 00000100:00100000:1.0:1762167011.228841:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451987456 00000100:00100000:1.0:1762167011.228898:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20027 00000100:00100000:1.0:1762167011.228908:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765451987456:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167011.228932:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.228954:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcda lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4014 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.229059:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.229075:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fff expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.229085:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.229116:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fff expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.229129:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fff expref: 897 pid: 30817 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.229143:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454527360:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.229223:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.230755:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454527360:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.230803:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.231198:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.231364:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451987584 00000100:00100000:3.0:1762167011.231372:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451987584 00010000:00010000:3.0:1762167011.231406:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fff expref: 898 pid: 30817 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167011.231446:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7631 00000100:00100000:3.0:1762167011.231457:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451987584:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.231470:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.231478:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fff expref: 898 pid: 30817 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.231494:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fff expref: 898 pid: 30817 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.231515:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bc6a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3fff expref: 898 pid: 30817 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.231530:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee346ae3c00) 00010000:00010000:3.0:1762167011.231535:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.231543:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.231550:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.231587:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167011.231639:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765451987584:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 185us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.231648:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7631 00010000:00010000:2.0:1762167011.231709:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.231717:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.231732:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:2.0:1762167011.231901:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bcda lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4014 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.231917:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4014 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.231923:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee346ae3c00) 00010000:00010000:2.0:1762167011.231926:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167011.231929:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29400, rc 0) 00000100:00100000:2.0:1762167011.231972:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451987456:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 3066us (3247us total) trans 8589953122 rc 0/0 00000100:00100000:2.0:1762167011.231979:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20027 00000100:00100000:0.0:1762167011.233539:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.233636:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451987712 00000100:00100000:2.0:1762167011.233654:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451987712 00000100:00100000:2.0:1762167011.233736:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20028 00000100:00100000:2.0:1762167011.233748:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451987712:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167011.233807:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.233836:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bcef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb401b expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.234042:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.234058:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4014 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.234067:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.234107:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4014 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.234122:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4014 expref: 898 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.234136:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454527488:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167011.234238:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167011.235454:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454527488:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167011.235499:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.235545:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.235682:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451987840 00000100:00100000:3.0:1762167011.235692:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451987840 00010000:00010000:3.0:1762167011.235742:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4014 expref: 899 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167011.235833:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7632 00000100:00100000:3.0:1762167011.235845:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2361:x1847765451987840:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.235863:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.235872:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4014 expref: 899 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.235888:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4014 expref: 899 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.235911:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bce1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4014 expref: 899 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.235928:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee346ae3c00) 00010000:00010000:3.0:1762167011.235933:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.235942:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.235950:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.235979:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.236001:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.236008:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167011.236031:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765451987840:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 188us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.236039:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7632 00000004:00200000:2.0:1762167011.236045:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.236050:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.236065:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.236088:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bcef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb401b expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.236099:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb401b expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.236106:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee346ae3c00) 00010000:00010000:2.0:1762167011.236109:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.236117:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:2.0:1762167011.236159:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24785b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451987712:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2414us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.236167:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20028 00000100:00100000:0.0:1762167011.237500:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.237595:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451987968 00000100:00100000:2.0:1762167011.237600:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451987968 00000100:00100000:2.0:1762167011.237644:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17358 00000100:00100000:2.0:1762167011.237653:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765451987968:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167011.237668:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.237686:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bcfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4022 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167011.237711:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888de, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:2.0:1762167011.237728:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.237731:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.237738:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bcfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4022 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.237758:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bcfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4022 expref: 27 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.237804:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1da00, rc 0) 00000100:00100000:2.0:1762167011.237843:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451987968:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 190us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.237850:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17358 00000100:00100000:0.0:1762167011.240110:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.240185:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451988096 00000100:00100000:1.0:1762167011.240193:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451988096 00002000:00100000:1.0:1762167011.240237:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (122880->126975) req@ffff9ee247858380 x1847765451988096/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.240247:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247858380 with x1847765451988096 ext(122880->126975) 00002000:00010000:1.0:1762167011.240253:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee247858380 00000100:00100000:1.0:1762167011.240280:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3174 00000100:00100000:1.0:1762167011.240291:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451988096:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:1.0:1762167011.240469:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451988096:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 182us (365us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762167011.240475:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3174 00002000:00100000:1.0:1762167011.240480:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (122880->126975) req@ffff9ee247858380 x1847765451988096/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/4536 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.240485:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247858380 with x1847765451988096 ext(122880->126975) 00002000:00010000:1.0:1762167011.240487:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee247858380 00000100:00100000:0.0:1762167011.242552:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.242651:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451988224 00000100:00100000:1.0:1762167011.242659:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451988224 00002000:00100000:1.0:1762167011.242698:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (126976->131071) req@ffff9ee247859f80 x1847765451988224/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.242708:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247859f80 with x1847765451988224 ext(126976->131071) 00002000:00010000:1.0:1762167011.242714:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee247859f80 00000100:00100000:1.0:1762167011.242744:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3175 00000100:00100000:1.0:1762167011.242754:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451988224:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:1.0:1762167011.242956:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451988224:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 203us (415us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762167011.242965:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3175 00002000:00100000:1.0:1762167011.242979:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (126976->131071) req@ffff9ee247859f80 x1847765451988224/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/4536 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.242988:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee247859f80 with x1847765451988224 ext(126976->131071) 00002000:00010000:1.0:1762167011.242991:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee247859f80 00000100:00100000:0.0:1762167011.244689:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.244810:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451988352 00000100:00100000:1.0:1762167011.244820:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451988352 00002000:00100000:1.0:1762167011.244862:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (102400->167935) req@ffff9ee372a4e300 x1847765451988352/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 504/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.244874:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4e300 with x1847765451988352 ext(102400->167935) 00002000:00010000:1.0:1762167011.244879:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4e300 00000100:00100000:1.0:1762167011.244906:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3176 00000100:00100000:1.0:1762167011.244917:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451988352:12345-192.168.203.35@tcp:3:lfs.0 00000100:00100000:1.0:1762167011.246210:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451988352:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 1291us (1523us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1762167011.246222:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3176 00002000:00100000:1.0:1762167011.246231:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (102400->167935) req@ffff9ee372a4e300 x1847765451988352/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 504/440 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.246247:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4e300 with x1847765451988352 ext(102400->167935) 00002000:00010000:1.0:1762167011.246251:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4e300 00000100:00100000:0.0:1762167011.249746:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.249842:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451988480 00000100:00100000:1.0:1762167011.249859:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451988480 00002000:00100000:1.0:1762167011.249941:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (28672->73727) req@ffff9ee372a4d180 x1847765451988480/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.249955:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4d180 with x1847765451988480 ext(28672->73727) 00002000:00010000:1.0:1762167011.249963:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4d180 00000100:00100000:1.0:1762167011.250009:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3177 00000100:00100000:1.0:1762167011.250021:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451988480:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167011.251902:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451988480:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1868us (2158us total) trans 0 rc 45056/45056 00000100:00100000:1.0:1762167011.251920:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3177 00002000:00100000:1.0:1762167011.251935:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (28672->73727) req@ffff9ee372a4d180 x1847765451988480/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/440 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.251947:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4d180 with x1847765451988480 ext(28672->73727) 00002000:00010000:1.0:1762167011.251953:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4d180 00000100:00100000:0.0:1762167011.255013:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.255136:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451988608 00000100:00100000:1.0:1762167011.255148:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451988608 00002000:00100000:1.0:1762167011.255194:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (204800->262143) req@ffff9ee372a4ce00 x1847765451988608/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.255204:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4ce00 with x1847765451988608 ext(204800->262143) 00002000:00010000:1.0:1762167011.255210:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4ce00 00000100:00100000:1.0:1762167011.255251:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3178 00000100:00100000:1.0:1762167011.255261:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451988608:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167011.257145:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451988608:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1879us (2142us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1762167011.257162:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3178 00002000:00100000:1.0:1762167011.257174:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81c:0x0] (204800->262143) req@ffff9ee372a4ce00 x1847765451988608/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/440 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.257184:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee372a4ce00 with x1847765451988608 ext(204800->262143) 00002000:00010000:1.0:1762167011.257190:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee372a4ce00 00000100:00100000:0.0:1762167011.259394:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.259462:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451988864 00000100:00100000:1.0:1762167011.259472:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451988864 00000100:00100000:1.0:1762167011.259529:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7384 00000100:00100000:1.0:1762167011.259539:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765451988864:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167011.259783:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451988864:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 245us (404us total) trans 8589953123 rc 0/0 00000100:00100000:1.0:1762167011.259791:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7384 00000100:00100000:0.0:1762167011.261148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.261210:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451989120 00000100:00100000:2.0:1762167011.261219:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451989120 00000100:00100000:2.0:1762167011.261272:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20029 00000100:00100000:2.0:1762167011.261282:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765451989120:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167011.261300:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.261303:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:2.0:1762167011.261328:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1dc00/0xf915a5bdf3d0bcf6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb401b expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.261348:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bc78 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4006 expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.261372:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bc4e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3ff8 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.261382:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee346ae3c00) 00010000:00010000:2.0:1762167011.261394:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.261407:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bd04 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4029 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.261458:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd0b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.261470:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd0b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.261479:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd0b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:2.0:1762167011.262118:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5606, 88 off453552 00000004:00080000:2.0:1762167011.262128:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632054364514ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.262177:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5614, 88 off454608 00000004:00080000:2.0:1762167011.262182:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632054419438ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.262223:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5615, 88 off454696 00000004:00080000:2.0:1762167011.262228:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632054464979ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.262249:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5607, 88 off453640 00000004:00080000:2.0:1762167011.262254:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632054491223ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.262289:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5616, 88 off454784 00000004:00080000:2.0:1762167011.262294:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632054530702ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.262324:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5608, 88 off453728 00000004:00080000:2.0:1762167011.262329:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632054566375ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.262371:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5609, 88 off453816 00000004:00080000:2.0:1762167011.262377:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632054613812ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.262398:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5617, 88 off454872 00000004:00080000:2.0:1762167011.262402:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632054639643ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.262436:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5618, 88 off454960 00000004:00080000:2.0:1762167011.262440:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632054677477ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.262456:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5610, 88 off453904 00000004:00080000:2.0:1762167011.262460:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632054697245ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.262496:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5619, 88 off455048 00000004:00080000:2.0:1762167011.262501:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632054738650ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.262552:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5611, 88 off453992 00000004:00080000:2.0:1762167011.262558:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632054795218ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.262591:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5612, 88 off454080 00000004:00080000:2.0:1762167011.262596:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632054832820ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.262626:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5620, 88 off455136 00000004:00080000:2.0:1762167011.262631:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632054868737ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.262662:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5613, 88 off454168 00000004:00080000:2.0:1762167011.262668:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632054904840ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.262698:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5621, 88 off455224 00000004:00080000:2.0:1762167011.262703:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632054940711ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.262735:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5622, 88 off455312 00000004:00080000:2.0:1762167011.262740:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632054977453ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.262796:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5614, 88 off454256 00000004:00080000:2.0:1762167011.262801:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632055038350ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.262827:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5615, 88 off454344 00000004:00080000:2.0:1762167011.262832:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632055068925ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.262852:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5623, 88 off455400 00000004:00080000:2.0:1762167011.262856:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632055093528ns, next at 630703976179ns, rc = 0 00000001:00080000:1.0:1762167011.278065:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953118 is committed 00010000:00010000:0.0:1762167011.278083:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4029 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167011.278088:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953123 is committed 00010000:00010000:0.0:1762167011.278099:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167011.278102:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000001:00080000:1.0:1762167011.278103:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953124 is committed 00000004:00080000:1.0:1762167011.278110:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3734 committed 00010000:00010000:0.0:1762167011.278119:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bd04 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4029 expref: 893 pid: 30819 timeout: 0 lvb_type: 3 00000004:00080000:1.0:1762167011.278127:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3721 committed 00010000:00010000:0.0:1762167011.278135:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4029 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167011.278141:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3720 committed 00000004:00080000:1.0:1762167011.278146:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3733 committed 00000004:00080000:1.0:1762167011.278149:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3732 committed 00000004:00080000:1.0:1762167011.278151:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3719 committed 00000004:00080000:1.0:1762167011.278154:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3731 committed 00000004:00080000:1.0:1762167011.278157:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3718 committed 00000004:00080000:1.0:1762167011.278160:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3717 committed 00000004:00080000:1.0:1762167011.278163:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3730 committed 00000004:00080000:1.0:1762167011.278165:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3716 committed 00000004:00080000:1.0:1762167011.278167:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3729 committed 00000004:00080000:1.0:1762167011.278170:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3728 committed 00010000:00010000:0.0:1762167011.278170:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00000004:00080000:1.0:1762167011.278175:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3715 committed 00010000:00010000:0.0:1762167011.278177:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1762167011.278179:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3714 committed 00010000:00010000:0.0:1762167011.278181:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000004:00080000:1.0:1762167011.278183:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3727 committed 00000004:00080000:1.0:1762167011.278188:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3713 committed 00000004:00080000:1.0:1762167011.278191:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3726 committed 00000004:00080000:1.0:1762167011.278195:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3725 committed 00000004:00080000:1.0:1762167011.278198:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3712 committed 00000100:00100000:1.0:1762167011.278232:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762167011.278255:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454527616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.278259:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451989120:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 16976us (17113us total) trans 8589953124 rc 0/0 00000100:00100000:0.0:1762167011.278271:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20029 00000100:00100000:0.0:1762167011.278306:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454527744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.278324:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.278373:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454528256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.278380:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454527872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.278384:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.278393:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454528128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.278422:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.278427:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454528384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.278433:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454527616 00000100:00100000:3.0:1762167011.278441:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454527616 00000100:00100000:1.0:1762167011.278443:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454527744 00000100:00100000:1.0:1762167011.278449:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454527744 00000100:00100000:2.0:1762167011.278456:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454528768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.278464:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.278488:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.278489:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454528256 00000100:00100000:0.0:1762167011.278493:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454529024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.278494:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454528256 00000100:00100000:1.0:1762167011.278502:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454528384 00000100:00100000:1.0:1762167011.278507:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454528384 00000100:00100000:2.0:1762167011.278515:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454529408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.278524:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454528768 00000100:00100000:3.0:1762167011.278528:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454528768 00000100:00100000:0.0:1762167011.278532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.278540:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454529024 00000100:00100000:1.0:1762167011.278546:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454529024 00000100:00100000:2.0:1762167011.278549:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.278553:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee34371a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454529536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.278555:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17359 00000100:00100000:3.0:1762167011.278570:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454527616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.278572:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454529408 00000100:00100000:1.0:1762167011.278577:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454529408 00000100:00100000:0.0:1762167011.278588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.278592:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17360 00000100:00100000:2.0:1762167011.278602:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454527744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.278604:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454529536 00000100:00100000:1.0:1762167011.278609:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454529536 00000100:00100000:1.0:1762167011.278632:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17361 00000100:00100000:1.0:1762167011.278640:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454528256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.278750:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17362 00002000:00010000:2.0:1762167011.278787:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.278792:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.278794:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.278795:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.278797:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00000100:00100000:0.0:1762167011.278797:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1847765454528384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167011.278798:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.278803:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167011.278818:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.278823:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.278826:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167011.278829:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.278831:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.278843:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3295:x1847765454527744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (460us total) trans 17179876044 rc 0/0 00000100:00100000:2.0:1762167011.278851:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17360 00002000:00010000:3.0:1762167011.278858:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762167011.278861:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167011.278863:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.278868:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17363 00000100:00100000:2.0:1762167011.278876:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454528768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.278897:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454528256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 257us (475us total) trans 21474843613 rc 0/0 00000100:00100000:3.0:1762167011.278904:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3293:x1847765454527616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 337us (581us total) trans 17179876043 rc 0/0 00000100:00100000:1.0:1762167011.278910:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17361 00000100:00100000:3.0:1762167011.278919:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17359 00000100:00100000:3.0:1762167011.278938:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17364 00002000:00010000:0.0:1762167011.278943:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167011.278946:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3295:x1847765454529024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.278949:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17365 00002000:00010000:0.0:1762167011.278951:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.278958:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167011.278961:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000100:00100000:1.0:1762167011.278965:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454529408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167011.278966:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167011.278980:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.278984:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.278986:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167011.278989:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.278991:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.279006:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1847765454528384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 246us (542us total) trans 17179876045 rc 0/0 00000100:00100000:0.0:1762167011.279014:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17362 00000100:00100000:2.0:1762167011.279027:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454528768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (538us total) trans 21474843614 rc 0/0 00000100:00100000:2.0:1762167011.279036:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17363 00000100:00100000:0.0:1762167011.279043:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17366 00000100:00100000:0.0:1762167011.279054:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454529536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167011.279073:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.279081:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.279084:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167011.279087:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.279089:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.279123:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3295:x1847765454529024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (595us total) trans 17179876046 rc 0/0 00000100:00100000:3.0:1762167011.279128:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17364 00000100:00100000:1.0:1762167011.279139:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454529408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 178us (590us total) trans 21474843615 rc 0/0 00000100:00100000:1.0:1762167011.279148:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17365 00000100:00100000:3.0:1762167011.279166:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167011.279178:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762167011.279184:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:1.0:1762167011.279185:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454527872 00002000:00010000:0.0:1762167011.279187:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:1.0:1762167011.279190:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454527872 00002000:00010000:0.0:1762167011.279192:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000100:00100000:3.0:1762167011.279196:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454528512:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167011.279198:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167011.279223:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17367 00000100:00100000:2.0:1762167011.279234:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454527872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.279243:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.279244:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1847765454529536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 189us (654us total) trans 21474843616 rc 0/0 00000100:00100000:0.0:1762167011.279254:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17366 00000100:00100000:0.0:1762167011.279276:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454528512 00000100:00100000:3.0:1762167011.279277:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454528640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.279281:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454528512 00000004:00080000:1.0:1762167011.279283:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee343718380/2, rc 0, transno 21474843613 00000100:00100000:1.0:1762167011.279298:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454528256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.279309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167011.279316:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34371b100/2, rc 0, transno 21474843614 00000100:00100000:1.0:1762167011.279323:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454528768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.279324:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454528640 00000100:00100000:0.0:1762167011.279331:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454528640 00000100:00100000:3.0:1762167011.279332:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454529152:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167011.279335:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762167011.279339:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.279342:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00000004:00080000:1.0:1762167011.279342:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee343719880/2, rc 0, transno 21474843615 00002000:00010000:2.0:1762167011.279349:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.279365:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 105 -> 105 00000100:00100000:1.0:1762167011.279365:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454529408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.279373:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17368 00000100:00100000:3.0:1762167011.279377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.279386:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454528512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.279394:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454527872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (228us total) trans 21474843617 rc 0/0 00000100:00100000:2.0:1762167011.279401:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17367 00000004:00080000:3.0:1762167011.279407:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee343719c00/2, rc 0, transno 21474843617 00000100:00100000:3.0:1762167011.279411:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454527872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.279413:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454529152 00000100:00100000:2.0:1762167011.279416:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454529152 00000100:00100000:3.0:1762167011.279433:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17369 00000100:00100000:2.0:1762167011.279437:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17370 00000100:00100000:3.0:1762167011.279441:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454528640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.279444:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee34371aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454529152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167011.279544:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.279547:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.279551:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000100:00100000:0.0:1762167011.279553:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454528512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (310us total) trans 17179876047 rc 0/0 00002000:00010000:2.0:1762167011.279554:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.279561:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.279567:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17368 00000100:00100000:2.0:1762167011.279586:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454529152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (212us total) trans 21474843618 rc 0/0 00000100:00100000:2.0:1762167011.279594:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17370 00000004:00080000:0.0:1762167011.279608:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284e00/2, rc 0, transno 17179876045 00000100:00100000:0.0:1762167011.279618:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454528384:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167011.279628:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc5180/2, rc 0, transno 17179876046 00000100:00100000:0.0:1762167011.279632:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454529024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167011.279643:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee34371a680/2, rc 0, transno 21474843616 00000100:00100000:0.0:1762167011.279647:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee34371a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454529536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.279654:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee34371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454528640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (260us total) trans 21474843619 rc 0/0 00000004:00080000:0.0:1762167011.279658:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f287480/2, rc 0, transno 17179876044 00000100:00100000:0.0:1762167011.279665:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454527744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.279666:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17369 00000100:00100000:0.0:1762167011.279680:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762167011.279687:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454529664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.279696:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.279720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.279724:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee343718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454528000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.279738:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762167011.279744:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454528128 00000100:00100000:2.0:1762167011.279750:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454528128 00000100:00100000:3.0:1762167011.279757:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.279807:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454529664 00000100:00100000:3.0:1762167011.279812:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454528896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.279814:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454529664 00000100:00100000:2.0:1762167011.279819:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454528000 00000100:00100000:1.0:1762167011.279822:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454529792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.279825:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454528000 00000100:00100000:3.0:1762167011.279842:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.279849:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454528896 00000100:00100000:2.0:1762167011.279854:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17371 00000100:00100000:0.0:1762167011.279855:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454528896 00000100:00100000:3.0:1762167011.279856:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454529280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.279866:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454528128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.279886:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17372 00000100:00100000:0.0:1762167011.279898:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3295:x1847765454529664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.279914:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167011.279969:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f286680/2, rc 0, transno 17179876047 00000100:00100000:1.0:1762167011.279980:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454528512:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167011.279984:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f284000/2, rc 0, transno 17179876043 00000100:00100000:3.0:1762167011.279994:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454527616:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167011.280012:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee343719f80/2, rc 0, transno 21474843619 00000100:00100000:1.0:1762167011.280024:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454528640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.280028:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454529280 00000100:00100000:2.0:1762167011.280034:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454528128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (331us total) trans 17179876048 rc 0/0 00000100:00100000:3.0:1762167011.280039:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454529280 00000100:00100000:2.0:1762167011.280044:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17371 00000004:00080000:1.0:1762167011.280058:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee343719500/2, rc 0, transno 21474843618 00000100:00100000:1.0:1762167011.280069:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454529152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.280070:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17373 00000100:00100000:0.0:1762167011.280089:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454529664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (365us total) trans 17179876049 rc 0/0 00000100:00100000:3.0:1762167011.280094:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454528000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.280100:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17372 00000100:00100000:0.0:1762167011.280120:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17374 00000100:00100000:0.0:1762167011.280131:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454528896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.280172:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17375 00000100:00100000:2.0:1762167011.280179:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454529280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167011.280187:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.280190:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.280192:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.280194:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.280197:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.280225:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454528000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 140us (467us total) trans 21474843620 rc 0/0 00000100:00100000:3.0:1762167011.280231:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17373 00000004:00080000:3.0:1762167011.280271:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f287100/2, rc 0, transno 17179876048 00000100:00100000:3.0:1762167011.280277:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454528128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.280282:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454528896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (440us total) trans 17179876050 rc 0/0 00002000:00010000:2.0:1762167011.280287:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167011.280287:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17374 00000004:00080000:3.0:1762167011.280290:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee343718000/2, rc 0, transno 21474843620 00002000:00010000:2.0:1762167011.280293:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:3.0:1762167011.280295:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee343718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454528000:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167011.280296:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167011.280298:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.280301:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:3.0:1762167011.280306:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36f285180/2, rc 0, transno 17179876050 00000100:00100000:3.0:1762167011.280310:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454528896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167011.280323:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc4000/2, rc 0, transno 17179876049 00000100:00100000:0.0:1762167011.280331:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454529664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.280333:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.280350:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454529280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (439us total) trans 17179876051 rc 0/0 00000100:00100000:0.0:1762167011.280364:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454529792 00000100:00100000:0.0:1762167011.280369:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454529792 00000100:00100000:2.0:1762167011.280374:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17375 00000100:00100000:2.0:1762167011.280394:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17376 00000100:00100000:2.0:1762167011.280402:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454529792:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167011.280405:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc6a00/2, rc 0, transno 17179876051 00000100:00100000:1.0:1762167011.280414:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454529280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.280424:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762167011.280432:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454529920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.280448:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762167011.280459:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454530048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.280474:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167011.280486:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.280491:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.280493:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00000100:00100000:3.0:1762167011.280495:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454529920 00002000:00010000:2.0:1762167011.280495:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000100:00100000:3.0:1762167011.280498:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454529920 00002000:00010000:2.0:1762167011.280498:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.280531:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17377 00000100:00100000:2.0:1762167011.280534:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3294:x1847765454529792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (204us total) trans 17179876052 rc 0/0 00000100:00100000:3.0:1762167011.280539:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454529920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.280540:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17376 00002000:00010000:3.0:1762167011.280614:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.280616:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.280618:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167011.280620:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.280622:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.280658:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454529920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (194us total) trans 21474843621 rc 0/0 00000100:00100000:3.0:1762167011.280665:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17377 00000004:00080000:1.0:1762167011.280695:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee242520380/2, rc 0, transno 21474843621 00000004:00080000:3.0:1762167011.280699:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc5500/2, rc 0, transno 17179876052 00000100:00100000:1.0:1762167011.280703:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454529920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.280708:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454529792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.280724:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.280747:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454530048 00000100:00100000:1.0:1762167011.280753:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454530048 00000100:00100000:1.0:1762167011.280827:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17378 00000100:00100000:1.0:1762167011.280835:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454530048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.280968:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3296:x1847765454530048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (241us total) trans 21474843622 rc 0/0 00000100:00100000:1.0:1762167011.280976:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17378 00000004:00080000:3.0:1762167011.280999:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240f480/2, rc 0, transno 21474843622 00000100:00100000:3.0:1762167011.281006:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454530048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.281243:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.281310:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451989248 00000100:00100000:1.0:1762167011.281315:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451989248 00000100:00100000:1.0:1762167011.281346:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17379 00000100:00100000:1.0:1762167011.281366:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765451989248:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167011.281376:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.281393:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4030 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.281423:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0bb1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f7a expref: 28 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167011.281432:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.281434:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.281438:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [90112->118783] (req 90112->118783) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 28 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.281464:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0bb1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f7a expref: 28 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167011.281477:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0bb1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f7a expref: 28 pid: 33892 timeout: 732 lvb_type: 1 00000100:00100000:1.0:1762167011.281489:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454530176:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.281555:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e240 going to sleep for 11 seconds 00000100:00100000:0.0:1762167011.284013:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.284145:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454530176:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167011.284155:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451989376 00000100:00100000:3.0:1762167011.284164:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451989376 00010000:00010000:1.0:1762167011.284179:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [90112->118783] (req 90112->118783) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 29 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.284198:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0bb1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f7a expref: 29 pid: 33892 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1762167011.284200:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28800, rc 0) 00000100:00100000:3.0:1762167011.284249:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7633 00000100:00100000:3.0:1762167011.284259:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451989376:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.284272:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.284295:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0bb1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f7a expref: 29 pid: 33892 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.284310:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0bb1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f7a expref: 29 pid: 33892 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.284336:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0bb1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f7a expref: 29 pid: 33892 timeout: 732 lvb_type: 1 00000100:00100000:1.0:1762167011.284342:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56065:x1847765451989248:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2985us (3105us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.284369:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17379 00010000:00010000:3.0:1762167011.284371:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.284376:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.284384:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->118783) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.284401:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->118783) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.284436:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->118783) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.284451:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454530304:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167011.284502:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2427206c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167011.285953:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454530304:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167011.285978:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167011.286020:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451989376:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1762us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.286029:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7633 00000100:00100000:2.0:1762167011.286458:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.286555:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451989504 00000100:00100000:1.0:1762167011.286562:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451989504 00002000:00100000:1.0:1762167011.286604:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (61440->126975) req@ffff9ee37fcc4700 x1847765451989504/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.286616:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc4700 with x1847765451989504 ext(61440->126975) 00002000:00010000:1.0:1762167011.286621:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc4700 00000100:00100000:1.0:1762167011.286656:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3179 00000100:00100000:1.0:1762167011.286665:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451989504:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167011.288666:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2358:x1847765451989504:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1994us (2202us total) trans 0 rc 65536/65536 00000100:00100000:1.0:1762167011.288681:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3179 00002000:00100000:1.0:1762167011.288692:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (61440->126975) req@ffff9ee37fcc4700 x1847765451989504/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/440 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.288702:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc4700 with x1847765451989504 ext(61440->126975) 00002000:00010000:1.0:1762167011.288707:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc4700 00000100:00100000:0.0:1762167011.290606:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.290670:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451989632 00000100:00100000:2.0:1762167011.290679:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451989632 00000100:00100000:2.0:1762167011.290733:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20030 00000100:00100000:2.0:1762167011.290744:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765451989632:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167011.290786:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.290807:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bd19 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4037 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.290909:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.290922:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.290932:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.290957:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.290961:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.290977:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.291002:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0bd19 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4037 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.291019:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4037 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.291026:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.291029:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.291032:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167011.291082:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451989632:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 340us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.291087:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20030 00000100:00100000:2.0:1762167011.295254:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.295368:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451989760 00000100:00100000:1.0:1762167011.295379:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451989760 00002000:00100000:1.0:1762167011.295430:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (12288->61439) req@ffff9ee37fcc5c00 x1847765451989760/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.295441:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc5c00 with x1847765451989760 ext(12288->61439) 00002000:00010000:1.0:1762167011.295448:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc5c00 00000100:00100000:1.0:1762167011.295483:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3180 00000100:00100000:1.0:1762167011.295493:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451989760:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167011.297093:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451989760:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1592us (1839us total) trans 0 rc 49152/49152 00000100:00100000:1.0:1762167011.297112:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3180 00002000:00100000:1.0:1762167011.297125:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (12288->61439) req@ffff9ee37fcc5c00 x1847765451989760/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/440 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.297136:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc5c00 with x1847765451989760 ext(12288->61439) 00002000:00010000:1.0:1762167011.297141:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc5c00 00000100:00100000:0.0:1762167011.301019:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.301086:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451989888 00000100:00100000:1.0:1762167011.301097:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451989888 00002000:00100000:1.0:1762167011.301143:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->12287) req@ffff9ee347b02a00 x1847765451989888/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.301155:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b02a00 with x1847765451989888 ext(4096->12287) 00002000:00010000:1.0:1762167011.301161:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b02a00 00000100:00100000:1.0:1762167011.301190:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3181 00000100:00100000:1.0:1762167011.301201:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451989888:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167011.301451:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765451989888:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 252us (438us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1762167011.301460:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3181 00002000:00100000:1.0:1762167011.301468:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->12287) req@ffff9ee347b02a00 x1847765451989888/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/8632 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.301477:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee347b02a00 with x1847765451989888 ext(4096->12287) 00002000:00010000:1.0:1762167011.301480:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee347b02a00 00000100:00100000:2.0:1762167011.305477:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.305564:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451990016 00000100:00100000:1.0:1762167011.305575:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451990016 00002000:00100000:1.0:1762167011.305635:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->118783) req@ffff9ee37fcc5880 x1847765451990016/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 504/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.305652:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc5880 with x1847765451990016 ext(4096->118783) 00002000:00010000:1.0:1762167011.305658:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc5880 00000100:00100000:1.0:1762167011.305699:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3182 00000100:00100000:1.0:1762167011.305711:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451990016:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:1.0:1762167011.307990:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765451990016:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 2273us (2515us total) trans 21474843623 rc 0/0 00000100:00100000:1.0:1762167011.308004:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3182 00002000:00100000:1.0:1762167011.308020:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->118783) req@ffff9ee37fcc5880 x1847765451990016/t21474843623(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 504/448 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.308032:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc5880 with x1847765451990016 ext(4096->118783) 00002000:00010000:1.0:1762167011.308039:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc5880 00000100:00100000:0.0:1762167011.309268:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.309335:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451990144 00000100:00100000:1.0:1762167011.309343:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451990144 00000100:00100000:1.0:1762167011.309408:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17380 00000100:00100000:1.0:1762167011.309418:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451990144:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167011.324558:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843616 is committed 00000001:00080000:1.0:1762167011.324586:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843601 is committed 00000001:00080000:1.0:1762167011.324599:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843623 is committed 00000001:00080000:1.0:1762167011.324607:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843622 is committed 00000100:00100000:2.0:1762167011.324680:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451990144:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 15257us (15408us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.324692:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17380 00000100:00100000:2.0:1762167011.328395:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.328491:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451990272 00000100:00100000:1.0:1762167011.328501:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451990272 00002000:00100000:1.0:1762167011.328548:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->126975) req@ffff9ee37fcc4a80 x1847765451990272/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 16872/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.328561:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc4a80 with x1847765451990272 ext(110592->126975) 00002000:00010000:1.0:1762167011.328567:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc4a80 00000100:00100000:1.0:1762167011.328600:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3183 00000100:00100000:1.0:1762167011.328608:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451990272:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:1.0:1762167011.329162:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765451990272:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 553us (777us total) trans 21474843624 rc 0/0 00000100:00100000:1.0:1762167011.329171:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3183 00002000:00100000:1.0:1762167011.329179:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->126975) req@ffff9ee37fcc4a80 x1847765451990272/t21474843624(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 16872/448 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.329188:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcc4a80 with x1847765451990272 ext(110592->126975) 00002000:00010000:1.0:1762167011.329192:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcc4a80 00000100:00100000:0.0:1762167011.330475:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.330538:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451990400 00000100:00100000:2.0:1762167011.330545:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451990400 00000100:00100000:2.0:1762167011.330589:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17381 00000100:00100000:2.0:1762167011.330600:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451990400:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:1.0:1762167011.346006:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843624 is committed 00000100:00100000:2.0:1762167011.346454:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451990400:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 15843us (15970us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.346469:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17381 00000100:00100000:0.0:1762167011.350517:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.350638:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451990656 00000100:00100000:1.0:1762167011.350650:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451990656 00000100:00100000:1.0:1762167011.350722:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7385 00000100:00100000:1.0:1762167011.350734:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765451990656:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:1.0:1762167011.351088:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765451990656:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 355us (579us total) trans 8589953125 rc 0/0 00000100:00100000:1.0:1762167011.351096:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7385 00000100:00100000:0.0:1762167011.361514:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.361627:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451990784 00000100:00100000:2.0:1762167011.361638:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451990784 00000100:00100000:2.0:1762167011.361699:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20031 00000100:00100000:2.0:1762167011.361710:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56222:x1847765451990784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.361733:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.361752:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bd27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb403e expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.361839:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd2e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.361852:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd2e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.361861:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd2e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.361874:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd35 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.361881:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.361886:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.361991:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.361999:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362005:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.362037:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.362043:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.362060:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362072:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362079:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd2e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362084:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd2e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362090:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd2e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362096:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.362099:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd2e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362107:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd2e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362118:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167011.362121:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.362126:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd2e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362131:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd2e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362144:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362150:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd35 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362155:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362159:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.362162:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362167:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd35 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362174:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee381d9b200) 00010000:00010000:2.0:1762167011.362176:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.362178:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd35 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362183:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd35 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.362212:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bd27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb403e expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.362225:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb403e expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.362231:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.362233:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.362236:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167011.362300:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56222:x1847765451990784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 592us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.362319:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20031 00000100:00100000:1.0:1762167011.368277:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.368474:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.368524:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451991168 00000100:00100000:0.0:1762167011.368534:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451991168 00000100:00100000:0.0:1762167011.369177:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20032 00000100:00100000:0.0:1762167011.369190:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56222:x1847765451991168:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167011.369213:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167011.369233:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bd43 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4045 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.369371:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.369395:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4037 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.369404:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb403e expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.369413:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 5/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.369447:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb403e expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.369460:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb403e expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1762167011.369474:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454530432:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167011.369515:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451990912 00000100:00100000:3.0:1762167011.369520:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451990912 00010000:00010000:3.0:1762167011.369544:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 6/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb403e expref: 895 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1762167011.369557:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4037 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.369568:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4037 expref: 895 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1762167011.369580:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454530560:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167011.369581:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7634 00000100:00100000:3.0:1762167011.369595:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451990912:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.369606:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762167011.369610:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2af00 going to sleep for 11 seconds 00010000:00010000:3.0:1762167011.369614:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb403e expref: 895 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.369629:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb403e expref: 895 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.369647:0:5741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167011.369652:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.369659:0:5741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.369666:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167011.369691:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451990912:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 99us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.369698:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7634 00000100:00100000:0.0:1762167011.372067:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.372148:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454530560:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167011.372165:0:30819:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.203.35@tcp) returned -22 from blocking AST (req@00000000c9f494bb x1847765454530432) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 1/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb403e expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.372184:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd3c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb403e expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.372199:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454530432:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167011.372223:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451991296 00010000:00010000:2.0:1762167011.372224:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00000100:00100000:3.0:1762167011.372232:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451991296 00010000:00010000:2.0:1762167011.372233:0:30819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.372245:0:30819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.372257:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.372270:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4037 expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167011.372309:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7635 00000100:00100000:3.0:1762167011.372319:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451991296:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.372333:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.372347:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4037 expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.372370:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4037 expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.372395:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd20 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4037 expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.372411:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167011.372415:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.372422:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.372429:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.372459:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167011.372520:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2360:x1847765451991296:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 202us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.372528:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7635 00010000:00010000:2.0:1762167011.372538:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.372544:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.372562:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:2.0:1762167011.372713:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0bd43 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4045 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.372728:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4045 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.372735:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.372738:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167011.372741:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ce00, rc 0) 00000100:00100000:2.0:1762167011.372859:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56222:x1847765451991168:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3672us (4386us total) trans 8589953126 rc 0/0 00000100:00100000:2.0:1762167011.372867:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20032 00000100:00100000:0.0:1762167011.374598:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.374688:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451991424 00000100:00100000:2.0:1762167011.374697:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451991424 00000100:00100000:2.0:1762167011.374758:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20033 00000100:00100000:2.0:1762167011.374796:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56222:x1847765451991424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.374819:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.374838:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bd58 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb404c expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.374923:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.374937:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4045 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.374945:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.374981:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4045 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.374995:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4045 expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.375009:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454530688:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167011.375088:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762167011.378046:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.378132:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454530688:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167011.378160:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167011.378517:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451991552 00000100:00100000:3.0:1762167011.378525:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451991552 00010000:00010000:3.0:1762167011.378560:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4045 expref: 895 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167011.378598:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7636 00000100:00100000:3.0:1762167011.378606:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765451991552:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.378619:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.378625:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4045 expref: 895 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.378636:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4045 expref: 895 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.378662:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bd4a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4045 expref: 895 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.378676:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167011.378681:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.378690:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.378697:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.378724:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167011.378804:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2360:x1847765451991552:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 198us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.378811:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7636 00010000:00010000:2.0:1762167011.378872:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.378883:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.378944:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.378950:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.378970:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.379002:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bd58 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb404c expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.379018:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb404c expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.379027:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.379030:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.379033:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d200, rc 0) 00000100:00100000:2.0:1762167011.379078:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56222:x1847765451991424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 4285us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.379086:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20033 00000100:00100000:0.0:1762167011.381188:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.381469:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451991808 00000100:00100000:2.0:1762167011.381480:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451991808 00000100:00100000:2.0:1762167011.381537:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20034 00000100:00100000:2.0:1762167011.381548:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56222:x1847765451991808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.381571:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.381591:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd66 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4053 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.381696:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd6d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.381710:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd6d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.381721:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd6d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.381746:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:2.0:1762167011.381920:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd66 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4053 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.381939:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd6d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4053 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.381961:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.381964:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167011.381967:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:2.0:1762167011.382032:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56222:x1847765451991808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 484us (851us total) trans 8589953127 rc 0/0 00000100:00100000:2.0:1762167011.382039:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20034 00000100:00100000:1.0:1762167011.384516:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.384557:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.384591:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.384685:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451991936 00000100:00100000:2.0:1762167011.384694:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451991936 00000100:00100000:2.0:1762167011.384747:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451992064 00000100:00100000:2.0:1762167011.384751:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451992064 00000100:00100000:2.0:1762167011.384792:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451992192 00000100:00100000:2.0:1762167011.384796:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451992192 00000100:00100000:2.0:1762167011.384820:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17382 00000100:00100000:2.0:1762167011.384830:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451991936:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:2.0:1762167011.384872:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.384889:0:6532:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->118783) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.384902:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167011.384904:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167011.384908:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.384941:0:6532:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->118783) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.384954:0:6532:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->118783) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 18 pid: 6532 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.384969:0:6532:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454530816:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167011.385049:0:6532:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762167011.385066:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17383 00000100:00100000:2.0:1762167011.385079:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17384 00000100:00100000:3.0:1762167011.385082:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451992064:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:2.0:1762167011.385093:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451992192:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167011.385109:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.385117:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.385125:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bb21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f81 expref: 31 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.385134:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bb28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f88 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167011.385137:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.385141:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.385147:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.385147:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.385151:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.385156:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.385179:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f81 expref: 31 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.385190:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bb28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f88 expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167011.385194:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bb21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f81 expref: 31 pid: 6532 timeout: 732 lvb_type: 1 00010000:00010000:2.0:1762167011.385213:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bb28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f88 expref: 18 pid: 26444 timeout: 732 lvb_type: 1 00000100:00100000:3.0:1762167011.385219:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454530944:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167011.385233:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454531072:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167011.385256:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:2.0:1762167011.385268:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3606c9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762167011.387186:0:6532:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6532:1847765454530816:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.387201:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167011.387213:0:6532:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.387246:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.387376:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454531072:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167011.387393:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.387434:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454530944:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167011.387449:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451992320 00000100:00100000:1.0:1762167011.387449:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451992448 00010000:00010000:3.0:1762167011.387453:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.387457:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451992320 00000100:00100000:1.0:1762167011.387457:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451992448 00010000:00010000:2.0:1762167011.387493:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bb21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f81 expref: 32 pid: 6532 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1762167011.387496:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->118783) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 19 pid: 6532 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.387582:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7637 00000100:00100000:2.0:1762167011.387590:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7638 00000100:00100000:1.0:1762167011.387592:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451992448:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167011.387596:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765451992320:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167011.387606:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167011.387606:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1762167011.387625:0:5742:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 105 -> 309 00010000:00010000:2.0:1762167011.387628:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bb21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f81 expref: 32 pid: 6532 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1762167011.387630:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->118783) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 19 pid: 6532 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.387640:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bb21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f81 expref: 32 pid: 6532 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1762167011.387641:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->118783) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 19 pid: 6532 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1762167011.387661:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bd12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->118783) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4030 expref: 19 pid: 6532 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.387663:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0bb21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f81 expref: 32 pid: 6532 timeout: 732 lvb_type: 1 00010000:00010000:2.0:1762167011.387678:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.387678:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.387681:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.387681:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.387686:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.387686:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.387696:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.387696:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.387715:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.387717:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.387731:0:6532:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.387742:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.387754:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451992320:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 157us (553us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167011.387787:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.387791:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7638 00010000:00010000:1.0:1762167011.387796:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.387803:0:6532:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.387809:0:6532:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.387814:0:6532:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.387822:0:6532:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.387833:0:6532:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.387839:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bd7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.387953:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.387962:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.387978:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.387985:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.388035:0:6533:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.388043:0:6533:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167011.388047:0:6533:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.388055:0:6533:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.388066:0:6533:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.388073:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bd82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.388092:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451992448:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 501us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167011.388100:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7637 00000100:00100000:3.0:1762167011.388121:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451992064:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3046us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.388130:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17383 00000100:00100000:1.0:1762167011.388162:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451991936:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3334us (3655us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.388170:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17382 00000100:00100000:1.0:1762167011.388593:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.388640:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451992576 00000100:00100000:0.0:1762167011.388646:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451992576 00010000:00010000:0.0:1762167011.388668:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bb28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f88 expref: 17 pid: 26444 timeout: 732 lvb_type: 1 00000100:00100000:0.0:1762167011.388704:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7639 00000100:00100000:0.0:1762167011.388712:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765451992576:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167011.388722:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167011.388744:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bb28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f88 expref: 17 pid: 26444 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1762167011.388758:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bb28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f88 expref: 17 pid: 26444 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1762167011.388804:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bb28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3f88 expref: 17 pid: 26444 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1762167011.388816:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.388818:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.388821:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.388829:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.388859:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167011.388895:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765451992576:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 183us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167011.388902:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7639 00010000:00010000:2.0:1762167011.389088:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.389100:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.389120:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.389128:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.389140:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.389146:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167011.389149:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.389156:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.389166:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.389173:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bd89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.389231:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2359:x1847765451992192:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 4141us (4638us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.389238:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17384 00000100:00100000:1.0:1762167011.391195:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.391247:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451992832 00000100:00100000:2.0:1762167011.391256:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451992832 00000100:00100000:2.0:1762167011.391311:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20035 00000100:00100000:2.0:1762167011.391321:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56222:x1847765451992832:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.391398:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762167011.391432:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bd5f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb404c expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.391454:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd0b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4029 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.391464:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.391486:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.391518:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.391536:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.391545:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:2.0:1762167011.392174:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5616, 88 off454432 00000004:00080000:2.0:1762167011.392183:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632184419881ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.392249:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5624, 88 off455488 00000004:00080000:2.0:1762167011.392255:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632184492116ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.392292:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5625, 88 off455576 00000004:00080000:2.0:1762167011.392297:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632184534684ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.392316:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5617, 88 off454520 00000004:00080000:2.0:1762167011.392320:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632184557419ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.392349:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5626, 88 off455664 00000004:00080000:2.0:1762167011.392364:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632184600929ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.392389:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5618, 88 off454608 00000004:00080000:2.0:1762167011.392393:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632184630704ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.392421:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5619, 88 off454696 00000004:00080000:2.0:1762167011.392426:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632184662774ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.392454:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5627, 88 off455752 00000004:00080000:2.0:1762167011.392458:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632184694957ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.392474:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5628, 88 off455840 00000004:00080000:2.0:1762167011.392478:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632184715554ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.392496:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5620, 88 off454784 00000004:00080000:2.0:1762167011.392500:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632184737246ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.392535:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5629, 88 off455928 00000004:00080000:2.0:1762167011.392540:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632184777722ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.392572:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5621, 88 off454872 00000004:00080000:2.0:1762167011.392577:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632184814505ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.392593:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5622, 88 off454960 00000004:00080000:2.0:1762167011.392597:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632184834324ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.392615:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5630, 88 off456016 00000004:00080000:2.0:1762167011.392618:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632184855235ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.392634:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5623, 88 off455048 00000004:00080000:2.0:1762167011.392638:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632184875684ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.392654:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5631, 88 off456104 00000004:00080000:2.0:1762167011.392658:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632184895226ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.392674:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5632, 88 off456192 00000004:00080000:2.0:1762167011.392678:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632184915362ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.392695:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5624, 88 off455136 00000004:00080000:2.0:1762167011.392699:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632184936592ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.392715:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5625, 88 off455224 00000004:00080000:2.0:1762167011.392720:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632184956859ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.392735:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5633, 88 off456280 00000004:00080000:2.0:1762167011.392739:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632184975987ns, next at 630703976179ns, rc = 0 00000001:00080000:1.0:1762167011.414937:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953125 is committed 00000001:00080000:1.0:1762167011.414956:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953128 is committed 00000004:00080000:1.0:1762167011.414960:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3744 committed 00000004:00080000:1.0:1762167011.414976:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3731 committed 00000004:00080000:1.0:1762167011.414987:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3730 committed 00000004:00080000:1.0:1762167011.414989:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3743 committed 00000004:00080000:1.0:1762167011.414991:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3742 committed 00000004:00080000:1.0:1762167011.414994:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3729 committed 00000004:00080000:1.0:1762167011.414996:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3741 committed 00000004:00080000:1.0:1762167011.414998:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3728 committed 00000004:00080000:1.0:1762167011.415000:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3727 committed 00000004:00080000:1.0:1762167011.415002:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3740 committed 00000004:00080000:1.0:1762167011.415004:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3726 committed 00000004:00080000:1.0:1762167011.415006:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3739 committed 00000004:00080000:1.0:1762167011.415008:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3738 committed 00000004:00080000:1.0:1762167011.415010:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3725 committed 00000004:00080000:1.0:1762167011.415012:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3724 committed 00000004:00080000:1.0:1762167011.415013:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3737 committed 00000004:00080000:1.0:1762167011.415015:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3723 committed 00000004:00080000:1.0:1762167011.415017:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3736 committed 00000004:00080000:1.0:1762167011.415018:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3735 committed 00000004:00080000:1.0:1762167011.415020:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3722 committed 00000100:00100000:2.0:1762167011.415242:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454531584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.415311:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.415339:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454532096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.415368:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.415388:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1762167011.415393:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454531200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.415409:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.415421:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454531712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.415436:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.415461:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454531584 00000100:00100000:2.0:1762167011.415467:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454531584 00000100:00100000:2.0:1762167011.415505:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454532096 00000100:00100000:2.0:1762167011.415508:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454532096 00000100:00100000:2.0:1762167011.415522:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454531200 00000100:00100000:2.0:1762167011.415525:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454531200 00000100:00100000:2.0:1762167011.415541:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454531712 00000100:00100000:2.0:1762167011.415543:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454531712 00000100:00100000:2.0:1762167011.415560:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17385 00000100:00100000:2.0:1762167011.415568:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3295:x1847765454531584:12345-0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1762167011.415643:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002519f000 reply state 00000000ae30d78d transno 8589953128 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.415655:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167011.415731:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454531456:0@lo:2:osp-syn-1-0.0 00010000:00080000:0.0:1762167011.415733:0:30819:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00002000:00010000:2.0:1762167011.415749:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167011.415750:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56222:x1847765451992832:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 24428us (24560us total) trans 8589953128 rc 0/0 00002000:00010000:2.0:1762167011.415753:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.415756:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167011.415758:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20035 00002000:00010000:2.0:1762167011.415759:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.415784:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.415789:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762167011.415820:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.415830:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.415837:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.415843:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167011.415847:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167011.415851:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454531328:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762167011.415859:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.415875:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167011.415878:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167011.415882:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.415888:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bd90 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.415924:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454531456 00000100:00100000:0.0:1762167011.415927:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454531456 00000100:00100000:0.0:1762167011.415942:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17386 00000100:00100000:0.0:1762167011.415947:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3295:x1847765454532096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167011.416019:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.416022:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.416024:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167011.416026:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.416028:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.416589:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454531584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1020us (1276us total) trans 17179876053 rc 0/0 00000100:00100000:2.0:1762167011.416597:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17385 00000100:00100000:2.0:1762167011.416614:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17387 00000100:00100000:2.0:1762167011.416652:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3295:x1847765454531200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167011.416728:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.416731:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167011.416733:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167011.416735:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167011.416737:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.416758:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454531200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (1348us total) trans 17179876055 rc 0/0 00000100:00100000:2.0:1762167011.416782:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17387 00000100:00100000:2.0:1762167011.416799:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17388 00000100:00100000:2.0:1762167011.416807:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3295:x1847765454531712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.416812:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454531968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.416848:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.416882:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454531968 00000100:00100000:3.0:1762167011.416887:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454531968 00000100:00100000:1.0:1762167011.416905:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.416911:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454532096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 962us (1541us total) trans 17179876054 rc 0/0 00000100:00100000:3.0:1762167011.416912:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454531328 00000100:00100000:3.0:1762167011.416917:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454531328 00000100:00100000:1.0:1762167011.416922:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fcc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454531840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.416922:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17386 00000100:00100000:1.0:1762167011.416943:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.416947:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454531840 00000100:00100000:0.0:1762167011.416951:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454531840 00000100:00100000:3.0:1762167011.416955:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17389 00000100:00100000:3.0:1762167011.416965:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454531456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.416972:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17390 00000100:00100000:0.0:1762167011.416980:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3294:x1847765454531968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167011.417096:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.417100:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.417103:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167011.417105:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.417107:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167011.417112:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17391 00000100:00100000:3.0:1762167011.417125:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3294:x1847765454531456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (1335us total) trans 17179876056 rc 0/0 00000100:00100000:1.0:1762167011.417125:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454531328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.417135:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3294:x1847765454531968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (287us total) trans 17179876057 rc 0/0 00000100:00100000:3.0:1762167011.417141:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17389 00000100:00100000:0.0:1762167011.417148:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17390 00000100:00100000:3.0:1762167011.417163:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17392 00000100:00100000:3.0:1762167011.417175:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3293:x1847765454531840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.417254:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3293:x1847765454531328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (348us total) trans 17179876058 rc 0/0 00000100:00100000:1.0:1762167011.417261:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17391 00000100:00100000:1.0:1762167011.417282:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454532224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.417318:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.417327:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3293:x1847765454531840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (380us total) trans 17179876059 rc 0/0 00000100:00100000:3.0:1762167011.417337:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17392 00000100:00100000:1.0:1762167011.417340:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454532736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.417346:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454532224 00000100:00100000:0.0:1762167011.417349:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454532224 00000100:00100000:1.0:1762167011.417375:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.417378:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454532480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.417385:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454532736 00000100:00100000:0.0:1762167011.417389:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454532736 00000100:00100000:1.0:1762167011.417395:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1762167011.417403:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454532608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.417409:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17393 00000100:00100000:3.0:1762167011.417415:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.417419:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1847765454532224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.417429:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.417435:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454532992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.417445:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454533120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.417468:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.417477:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454532480 00000100:00100000:1.0:1762167011.417482:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454532480 00000100:00100000:1.0:1762167011.417500:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454532608 00000100:00100000:1.0:1762167011.417503:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454532608 00000004:00080000:3.0:1762167011.417512:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc5f80/2, rc 0, transno 17179876056 00000100:00100000:1.0:1762167011.417513:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454532992 00000100:00100000:1.0:1762167011.417517:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454532992 00000100:00100000:3.0:1762167011.417530:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454531456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.417532:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17394 00000100:00100000:1.0:1762167011.417541:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454532736:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167011.417552:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348255c00/2, rc 0, transno 17179876057 00000100:00100000:3.0:1762167011.417559:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454531968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.417571:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1762167011.417578:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454532352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.417613:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.417621:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454532224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (301us total) trans 21474843625 rc 0/0 00000100:00100000:0.0:1762167011.417629:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17393 00000100:00100000:3.0:1762167011.417631:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454532864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.417643:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454532352 00000100:00100000:0.0:1762167011.417648:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454532352 00002000:00010000:1.0:1762167011.417650:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.417653:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.417656:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:3.0:1762167011.417661:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167011.417662:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000100:00100000:0.0:1762167011.417665:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17395 00002000:00010000:1.0:1762167011.417667:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.417672:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454532480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.417696:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454532736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (321us total) trans 21474843626 rc 0/0 00000100:00100000:1.0:1762167011.417703:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17394 00000100:00100000:1.0:1762167011.417716:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454532864 00000100:00100000:1.0:1762167011.417719:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454532864 00000100:00100000:1.0:1762167011.417739:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17396 00000100:00100000:1.0:1762167011.417744:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454532608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167011.417785:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.417796:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.417798:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167011.417803:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.417805:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.417831:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454532480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (419us total) trans 21474843627 rc 0/0 00000100:00100000:3.0:1762167011.417864:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17397 00000100:00100000:0.0:1762167011.417871:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17395 00000100:00100000:3.0:1762167011.417876:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454532992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.417888:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17398 00000100:00100000:0.0:1762167011.417896:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454532352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.418013:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454532352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (400us total) trans 21474843628 rc 0/0 00000100:00100000:0.0:1762167011.418019:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17398 00000100:00100000:0.0:1762167011.418034:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17399 00000100:00100000:0.0:1762167011.418042:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454532864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.418106:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454532992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 233us (638us total) trans 21474843629 rc 0/0 00000100:00100000:3.0:1762167011.418114:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17397 00000100:00100000:2.0:1762167011.418135:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454531712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1328us (2695us total) trans 17179876060 rc 0/0 00002000:00010000:0.0:1762167011.418140:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167011.418143:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17388 00002000:00010000:0.0:1762167011.418143:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.418145:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167011.418147:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.418150:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.418153:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843622 gen 2 00000004:00080000:3.0:1762167011.418160:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348257b80, transno 21474843603 00000004:00080000:3.0:1762167011.418171:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348254700, transno 21474843604 00000100:00100000:0.0:1762167011.418176:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454532864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (518us total) trans 21474843630 rc 0/0 00000004:00080000:3.0:1762167011.418177:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348255f80, transno 21474843605 00000004:00080000:3.0:1762167011.418184:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d1180, transno 21474843606 00000004:00080000:2.0:1762167011.418187:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc6680/2, rc 0, transno 17179876055 00000100:00100000:0.0:1762167011.418187:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17399 00000004:00080000:3.0:1762167011.418190:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348256a00, transno 21474843607 00000100:00100000:2.0:1762167011.418194:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454531200:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167011.418197:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d1f80, transno 21474843608 00000004:00080000:3.0:1762167011.418203:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348257100, transno 21474843609 00000004:00080000:3.0:1762167011.418207:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d1500, transno 21474843610 00000004:00080000:2.0:1762167011.418209:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc7100/2, rc 0, transno 17179876060 00000004:00080000:3.0:1762167011.418211:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d0000, transno 21474843611 00000100:00100000:2.0:1762167011.418216:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454531712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167011.418217:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2477d0700, transno 21474843612 00000004:00080000:3.0:1762167011.418224:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee343718380, transno 21474843613 00000004:00080000:3.0:1762167011.418230:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34371b100, transno 21474843614 00000004:00080000:2.0:1762167011.418231:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc7800/2, rc 0, transno 17179876053 00000100:00100000:0.0:1762167011.418231:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454533376:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167011.418236:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee343719880, transno 21474843615 00000100:00100000:2.0:1762167011.418237:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454531584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167011.418243:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee34371a680, transno 21474843616 00000004:00080000:3.0:1762167011.418248:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee343719c00, transno 21474843617 00000004:00080000:2.0:1762167011.418251:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee348256d80/2, rc 0, transno 17179876054 00000004:00080000:3.0:1762167011.418252:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee343719500, transno 21474843618 00000100:00100000:2.0:1762167011.418256:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454532096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.418257:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167011.418260:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee343719f80, transno 21474843619 00000004:00080000:3.0:1762167011.418266:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee343718000, transno 21474843620 00000100:00100000:2.0:1762167011.418266:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:3.0:1762167011.418273:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee242520380, transno 21474843621 00000100:00100000:2.0:1762167011.418275:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454533248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167011.418278:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240f480, transno 21474843622 00000004:00080000:0.0:1762167011.418282:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc4380/2, rc 0, transno 17179876058 00000100:00100000:0.0:1762167011.418287:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454531328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.418291:0:3294:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee347b06a00 x1847765454532352/t21474843628(21474843628) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167027 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762167011.418297:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fcc7b80/2, rc 0, transno 17179876059 00000100:00100000:0.0:1762167011.418302:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fcc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454531840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.418305:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167011.418314:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b06a00/2, rc 0, transno 21474843628 00000100:00100000:3.0:1762167011.418321:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454532352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.418322:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454533376 00000100:00100000:2.0:1762167011.418328:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454533248 00000100:00100000:0.0:1762167011.418328:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454533376 00000100:00100000:2.0:1762167011.418331:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454533248 00000004:00080000:3.0:1762167011.418342:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b04e00/2, rc 0, transno 21474843630 00000100:00100000:3.0:1762167011.418350:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454532864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.418366:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17400 00000100:00100000:2.0:1762167011.418376:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17401 00000100:00100000:0.0:1762167011.418377:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454533376:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167011.418380:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b05880/2, rc 0, transno 21474843627 00000100:00100000:2.0:1762167011.418383:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3295:x1847765454533248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.418388:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454532480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167011.418400:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b05180/2, rc 0, transno 21474843629 00000100:00100000:3.0:1762167011.418405:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454532992:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167011.418477:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.418481:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.418483:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167011.418485:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.418488:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.418515:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3295:x1847765454533248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (211us total) trans 17179876062 rc 0/0 00000100:00100000:0.0:1762167011.418516:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3293:x1847765454533376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (260us total) trans 17179876061 rc 0/0 00000100:00100000:2.0:1762167011.418522:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17401 00000100:00100000:0.0:1762167011.418525:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17400 00000004:00080000:2.0:1762167011.418549:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240c000/2, rc 0, transno 17179876062 00000004:00080000:0.0:1762167011.418549:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240e300/2, rc 0, transno 17179876061 00000100:00100000:2.0:1762167011.418553:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454533248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.418553:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454533376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.418578:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167011.418599:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b07800/2, rc 0, transno 21474843626 00000100:00100000:2.0:1762167011.418600:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454533120 00000100:00100000:2.0:1762167011.418603:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454533120 00000100:00100000:0.0:1762167011.418603:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454532736:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167011.418611:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b06d80/2, rc 0, transno 21474843625 00000100:00100000:0.0:1762167011.418615:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454532224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.418621:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17402 00000100:00100000:2.0:1762167011.418626:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454533120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167011.418718:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762167011.418721:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.418723:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167011.418725:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.418728:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167011.418785:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454533120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (205us total) trans 21474843631 rc 0/0 00000100:00100000:2.0:1762167011.418792:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17402 00000100:00100000:1.0:1762167011.418813:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454532608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1068us (1382us total) trans 21474843632 rc 0/0 00000100:00100000:1.0:1762167011.418819:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17396 00000004:00080000:3.0:1762167011.418892:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 2 in flight, 20 done 00000004:00080000:0.0:1762167011.418913:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee347b04700/2, rc 0, transno 21474843632 00000100:00100000:0.0:1762167011.418919:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee347b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454532608:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167011.418928:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243180e00/2, rc 0, transno 21474843631 00000100:00100000:0.0:1762167011.418932:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454533120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.418980:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762167011.418988:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454533504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.419013:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.419060:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454533504 00000100:00100000:0.0:1762167011.419065:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454533504 00000100:00100000:3.0:1762167011.419082:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762167011.419094:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454533632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.419099:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17403 00000100:00100000:0.0:1762167011.419107:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454533504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.419130:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.419159:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454533632 00000100:00100000:2.0:1762167011.419164:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454533632 00000100:00100000:2.0:1762167011.419201:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17404 00000100:00100000:2.0:1762167011.419208:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454533632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167011.419212:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.419228:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.419230:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167011.419233:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.419235:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.419280:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454533504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (265us total) trans 21474843633 rc 0/0 00000100:00100000:0.0:1762167011.419287:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17403 00000100:00100000:2.0:1762167011.419361:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454533632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (221us total) trans 21474843634 rc 0/0 00000100:00100000:2.0:1762167011.419368:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17404 00000004:00080000:3.0:1762167011.419439:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240c380/2, rc 0, transno 21474843634 00000100:00100000:3.0:1762167011.419444:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454533632:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167011.419607:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240f480/2, rc 0, transno 21474843633 00000100:00100000:1.0:1762167011.419612:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454533504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.419842:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.419868:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451992960 00000100:00100000:2.0:1762167011.419872:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451992960 00000100:00100000:2.0:1762167011.419912:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20036 00000100:00100000:2.0:1762167011.419919:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56222:x1847765451992960:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.419934:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.419952:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd97 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb405a expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.420000:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd97 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb405a expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.420014:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd97 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb405a expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.420032:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.420036:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167011.420039:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:2.0:1762167011.420087:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56222:x1847765451992960:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 168us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.420094:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20036 00000100:00100000:2.0:1762167011.422021:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.422102:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993088 00000100:00100000:0.0:1762167011.422110:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993088 00000100:00100000:0.0:1762167011.422155:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20037 00000100:00100000:0.0:1762167011.422162:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56222:x1847765451993088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167011.422177:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167011.422191:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bd9e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4061 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.422250:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0bda5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.422261:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0bda5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.422276:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0bda5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167011.422302:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:0.0:1762167011.422307:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167011.422323:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0bda5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.422367:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0bd9e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4061 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.422386:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0bda5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4061 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.422394:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167011.422397:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167011.422400:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c400, rc 0) 00000100:00100000:0.0:1762167011.422447:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56222:x1847765451993088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 286us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167011.422453:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20037 00000100:00100000:1.0:1762167011.423812:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.423889:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993216 00000100:00100000:2.0:1762167011.423896:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993216 00000100:00100000:2.0:1762167011.423947:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17405 00000100:00100000:2.0:1762167011.423956:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+15:2358:x1847765451993216:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.423971:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.423990:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bdac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4068 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167011.424011:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888e3, ctime: 0x690888e3, blocks: 0x135 00010000:00010000:2.0:1762167011.424026:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.424029:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.424043:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bdac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4068 expref: 16 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.424058:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bdac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4068 expref: 16 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.424069:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d200, rc 0) 00000100:00100000:2.0:1762167011.424185:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765451993216:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 229us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.424191:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17405 00000100:00100000:3.0:1762167011.424211:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.424232:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993344 00000100:00100000:2.0:1762167011.424237:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993344 00000100:00100000:3.0:1762167011.424295:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.424580:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993472 00000100:00100000:2.0:1762167011.424584:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993472 00000100:00100000:2.0:1762167011.424617:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17406 00000100:00100000:2.0:1762167011.424624:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2359:x1847765451993344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.424631:0:6533:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.424642:0:6533:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bdb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb406f expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167011.424658:0:6533:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888e3, atime: 0x690888e3, ctime: 0x690888e3, blocks: 0x3 00010000:00010000:2.0:1762167011.424668:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.424671:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.424676:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb406f expref: 31 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.424686:0:6533:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb406f expref: 31 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.424693:0:6533:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167011.424717:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451993344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 95us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.424724:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17406 00000100:00100000:3.0:1762167011.424788:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17407 00000100:00100000:3.0:1762167011.424799:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765451993472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167011.424808:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.424821:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bdba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4076 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167011.424837:0:33892:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888e3, atime: 0x690888e3, ctime: 0x690888e3, blocks: 0x3 00010000:00010000:3.0:1762167011.424848:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.424850:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.424856:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bdba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4076 expref: 17 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167011.424873:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bdba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4076 expref: 17 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167011.424882:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167011.424906:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451993472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 111us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.424913:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17407 00000100:00100000:1.0:1762167011.428071:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.429441:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993600 00000100:00100000:2.0:1762167011.429455:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993600 00000100:00100000:2.0:1762167011.429523:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 121 00000100:00100000:2.0:1762167011.429533:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2358:x1847765451993600:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762167011.429607:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2358:x1847765451993600:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 76us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.429615:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 121 00000100:00100000:0.0:1762167011.453182:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.453346:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993728 00000100:00100000:1.0:1762167011.453380:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993728 00000100:00100000:1.0:1762167011.453449:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3184 00000100:00100000:1.0:1762167011.453459:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451993728:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.453491:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bdc1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.453505:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.453508:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.453513:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bdc1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.453526:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bdc1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.456440:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bdc1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.456472:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bdc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.456480:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bdc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.456486:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a28800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.456490:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bdc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.456498:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bdc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.456515:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bdc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.456521:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0bdc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.456610:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451993728:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3148us (3435us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.456621:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3184 00000100:00100000:2.0:1762167011.458956:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.459095:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993856 00000100:00100000:1.0:1762167011.459105:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993856 00000100:00100000:1.0:1762167011.459184:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3185 00000100:00100000:1.0:1762167011.459195:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765451993856:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167011.459241:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888d5, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.459250:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bdc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.459263:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.459266:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.459271:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.459284:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167011.478011:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876061 is committed 00000001:00080000:3.0:1762167011.478051:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876063 is committed 00000001:00080000:3.0:1762167011.478074:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876062 is committed 00010000:00010000:0.0:1762167011.478120:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.478133:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bdc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.478142:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.478149:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167011.478154:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.478162:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bdc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.478178:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bdc8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.478185:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0bdc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.478282:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451993856:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 19086us (19330us total) trans 17179876063 rc 0/0 00000100:00100000:0.0:1762167011.478299:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3185 00000100:00100000:3.0:1762167011.481530:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.481691:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451993984 00000100:00100000:0.0:1762167011.481702:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451993984 00000100:00100000:0.0:1762167011.481791:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3186 00000100:00100000:0.0:1762167011.481812:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451993984:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167011.481874:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888db, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:0.0:1762167011.481884:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.481898:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.481901:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.481907:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.481922:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167011.499677:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843635 is committed 00000001:00080000:1.0:1762167011.499703:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843633 is committed 00000001:00080000:1.0:1762167011.499727:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843634 is committed 00010000:00010000:2.0:1762167011.499740:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.499759:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.499806:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.499813:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167011.499817:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.499824:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.499842:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdcf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.499847:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.499992:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451993984:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 18185us (18463us total) trans 21474843635 rc 0/0 00000100:00100000:2.0:1762167011.500007:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3186 00000100:00100000:2.0:1762167011.503076:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.503155:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451994112 00000100:00100000:0.0:1762167011.503170:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451994112 00000100:00100000:0.0:1762167011.503270:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3187 00000100:00100000:0.0:1762167011.503283:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451994112:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167011.503350:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888db, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:0.0:1762167011.503372:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bdd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.503390:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.503393:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.503399:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bdd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.503414:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bdd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762167011.522486:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876064 is committed 00010000:00010000:0.0:1762167011.522528:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bdd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.522542:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bdd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.522552:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bdd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.522559:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167011.522565:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bdd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.522573:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bdd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.522598:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bdd6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.522607:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bdd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.522707:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451994112:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 19421us (19640us total) trans 17179876064 rc 0/0 00000100:00100000:0.0:1762167011.522721:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3187 00000100:00100000:1.0:1762167011.526015:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.526065:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451994240 00000100:00100000:0.0:1762167011.526077:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451994240 00000100:00100000:0.0:1762167011.526151:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3188 00000100:00100000:0.0:1762167011.526163:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451994240:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167011.526217:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888dd, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:0.0:1762167011.526226:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bddd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.526239:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.526241:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.526252:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.526264:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762167011.541464:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876065 is committed 00010000:00010000:0.0:1762167011.541544:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.541562:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.541570:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.541576:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167011.541581:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.541589:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bddd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.541607:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bddd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.541614:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bddd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.542005:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2358:x1847765451994240:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 15602us (15757us total) trans 17179876065 rc 0/0 00000100:00100000:0.0:1762167011.542016:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3188 00000100:00100000:2.0:1762167011.544510:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.544619:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451994368 00000100:00100000:0.0:1762167011.544628:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451994368 00000100:00100000:0.0:1762167011.544703:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3189 00000100:00100000:0.0:1762167011.544714:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451994368:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:0.0:1762167011.544798:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888dd, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:0.0:1762167011.544808:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bde4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.544822:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.544825:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.544830:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bde4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.544845:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bde4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.557881:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bde4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.557900:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bde4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.557915:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bde4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.557923:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30d200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167011.557928:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bde4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.557937:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bde4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.557956:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bde4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.557964:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0bde4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167011.558013:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843636 is committed 00000100:00100000:2.0:1762167011.558085:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451994368:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 13369us (13579us total) trans 21474843636 rc 0/0 00000100:00100000:2.0:1762167011.558097:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3189 00000100:00100000:2.0:1762167011.560716:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.560844:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451994496 00000100:00100000:0.0:1762167011.560854:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451994496 00000100:00100000:0.0:1762167011.560920:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3190 00000100:00100000:0.0:1762167011.560930:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2358:x1847765451994496:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:0.0:1762167011.560962:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.560979:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bcfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4022 expref: 17 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167011.560987:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.560989:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.560992:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.561142:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bcfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4022 expref: 17 pid: 6532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167011.561163:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bcfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4022 expref: 17 pid: 6532 timeout: 732 lvb_type: 1 00000100:00100000:0.0:1762167011.561179:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359067800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454533760:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167011.561268:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36de2a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167011.562329:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359067800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454533760:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167011.562350:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.562909:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.562975:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451994624 00000100:00100000:0.0:1762167011.562983:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451994624 00010000:00010000:0.0:1762167011.563011:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bcfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4022 expref: 18 pid: 6532 timeout: 732 lvb_type: 1 00000100:00100000:0.0:1762167011.563050:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7640 00000100:00100000:0.0:1762167011.563060:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765451994624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167011.563073:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167011.563094:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bcfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4022 expref: 18 pid: 6532 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1762167011.563107:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bcfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4022 expref: 18 pid: 6532 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1762167011.563129:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0bcfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4022 expref: 18 pid: 6532 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1762167011.563144:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.563147:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167011.563151:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.563166:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.563201:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167011.563256:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765451994624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 197us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167011.563265:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7640 00010000:00010000:1.0:1762167011.563298:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.563313:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167011.585010:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843637 is committed 00010000:00010000:2.0:1762167011.585121:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.585135:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.585144:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.585157:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30da00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167011.585162:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.585171:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.585189:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.585195:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0bdeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.585297:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765451994496:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 24365us (24586us total) trans 21474843637 rc 0/0 00000100:00100000:2.0:1762167011.585308:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3190 00000100:00100000:0.0:1762167011.589657:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.589747:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451994752 00000100:00100000:2.0:1762167011.589757:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451994752 00000100:00100000:2.0:1762167011.589867:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3191 00000100:00100000:2.0:1762167011.589878:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451994752:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:2.0:1762167011.589931:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888de, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:2.0:1762167011.589940:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bdf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.589953:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.589956:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.589963:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.589976:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.604709:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.604727:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bdf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.604740:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bdf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762167011.604747:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876066 is committed 00010000:00010000:1.0:1762167011.604748:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.604756:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bdf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.604791:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bdf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.604812:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bdf2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.604819:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bdf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.604913:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765451994752:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 15033us (15262us total) trans 17179876066 rc 0/0 00000100:00100000:1.0:1762167011.604924:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3191 00000100:00100000:0.0:1762167011.608313:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.608368:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451994880 00000100:00100000:1.0:1762167011.608382:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451994880 00000100:00100000:1.0:1762167011.608454:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3192 00000100:00100000:1.0:1762167011.608463:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765451994880:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167011.608507:0:26246:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888e0, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.608514:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bdf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.608525:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.608527:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.608531:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bdf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.608549:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bdf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167011.624308:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843638 is committed 00010000:00010000:1.0:1762167011.624318:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bdf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.624333:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bdf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.624342:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bdf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.624360:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee346a29400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.624366:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bdf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.624375:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bdf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.624397:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bdf9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.624403:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0bdf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.624484:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765451994880:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16017us (16175us total) trans 21474843638 rc 0/0 00000100:00100000:1.0:1762167011.624494:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3192 00000100:00100000:2.0:1762167011.634667:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.634807:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451995136 00000100:00100000:0.0:1762167011.634819:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451995136 00000100:00100000:0.0:1762167011.634893:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20038 00000100:00100000:0.0:1762167011.634904:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56222:x1847765451995136:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167011.634961:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167011.634990:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0bda5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4061 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.635012:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167011.635017:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167011.635285:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.635302:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.635311:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:0.0:1762167011.635385:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953129 00000004:00010000:0.0:1762167011.635414:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dff5fd0c reply state 00000000a73491ce transno 8589953130 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.635422:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167011.635511:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56222:x1847765451995136:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 610us (857us total) trans 8589953130 rc 0/0 00000100:00100000:0.0:1762167011.635519:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20038 00000020:00080000:0.0:1762167011.635526:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167011.637264:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.637279:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.637287:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.637293:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.637298:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.637306:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.637321:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.637325:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.637329:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.637335:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0be00 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.637530:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.637605:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451995264 00000100:00100000:1.0:1762167011.637615:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451995264 00000100:00100000:1.0:1762167011.637667:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17408 00000100:00100000:1.0:1762167011.637677:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56222:x1847765451995264:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167011.637694:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.637712:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0be07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb407d expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167011.637737:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888d5, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.637757:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.637759:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.637796:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0be07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb407d expref: 23 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.637813:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0be07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb407d expref: 23 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.637825:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29400, rc 0) 00000100:00100000:1.0:1762167011.637880:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56222:x1847765451995264:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 204us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.637891:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17408 00000100:00100000:0.0:1762167011.639174:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.639226:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451995392 00000100:00100000:1.0:1762167011.639233:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451995392 00002000:00010000:1.0:1762167011.639262:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (262144->18446744073709551615) 00002000:00100000:1.0:1762167011.639266:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359065c00 with x1847765451995392 ext(262144->18446744073709551615) 00002000:00010000:1.0:1762167011.639276:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359065c00. 00000100:00100000:1.0:1762167011.639303:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3193 00000100:00100000:1.0:1762167011.639310:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765451995392:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167011.639456:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.639516:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451995520 00000100:00100000:3.0:1762167011.639521:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451995520 00002000:00010000:1.0:1762167011.639594:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762167011.639599:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.639600:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00010000:1.0:1762167011.639603:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167011.639606:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00100000:3.0:1762167011.639611:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d1500 with x1847765451995520 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167011.639612:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:3.0:1762167011.639623:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d1500. 00000100:00100000:3.0:1762167011.639656:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3194 00000100:00100000:3.0:1762167011.639668:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765451995520:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167011.639671:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451995392:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 357us (498us total) trans 17179876067 rc 0/0 00000100:00100000:1.0:1762167011.639683:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3193 00002000:00010000:1.0:1762167011.639687:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (262144->18446744073709551615) 00002000:00100000:1.0:1762167011.639689:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee359065c00 with x1847765451995392 ext(262144->18446744073709551615) 00002000:00010000:1.0:1762167011.639694:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee359065c00. 00002000:00010000:3.0:1762167011.639897:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.639901:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.639904:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167011.639907:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.639910:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.639938:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765451995520:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 274us (483us total) trans 21474843639 rc 0/0 00000100:00100000:3.0:1762167011.639946:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3194 00002000:00010000:3.0:1762167011.639949:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:3.0:1762167011.639952:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2477d1500 with x1847765451995520 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167011.639957:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2477d1500. 00000100:00100000:0.0:1762167011.641451:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.641532:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451995648 00000100:00100000:2.0:1762167011.641548:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451995648 00000100:00100000:2.0:1762167011.641607:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20039 00000100:00100000:2.0:1762167011.641616:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56222:x1847765451995648:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.641641:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.641665:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0be0e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4084 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.641837:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0be15 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.641857:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0be15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.641867:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0be15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.641906:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.641910:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.641927:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0be15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.641960:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0be0e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4084 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.641986:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0be15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4084 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.642001:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.642004:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.642008:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167011.642075:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56222:x1847765451995648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 459us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.642083:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20039 00000100:00100000:0.0:1762167011.644400:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.644555:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451995904 00000100:00100000:2.0:1762167011.644564:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451995904 00000100:00100000:2.0:1762167011.644614:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20040 00000100:00100000:2.0:1762167011.644624:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56222:x1847765451995904:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.644670:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.644695:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0be15 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4084 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.644712:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.644717:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.645033:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.645051:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.645060:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167011.645129:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953131 00000004:00010000:2.0:1762167011.645158:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002d1b07cd reply state 0000000060624c75 transno 8589953132 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167011.645165:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.645267:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56222:x1847765451995904:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 644us (875us total) trans 8589953132 rc 0/0 00000100:00100000:2.0:1762167011.645275:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20040 00000020:00080000:2.0:1762167011.645285:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167011.646210:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.646222:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.646230:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.646236:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167011.646240:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.646248:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.646261:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:1.0:1762167011.646264:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167011.646268:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.646273:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0be1c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.646847:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.646914:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451996032 00000100:00100000:1.0:1762167011.646923:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451996032 00000100:00100000:1.0:1762167011.646984:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17409 00000100:00100000:1.0:1762167011.646994:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56222:x1847765451996032:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167011.647008:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.647028:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0be23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb408b expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167011.647051:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888db, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.647068:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.647070:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.647077:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0be23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb408b expref: 18 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.647096:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0be23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb408b expref: 18 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.647107:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29c00, rc 0) 00000100:00100000:1.0:1762167011.647157:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56222:x1847765451996032:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 164us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.647164:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17409 00000100:00100000:0.0:1762167011.648989:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.649093:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451996160 00000100:00100000:3.0:1762167011.649102:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451996160 00002000:00010000:3.0:1762167011.649136:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (262144->18446744073709551615) 00002000:00100000:3.0:1762167011.649140:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b3b80 with x1847765451996160 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762167011.649149:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b3b80. 00000100:00100000:3.0:1762167011.649173:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3195 00000100:00100000:3.0:1762167011.649181:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765451996160:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167011.649189:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.649326:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451996288 00000100:00100000:1.0:1762167011.649331:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451996288 00002000:00010000:1.0:1762167011.649363:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:1.0:1762167011.649371:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b1880 with x1847765451996288 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167011.649380:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b1880. 00000100:00100000:1.0:1762167011.649429:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3196 00000100:00100000:1.0:1762167011.649439:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2359:x1847765451996288:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167011.649533:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762167011.649536:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.649539:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167011.649541:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.649543:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167011.649593:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.649597:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.649600:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167011.649605:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000100:00100000:3.0:1762167011.649606:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2359:x1847765451996160:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 422us (624us total) trans 21474843640 rc 0/0 00002000:00010000:1.0:1762167011.649609:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.649620:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3195 00002000:00010000:3.0:1762167011.649625:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (262144->18446744073709551615) 00002000:00100000:3.0:1762167011.649628:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b3b80 with x1847765451996160 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762167011.649634:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36e3b3b80. 00000100:00100000:1.0:1762167011.649640:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765451996288:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 202us (453us total) trans 17179876068 rc 0/0 00000100:00100000:1.0:1762167011.649650:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3196 00002000:00010000:1.0:1762167011.649654:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:1.0:1762167011.649657:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36e3b1880 with x1847765451996288 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167011.649664:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36e3b1880. 00000100:00100000:0.0:1762167011.651939:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.652120:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451996416 00000100:00100000:2.0:1762167011.652130:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451996416 00000100:00100000:2.0:1762167011.652185:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20041 00000100:00100000:2.0:1762167011.652195:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56222:x1847765451996416:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.652220:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.652239:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0be2a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4092 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.652316:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be31 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.652332:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.652342:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.652382:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.652386:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.652403:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.652429:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0be2a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4092 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.652447:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be31 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4092 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.652456:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.652459:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.652463:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167011.652532:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56222:x1847765451996416:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 338us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.652540:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20041 00000100:00100000:0.0:1762167011.655462:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.655524:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451996672 00000100:00100000:2.0:1762167011.655537:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451996672 00000100:00100000:2.0:1762167011.655609:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20042 00000100:00100000:2.0:1762167011.655622:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56222:x1847765451996672:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.655695:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.655729:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be31 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4092 expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.655799:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.655815:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.656130:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.656147:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.656163:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167011.656221:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953133 00000004:00010000:2.0:1762167011.656248:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000518e76c4 reply state 0000000094cc61d4 transno 8589953134 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167011.656257:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.656372:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56222:x1847765451996672:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 751us (921us total) trans 8589953134 rc 0/0 00000100:00100000:2.0:1762167011.656380:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20042 00000020:00080000:2.0:1762167011.656388:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762167011.659391:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167011.659473:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.659486:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.659495:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.659500:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00000100:00100000:1.0:1762167011.659504:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451996800 00010000:00010000:2.0:1762167011.659506:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.659516:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167011.659516:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451996800 00010000:00010000:2.0:1762167011.659535:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.659538:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.659554:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.659561:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be38 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167011.659571:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17410 00000100:00100000:1.0:1762167011.659582:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56222:x1847765451996800:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167011.659598:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.659617:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0be3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4099 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167011.659642:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888db, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.659661:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.659664:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.659671:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0be3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4099 expref: 26 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.659686:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0be3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4099 expref: 26 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.659696:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28800, rc 0) 00000100:00100000:1.0:1762167011.659751:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56222:x1847765451996800:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 171us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.659759:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17410 00000100:00100000:0.0:1762167011.662304:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.662339:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.662372:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451996928 00000100:00100000:2.0:1762167011.662381:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451996928 00000100:00100000:1.0:1762167011.662421:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451997056 00002000:00010000:2.0:1762167011.662423:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (262144->18446744073709551615) 00000100:00100000:1.0:1762167011.662426:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451997056 00002000:00100000:2.0:1762167011.662428:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f331500 with x1847765451996928 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.662439:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36f331500. 00002000:00010000:1.0:1762167011.662442:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:1.0:1762167011.662445:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f333480 with x1847765451997056 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167011.662450:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f333480. 00000100:00100000:2.0:1762167011.662471:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3197 00000100:00100000:2.0:1762167011.662480:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765451996928:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167011.662484:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3198 00000100:00100000:1.0:1762167011.662490:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765451997056:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167011.662695:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762167011.662695:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.662700:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.662700:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.662703:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167011.662703:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167011.662706:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.662706:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.662709:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167011.662709:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.662834:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765451996928:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 355us (536us total) trans 17179876069 rc 0/0 00000100:00100000:2.0:1762167011.662849:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3197 00002000:00010000:2.0:1762167011.662853:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (262144->18446744073709551615) 00002000:00100000:2.0:1762167011.662856:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f331500 with x1847765451996928 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.662861:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36f331500. 00000100:00100000:1.0:1762167011.663076:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765451997056:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 584us (734us total) trans 21474843641 rc 0/0 00000100:00100000:1.0:1762167011.663082:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3198 00002000:00010000:1.0:1762167011.663086:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:1.0:1762167011.663089:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f333480 with x1847765451997056 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167011.663098:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f333480. 00000100:00100000:0.0:1762167011.664866:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.664944:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451997184 00000100:00100000:3.0:1762167011.664954:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451997184 00000100:00100000:3.0:1762167011.665004:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20043 00000100:00100000:3.0:1762167011.665016:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56222:x1847765451997184:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167011.665041:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.665060:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0be46 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40a0 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.665155:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be4d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.665170:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.665180:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167011.665207:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:3.0:1762167011.665211:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167011.665224:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.665244:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0be46 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a0 expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.665262:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a0 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.665268:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167011.665271:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167011.665274:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:3.0:1762167011.665338:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56222:x1847765451997184:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 324us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.665345:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20043 00000100:00100000:0.0:1762167011.668371:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.668502:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451997440 00000100:00100000:3.0:1762167011.668514:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451997440 00000100:00100000:3.0:1762167011.668586:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20044 00000100:00100000:3.0:1762167011.668596:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56222:x1847765451997440:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167011.668654:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.668682:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be4d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a0 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.668705:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167011.668709:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167011.669017:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.669029:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.669036:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762167011.669078:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953135 00000004:00010000:3.0:1762167011.669103:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000589c1e98 reply state 000000006c700d9d transno 8589953136 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167011.669111:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167011.669207:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56222:x1847765451997440:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 611us (855us total) trans 8589953136 rc 0/0 00000100:00100000:3.0:1762167011.669215:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20044 00000020:00080000:3.0:1762167011.669221:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167011.670205:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.670216:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.670224:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.670243:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167011.670248:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.670256:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.670269:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:1.0:1762167011.670273:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167011.670277:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.670282:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0be54 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.670749:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.670840:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451997568 00000100:00100000:1.0:1762167011.670850:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451997568 00000100:00100000:1.0:1762167011.670905:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17411 00000100:00100000:1.0:1762167011.670915:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56222:x1847765451997568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167011.670931:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.670952:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0be5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40a7 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167011.670978:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888dd, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.671000:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.671003:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.671011:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0be5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a7 expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.671032:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0be5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a7 expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.671045:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29200, rc 0) 00000100:00100000:1.0:1762167011.671103:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56222:x1847765451997568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 190us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.671108:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17411 00000100:00100000:0.0:1762167011.672746:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.672811:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.672835:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451997696 00000100:00100000:1.0:1762167011.672844:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451997696 00000100:00100000:2.0:1762167011.672872:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451997824 00002000:00010000:1.0:1762167011.672878:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (262144->18446744073709551615) 00000100:00100000:2.0:1762167011.672879:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451997824 00002000:00100000:1.0:1762167011.672886:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443cbb80 with x1847765451997696 ext(262144->18446744073709551615) 00002000:00010000:1.0:1762167011.672897:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2443cbb80. 00002000:00010000:2.0:1762167011.672906:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.672911:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c8e00 with x1847765451997824 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.672918:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443c8e00. 00000100:00100000:1.0:1762167011.672932:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3199 00000100:00100000:1.0:1762167011.672944:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765451997696:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167011.672951:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3200 00000100:00100000:2.0:1762167011.672962:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765451997824:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167011.673234:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.673238:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.673241:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167011.673244:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.673245:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762167011.673247:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167011.673251:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.673256:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167011.673259:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.673261:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167011.673321:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451997696:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 378us (578us total) trans 17179876070 rc 0/0 00000100:00100000:1.0:1762167011.673330:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3199 00002000:00010000:1.0:1762167011.673335:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (262144->18446744073709551615) 00002000:00100000:1.0:1762167011.673338:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443cbb80 with x1847765451997696 ext(262144->18446744073709551615) 00002000:00010000:1.0:1762167011.673344:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2443cbb80. 00000100:00100000:2.0:1762167011.673493:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765451997824:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 354us (502us total) trans 21474843642 rc 0/0 00000100:00100000:2.0:1762167011.673505:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3200 00002000:00010000:2.0:1762167011.673509:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.673512:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c8e00 with x1847765451997824 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.673517:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443c8e00. 00000100:00100000:0.0:1762167011.675247:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.675306:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451997952 00000100:00100000:3.0:1762167011.675317:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451997952 00000100:00100000:3.0:1762167011.675391:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20045 00000100:00100000:3.0:1762167011.675404:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56222:x1847765451997952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167011.675432:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.675452:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0be62 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40ae expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.675568:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0be69 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.675582:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0be69 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.675594:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0be69 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167011.675622:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:3.0:1762167011.675626:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167011.675643:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0be69 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.675666:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0be62 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ae expref: 901 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.675685:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0be69 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ae expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.675693:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167011.675696:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167011.675699:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:3.0:1762167011.675808:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56222:x1847765451997952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 360us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.675819:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20045 00000100:00100000:0.0:1762167011.677745:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.677903:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451998208 00000100:00100000:3.0:1762167011.677912:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451998208 00000100:00100000:3.0:1762167011.677966:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20046 00000100:00100000:3.0:1762167011.677978:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56222:x1847765451998208:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:3.0:1762167011.678026:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.678052:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0be69 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ae expref: 900 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.678065:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167011.678068:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167011.678294:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.678307:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.678316:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:3.0:1762167011.678386:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953137 00000004:00010000:3.0:1762167011.678411:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ae8c4b7a reply state 0000000015e0fbfa transno 8589953138 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167011.678419:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167011.678505:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56222:x1847765451998208:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 530us (776us total) trans 8589953138 rc 0/0 00000100:00100000:3.0:1762167011.678512:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20046 00000020:00080000:3.0:1762167011.678517:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167011.679446:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.679460:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.679471:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.679476:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.679480:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.679488:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.679500:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.679503:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.679506:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.679512:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0be70 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.679863:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.679912:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451998336 00000100:00100000:1.0:1762167011.679920:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451998336 00000100:00100000:1.0:1762167011.679968:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17412 00000100:00100000:1.0:1762167011.679990:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56222:x1847765451998336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167011.680007:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.680026:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0be77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40b5 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167011.680054:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888dd, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.680077:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.680079:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.680086:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0be77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40b5 expref: 22 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.680099:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0be77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40b5 expref: 22 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.680111:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a28600, rc 0) 00000100:00100000:1.0:1762167011.680166:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56222:x1847765451998336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 189us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.680173:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17412 00000100:00100000:0.0:1762167011.681287:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.681334:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451998592 00000100:00100000:0.0:1762167011.681340:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.681341:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451998592 00002000:00010000:2.0:1762167011.681385:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.681391:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443cb100 with x1847765451998592 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.681402:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2443cb100. 00000100:00100000:2.0:1762167011.681435:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451998464 00000100:00100000:2.0:1762167011.681440:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451998464 00000100:00100000:1.0:1762167011.681444:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3201 00002000:00010000:2.0:1762167011.681455:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (262144->18446744073709551615) 00000100:00100000:1.0:1762167011.681457:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765451998592:12345-192.168.203.35@tcp:10:lfs.0 00002000:00100000:2.0:1762167011.681460:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c9c00 with x1847765451998464 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.681469:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443c9c00. 00000100:00100000:2.0:1762167011.681495:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3202 00000100:00100000:2.0:1762167011.681503:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765451998464:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167011.681798:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762167011.681802:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.681805:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167011.681808:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.681810:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167011.681811:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.681815:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.681818:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167011.681821:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.681823:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.681856:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765451998464:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 352us (515us total) trans 21474843643 rc 0/0 00000100:00100000:1.0:1762167011.681857:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765451998592:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 402us (571us total) trans 17179876071 rc 0/0 00000100:00100000:2.0:1762167011.681872:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3202 00002000:00010000:2.0:1762167011.681877:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (262144->18446744073709551615) 00002000:00100000:2.0:1762167011.681880:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c9c00 with x1847765451998464 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.681884:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443c9c00. 00000100:00100000:1.0:1762167011.682030:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3201 00002000:00010000:1.0:1762167011.682034:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:1.0:1762167011.682038:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443cb100 with x1847765451998592 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167011.682043:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2443cb100. 00000100:00100000:0.0:1762167011.683739:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.683810:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451998720 00000100:00100000:3.0:1762167011.683818:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451998720 00000100:00100000:3.0:1762167011.683874:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20047 00000100:00100000:3.0:1762167011.683886:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56222:x1847765451998720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167011.683909:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.683929:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0be7e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40bc expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.684063:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be85 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.684078:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be85 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.684088:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be85 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.684120:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.684125:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.684140:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be85 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.684166:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0be7e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40bc expref: 903 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.684179:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be85 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40bc expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.684185:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.684187:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.684189:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167011.684246:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56222:x1847765451998720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 363us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.684253:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20047 00000100:00100000:0.0:1762167011.686538:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.686593:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451998976 00000100:00100000:2.0:1762167011.686603:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451998976 00000100:00100000:2.0:1762167011.686662:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20048 00000100:00100000:2.0:1762167011.686672:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56222:x1847765451998976:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.686720:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.686745:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0be85 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40bc expref: 902 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.686803:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.686811:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.687033:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.687047:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.687056:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167011.687120:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953139 00000004:00010000:2.0:1762167011.687143:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b6e7e62a reply state 0000000093fcc23b transno 8589953140 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167011.687151:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.687232:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56222:x1847765451998976:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 561us (700us total) trans 8589953140 rc 0/0 00000100:00100000:2.0:1762167011.687240:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20048 00000020:00080000:2.0:1762167011.687246:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167011.688100:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.688113:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.688121:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.688127:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167011.688132:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.688139:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.688151:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:1.0:1762167011.688153:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167011.688157:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.688163:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0be8c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.688368:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.688413:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451999104 00000100:00100000:1.0:1762167011.688420:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451999104 00000100:00100000:1.0:1762167011.688464:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17413 00000100:00100000:1.0:1762167011.688473:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56222:x1847765451999104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167011.688485:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.688505:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0be93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40c3 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167011.688528:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888de, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.688548:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.688551:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.688557:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0be93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40c3 expref: 24 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.688571:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0be93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40c3 expref: 24 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.688581:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee346a29000, rc 0) 00000100:00100000:1.0:1762167011.688629:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56222:x1847765451999104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 157us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.688635:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17413 00000100:00100000:0.0:1762167011.690371:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.690409:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.690517:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451999232 00000100:00100000:1.0:1762167011.690525:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451999232 00000100:00100000:2.0:1762167011.690551:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451999360 00000100:00100000:2.0:1762167011.690557:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451999360 00002000:00010000:1.0:1762167011.690561:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (262144->18446744073709551615) 00002000:00100000:1.0:1762167011.690566:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443caa00 with x1847765451999232 ext(262144->18446744073709551615) 00002000:00010000:1.0:1762167011.690577:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443caa00. 00002000:00010000:2.0:1762167011.690581:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.690587:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c8a80 with x1847765451999360 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.690595:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2443c8a80. 00000100:00100000:1.0:1762167011.690616:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3203 00000100:00100000:1.0:1762167011.690627:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765451999232:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:2.0:1762167011.690634:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3204 00000100:00100000:2.0:1762167011.690645:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765451999360:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167011.690961:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.690961:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762167011.690968:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.690969:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.690976:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167011.690976:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167011.690984:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.690985:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.690991:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167011.690992:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167011.691750:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2361:x1847765451999232:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 1122us (1383us total) trans 21474843644 rc 0/0 00000100:00100000:2.0:1762167011.691753:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765451999360:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 1104us (1338us total) trans 17179876072 rc 0/0 00000100:00100000:2.0:1762167011.691793:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3204 00002000:00010000:2.0:1762167011.691799:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00000100:00100000:1.0:1762167011.691800:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3203 00002000:00100000:2.0:1762167011.691805:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443c8a80 with x1847765451999360 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167011.691807:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (262144->18446744073709551615) 00002000:00100000:1.0:1762167011.691812:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee2443caa00 with x1847765451999232 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.691815:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee2443c8a80. 00002000:00010000:1.0:1762167011.691819:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee2443caa00. 00000100:00100000:2.0:1762167011.693604:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.693675:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451999488 00000100:00100000:0.0:1762167011.693694:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451999488 00000100:00100000:0.0:1762167011.693750:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20049 00000100:00100000:0.0:1762167011.693793:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56222:x1847765451999488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167011.693816:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167011.693834:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0be9a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40ca expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.693910:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bea1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.693924:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bea1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.693935:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bea1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:0.0:1762167011.693965:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:0.0:1762167011.693968:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167011.693983:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bea1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.694006:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0be9a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ca expref: 905 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.694023:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bea1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ca expref: 904 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167011.694031:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167011.694034:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167011.694037:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ce00, rc 0) 00000100:00100000:0.0:1762167011.694100:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56222:x1847765451999488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 340us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167011.694108:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20049 00000100:00100000:0.0:1762167011.696475:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.696530:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451999744 00000100:00100000:2.0:1762167011.696540:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451999744 00000100:00100000:2.0:1762167011.696593:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20050 00000100:00100000:2.0:1762167011.696604:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56222:x1847765451999744:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.696656:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.696681:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0bea1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ca expref: 904 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.696701:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.696707:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.696961:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.696975:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.696984:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167011.697039:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953141 00000004:00010000:2.0:1762167011.697063:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000010dfa4c2 reply state 00000000cfc4f8af transno 8589953142 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167011.697077:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.697169:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56222:x1847765451999744:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 566us (700us total) trans 8589953142 rc 0/0 00000100:00100000:2.0:1762167011.697177:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20050 00000020:00080000:2.0:1762167011.697183:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167011.698389:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.698402:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.698408:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.698414:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.698418:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.698425:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.698437:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.698440:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.698444:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.698449:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bea8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.699235:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.699297:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765451999872 00000100:00100000:1.0:1762167011.699305:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765451999872 00000100:00100000:1.0:1762167011.699370:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17414 00000100:00100000:1.0:1762167011.699391:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56222:x1847765451999872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167011.699406:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.699426:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0beaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40d1 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167011.699449:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888de, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.699470:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.699473:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.699480:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0beaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d1 expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.699494:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0beaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d1 expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.699505:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37fc66600, rc 0) 00000100:00100000:1.0:1762167011.699558:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56222:x1847765451999872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 172us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.699565:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17414 00000100:00100000:3.0:1762167011.701106:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.701147:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.701188:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452000000 00000100:00100000:2.0:1762167011.701195:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452000128 00000100:00100000:1.0:1762167011.701197:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452000000 00000100:00100000:2.0:1762167011.701203:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452000128 00002000:00010000:2.0:1762167011.701230:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00010000:1.0:1762167011.701231:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (262144->18446744073709551615) 00002000:00100000:2.0:1762167011.701235:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240f800 with x1847765452000128 ext(0->18446744073709551615) 00002000:00100000:1.0:1762167011.701238:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240d880 with x1847765452000000 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762167011.701245:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240f800. 00002000:00010000:1.0:1762167011.701247:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240d880. 00000100:00100000:2.0:1762167011.701268:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3205 00000100:00100000:2.0:1762167011.701277:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765452000128:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167011.701286:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3206 00000100:00100000:1.0:1762167011.701298:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452000000:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167011.701576:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.701576:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762167011.701583:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.701584:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.701590:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167011.701591:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167011.701595:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.701597:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.701601:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167011.701602:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167011.701668:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452000000:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 370us (564us total) trans 17179876073 rc 0/0 00000100:00100000:2.0:1762167011.701669:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765452000128:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 388us (517us total) trans 21474843645 rc 0/0 00000100:00100000:1.0:1762167011.701684:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3206 00002000:00010000:1.0:1762167011.701688:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (262144->18446744073709551615) 00002000:00100000:1.0:1762167011.701692:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240d880 with x1847765452000000 ext(262144->18446744073709551615) 00000100:00100000:2.0:1762167011.701695:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3205 00002000:00010000:1.0:1762167011.701699:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240d880. 00002000:00010000:2.0:1762167011.701701:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.701706:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240f800 with x1847765452000128 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.701715:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240f800. 00000100:00100000:0.0:1762167011.703428:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.703493:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452000256 00000100:00100000:2.0:1762167011.703501:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452000256 00000100:00100000:2.0:1762167011.703556:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20051 00000100:00100000:2.0:1762167011.703566:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56222:x1847765452000256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.703588:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.703605:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0beb6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40d8 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.703683:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bebd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.703704:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bebd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.703717:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bebd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.703746:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.703751:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.703811:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bebd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.703852:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0beb6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d8 expref: 907 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.703869:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bebd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d8 expref: 906 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.703885:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.703888:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.703891:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:2.0:1762167011.703952:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56222:x1847765452000256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 388us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.703964:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20051 00000100:00100000:0.0:1762167011.705939:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.706068:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452000512 00000100:00100000:2.0:1762167011.706085:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452000512 00000100:00100000:2.0:1762167011.706185:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20052 00000100:00100000:2.0:1762167011.706197:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56222:x1847765452000512:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.706270:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.706309:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bebd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d8 expref: 906 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.706339:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.706344:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.706686:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.706703:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.706714:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167011.706841:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953143 00000004:00010000:2.0:1762167011.706869:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002b004765 reply state 00000000ea7b54ee transno 8589953144 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167011.706879:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.706988:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56222:x1847765452000512:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 793us (1055us total) trans 8589953144 rc 0/0 00000100:00100000:2.0:1762167011.706996:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20052 00000020:00080000:2.0:1762167011.707003:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167011.708634:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.708650:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.708657:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.708664:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167011.708669:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.708678:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.708695:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:1.0:1762167011.708699:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167011.708703:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167011.708710:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0bec4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.709332:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.709567:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452000640 00000100:00100000:1.0:1762167011.709579:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452000640 00000100:00100000:1.0:1762167011.709640:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17415 00000100:00100000:1.0:1762167011.709650:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56222:x1847765452000640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167011.709673:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.709695:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0becb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40df expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167011.709722:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888e0, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.709741:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.709744:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.709752:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0becb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40df expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.709804:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0becb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40df expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.709817:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee372abbe00, rc 0) 00000100:00100000:1.0:1762167011.709865:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56222:x1847765452000640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 217us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.709872:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17415 00000100:00100000:3.0:1762167011.711200:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.711238:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.711311:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452000768 00000100:00100000:2.0:1762167011.711318:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452000768 00000100:00100000:1.0:1762167011.711324:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452000896 00000100:00100000:1.0:1762167011.711331:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452000896 00002000:00010000:2.0:1762167011.711358:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (262144->18446744073709551615) 00002000:00010000:1.0:1762167011.711361:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00100000:2.0:1762167011.711364:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240f100 with x1847765452000768 ext(262144->18446744073709551615) 00002000:00100000:1.0:1762167011.711367:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240ca80 with x1847765452000896 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.711375:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240f100. 00002000:00010000:1.0:1762167011.711378:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240ca80. 00000100:00100000:2.0:1762167011.711407:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3207 00000100:00100000:2.0:1762167011.711418:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765452000768:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:1.0:1762167011.711423:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3208 00000100:00100000:1.0:1762167011.711435:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765452000896:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167011.711712:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762167011.711717:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.711718:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.711720:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167011.711723:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.711725:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.711728:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:2.0:1762167011.711730:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1762167011.711733:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.711737:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.711878:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452000768:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 462us (682us total) trans 21474843646 rc 0/0 00000100:00100000:1.0:1762167011.711881:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765452000896:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 446us (638us total) trans 17179876074 rc 0/0 00000100:00100000:2.0:1762167011.711893:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3207 00002000:00010000:2.0:1762167011.711897:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (262144->18446744073709551615) 00002000:00100000:2.0:1762167011.711902:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240f100 with x1847765452000768 ext(262144->18446744073709551615) 00000100:00100000:1.0:1762167011.711902:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3208 00002000:00010000:2.0:1762167011.711910:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24240f100. 00002000:00010000:1.0:1762167011.711910:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00100000:1.0:1762167011.711915:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24240ca80 with x1847765452000896 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167011.711921:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24240ca80. 00000100:00100000:0.0:1762167011.713722:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.713799:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452001152 00000100:00100000:2.0:1762167011.713807:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452001152 00000100:00100000:2.0:1762167011.713864:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20053 00000100:00100000:2.0:1762167011.713877:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56222:x1847765452001152:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167011.713968:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.713984:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.713994:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00010000:2.0:1762167011.714102:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000092896b8c reply state 0000000000477ec2 transno 8589953145 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167011.714110:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.714189:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56222:x1847765452001152:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 315us (473us total) trans 8589953145 rc 0/0 00000100:00100000:2.0:1762167011.714200:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20053 00000100:00100000:0.0:1762167011.715759:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.715813:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.715832:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.715863:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452001280 00000100:00100000:0.0:1762167011.715863:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452001408 00000100:00100000:1.0:1762167011.715871:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452001280 00000100:00100000:0.0:1762167011.715872:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452001408 00000100:00100000:1.0:1762167011.715920:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452001536 00000100:00100000:1.0:1762167011.715924:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452001536 00000100:00100000:3.0:1762167011.715945:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17416 00000100:00100000:3.0:1762167011.715960:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765452001280:12345-192.168.203.35@tcp:2:lfs.0 00010000:00010000:2.0:1762167011.716043:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.716054:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.716062:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.716069:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.716074:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.716080:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.716096:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.716100:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.716104:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.716111:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bed2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00002000:00010000:3.0:1762167011.716156:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762167011.716161:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.716164:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.716166:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.716168:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00000100:00100000:0.0:1762167011.716204:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17417 00000100:00100000:1.0:1762167011.716214:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17418 00000100:00100000:0.0:1762167011.716218:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765452001408:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167011.716228:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2358:x1847765452001280:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 270us (477us total) trans 21474843647 rc 0/0 00000100:00100000:1.0:1762167011.716230:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2358:x1847765452001536:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167011.716243:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17416 00002000:00010000:1.0:1762167011.716374:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.716378:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.716380:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.716382:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.716385:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167011.716425:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2358:x1847765452001536:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 201us (592us total) trans 21474843648 rc 0/0 00000100:00100000:1.0:1762167011.716433:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17418 00002000:00010000:0.0:1762167011.716445:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.716450:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.716453:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.716456:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.716458:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.716483:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2358:x1847765452001408:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 270us (669us total) trans 17179876075 rc 0/0 00000100:00100000:0.0:1762167011.716491:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17417 00000100:00100000:2.0:1762167011.718597:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.718680:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452001792 00000100:00100000:1.0:1762167011.718687:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452001792 00000100:00100000:1.0:1762167011.718878:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7386 00000100:00100000:1.0:1762167011.718891:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f651450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56222:x1847765452001792:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:1.0:1762167011.718952:0:30820:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd6d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4053 expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.719000:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167011.719013:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd97 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb405a expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.719022:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167011.719057:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd97 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb405a expref: 908 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.719071:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd97 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb405a expref: 908 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.719086:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454533888:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.719171:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e180 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.721325:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454533888:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.721363:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167011.722212:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.722364:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452001920 00000100:00100000:0.0:1762167011.722371:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452001920 00010000:00010000:0.0:1762167011.722405:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd97 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb405a expref: 909 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1762167011.722480:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7641 00000100:00100000:0.0:1762167011.722490:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2477d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:2361:x1847765452001920:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167011.722504:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167011.722511:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd97 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb405a expref: 909 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1762167011.722524:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd97 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb405a expref: 909 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1762167011.722545:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bd97 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb405a expref: 909 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1762167011.722565:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167011.722570:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167011.722579:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167011.722587:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167011.722721:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.722875:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167011.722883:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167011.723401:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2477d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2361:x1847765452001920:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 909us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167011.723419:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7641 00000040:00080000:1.0:1762167011.723444:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5626, 88 off455312 00000004:00080000:1.0:1762167011.723454:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632515690099ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167011.723534:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5634, 88 off456368 00000004:00080000:1.0:1762167011.723540:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632515777045ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167011.723988:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5635, 88 off456456 00000004:00080000:1.0:1762167011.723995:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632516231875ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167011.724114:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5627, 88 off455400 00000004:00080000:1.0:1762167011.724120:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632516356775ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167011.724153:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5636, 88 off456544 00000004:00080000:1.0:1762167011.724158:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632516394883ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167011.724173:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5628, 88 off455488 00000004:00080000:1.0:1762167011.724177:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632516414120ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167011.724191:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5629, 88 off455576 00000004:00080000:1.0:1762167011.724195:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632516432027ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167011.724210:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5637, 88 off456632 00000004:00080000:1.0:1762167011.724213:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632516450855ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167011.724229:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5638, 88 off456720 00000004:00080000:1.0:1762167011.724233:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632516469942ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167011.724248:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5630, 88 off455664 00000004:00080000:1.0:1762167011.724251:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632516488802ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167011.724266:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5639, 88 off456808 00000004:00080000:1.0:1762167011.724269:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632516506255ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167011.724283:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5631, 88 off455752 00000004:00080000:1.0:1762167011.724287:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632516524507ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167011.724302:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5632, 88 off455840 00000004:00080000:1.0:1762167011.724306:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632516542933ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167011.724322:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5640, 88 off456896 00000004:00080000:1.0:1762167011.724326:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632516563252ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167011.724341:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5633, 88 off455928 00000004:00080000:1.0:1762167011.724345:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632516582159ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167011.724371:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5641, 88 off456984 00000004:00080000:1.0:1762167011.724376:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632516613413ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167011.724397:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5642, 88 off457072 00000004:00080000:1.0:1762167011.724401:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632516638523ns, next at 630703976179ns, rc = 0 00000040:00080000:1.0:1762167011.724418:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5634, 88 off456016 00000004:00080000:1.0:1762167011.724422:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632516659219ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167011.724455:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5635, 88 off456104 00000004:00080000:1.0:1762167011.724459:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632516696664ns, next at 630704042948ns, rc = 0 00000040:00080000:1.0:1762167011.724475:0:30820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5643, 88 off457160 00000004:00080000:1.0:1762167011.724479:0:30820:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632516716195ns, next at 630703976179ns, rc = 0 00000001:00080000:1.0:1762167011.739417:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953130 is committed 00000001:00080000:1.0:1762167011.739438:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953146 is committed 00000004:00080000:1.0:1762167011.739444:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3754 committed 00000004:00010000:3.0:1762167011.739461:0:30820:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000faea600 reply state 00000000d8750466 transno 8589953146 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000004:00080000:1.0:1762167011.739462:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3741 committed 00000100:00100000:3.0:1762167011.739479:0:30820:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1762167011.739480:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3740 committed 00000004:00080000:1.0:1762167011.739484:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3753 committed 00000004:00080000:1.0:1762167011.739486:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3752 committed 00000004:00080000:1.0:1762167011.739488:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3739 committed 00000004:00080000:1.0:1762167011.739490:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3751 committed 00010000:00010000:3.0:1762167011.739492:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00000004:00080000:1.0:1762167011.739493:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3738 committed 00000004:00080000:1.0:1762167011.739497:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3737 committed 00010000:00010000:3.0:1762167011.739499:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1762167011.739502:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3750 committed 00000004:00080000:1.0:1762167011.739508:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3736 committed 00010000:00010000:3.0:1762167011.739512:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bd6d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4053 expref: 905 pid: 30819 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762167011.739513:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3749 committed 00000004:00080000:1.0:1762167011.739520:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3748 committed 00000004:00080000:1.0:1762167011.739525:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3735 committed 00000004:00080000:1.0:1762167011.739529:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3734 committed 00000004:00080000:1.0:1762167011.739534:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3747 committed 00000004:00080000:1.0:1762167011.739538:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3733 committed 00000004:00080000:1.0:1762167011.739544:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3746 committed 00000004:00080000:1.0:1762167011.739546:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3745 committed 00000004:00080000:1.0:1762167011.739549:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3732 committed 00000100:00100000:1.0:1762167011.739613:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454534016:0@lo:2:osp-syn-0-0.0 00010000:00080000:3.0:1762167011.739656:0:30820:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762167011.739668:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.739674:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f651450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56222:x1847765452001792:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 20785us (21083us total) trans 8589953146 rc 0/0 00000100:00100000:3.0:1762167011.739686:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7386 00000100:00100000:1.0:1762167011.739714:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454534656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.739735:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454534144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.739755:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.739799:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.739805:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454535168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.739822:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454534016 00000100:00100000:2.0:1762167011.739831:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454534528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.739831:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454534016 00000100:00100000:1.0:1762167011.739842:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.739873:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454535680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.739877:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454534656 00000100:00100000:0.0:1762167011.739881:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454534656 00000100:00100000:3.0:1762167011.739896:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454534272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.739903:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454534144 00000100:00100000:0.0:1762167011.739905:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454534144 00000100:00100000:1.0:1762167011.739910:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454534400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.739912:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.739938:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454535168 00000100:00100000:0.0:1762167011.739942:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454535168 00000100:00100000:3.0:1762167011.739950:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454534528 00000100:00100000:3.0:1762167011.739953:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454534528 00000100:00100000:1.0:1762167011.739972:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.739972:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17419 00000100:00100000:2.0:1762167011.739981:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454535040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.739987:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3293:x1847765454534016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.739995:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454534912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.740022:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.740034:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454534400 00000100:00100000:1.0:1762167011.740039:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454534400 00000100:00100000:2.0:1762167011.740047:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454535552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.740055:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17420 00000100:00100000:2.0:1762167011.740073:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.740079:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765454534656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.740081:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454535040 00000100:00100000:1.0:1762167011.740086:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454535040 00000100:00100000:1.0:1762167011.740106:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454535552 00000100:00100000:1.0:1762167011.740109:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454535552 00000100:00100000:2.0:1762167011.740115:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17421 00000100:00100000:2.0:1762167011.740127:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454534144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.740132:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17422 00000100:00100000:1.0:1762167011.740144:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3293:x1847765454535168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167011.740240:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762167011.740241:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.740245:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.740245:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.740249:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167011.740249:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.740252:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.740252:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.740255:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167011.740255:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00002000:00010000:1.0:1762167011.740289:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00000100:00100000:0.0:1762167011.740291:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454534016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 308us (624us total) trans 21474843649 rc 0/0 00000100:00100000:3.0:1762167011.740294:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454534656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (538us total) trans 17179876076 rc 0/0 00002000:00010000:1.0:1762167011.740297:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.740302:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00000100:00100000:0.0:1762167011.740303:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17419 00002000:00010000:1.0:1762167011.740307:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.740309:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167011.740312:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17420 00002000:00010000:1.0:1762167011.740313:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167011.740315:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167011.740322:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1762167011.740322:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17423 00002000:00010000:2.0:1762167011.740328:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000100:00100000:3.0:1762167011.740330:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17424 00002000:00010000:2.0:1762167011.740334:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.740334:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454534528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.740341:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454534400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.740367:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454535168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (513us total) trans 17179876077 rc 0/0 00000100:00100000:1.0:1762167011.740375:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17422 00000100:00100000:2.0:1762167011.740397:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454534144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 272us (596us total) trans 17179876078 rc 0/0 00000100:00100000:1.0:1762167011.740398:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17425 00000100:00100000:2.0:1762167011.740410:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17421 00000100:00100000:1.0:1762167011.740412:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3296:x1847765454535040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.740433:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17426 00000100:00100000:2.0:1762167011.740444:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454535552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167011.740454:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762167011.740459:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.740461:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167011.740463:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.740466:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167011.740467:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.740471:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.740473:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.740475:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.740477:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.740504:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1847765454534400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (540us total) trans 17179876079 rc 0/0 00000100:00100000:0.0:1762167011.740504:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454534528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (636us total) trans 21474843650 rc 0/0 00000100:00100000:0.0:1762167011.740512:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17423 00000100:00100000:3.0:1762167011.740516:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17424 00000100:00100000:3.0:1762167011.740542:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167011.740545:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762167011.740550:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.740552:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167011.740555:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.740557:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167011.740561:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454534784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.740563:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454534272 00000100:00100000:0.0:1762167011.740567:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454534272 00002000:00010000:2.0:1762167011.740588:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.740592:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:1.0:1762167011.740596:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454535040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (572us total) trans 21474843651 rc 0/0 00000100:00100000:0.0:1762167011.740597:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17427 00000100:00100000:3.0:1762167011.740600:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167011.740601:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167011.740610:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000100:00100000:0.0:1762167011.740610:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3294:x1847765454534272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.740616:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17425 00002000:00010000:2.0:1762167011.740618:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.740622:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454535296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.740636:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454534784 00000100:00100000:1.0:1762167011.740640:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454534784 00000100:00100000:3.0:1762167011.740658:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.740663:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3296:x1847765454535552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (588us total) trans 21474843652 rc 0/0 00000100:00100000:1.0:1762167011.740671:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454535296 00000100:00100000:1.0:1762167011.740675:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454535296 00000100:00100000:2.0:1762167011.740679:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17426 00000100:00100000:3.0:1762167011.740683:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454535808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.740699:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17428 00000100:00100000:2.0:1762167011.740710:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17429 00000100:00100000:1.0:1762167011.740713:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454534784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.740715:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.740725:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3294:x1847765454535296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167011.740749:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167011.740753:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454535808 00002000:00010000:0.0:1762167011.740753:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.740756:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00000100:00100000:3.0:1762167011.740757:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454535808 00002000:00010000:0.0:1762167011.740758:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.740781:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.740805:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17430 00000100:00100000:3.0:1762167011.740812:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454535808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.740816:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454534272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (274us total) trans 17179876080 rc 0/0 00000100:00100000:0.0:1762167011.740823:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17427 00002000:00010000:1.0:1762167011.740858:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.740862:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.740865:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167011.740868:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.740870:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.740884:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876062 gen 2 00000004:00080000:0.0:1762167011.740892:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28380, transno 17179876033 00002000:00010000:2.0:1762167011.740893:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.740897:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:1.0:1762167011.740901:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454534784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (302us total) trans 21474843653 rc 0/0 00002000:00010000:2.0:1762167011.740903:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000004:00080000:0.0:1762167011.740903:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc29500, transno 17179876034 00000004:00080000:0.0:1762167011.740909:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28e00, transno 17179876035 00002000:00010000:2.0:1762167011.740911:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000004:00080000:0.0:1762167011.740915:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc2a680, transno 17179876036 00000100:00100000:1.0:1762167011.740916:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17428 00002000:00010000:2.0:1762167011.740918:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:0.0:1762167011.740921:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03480, transno 17179876037 00000004:00080000:0.0:1762167011.740926:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28000, transno 17179876038 00000004:00080000:0.0:1762167011.740930:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc2b100, transno 17179876039 00000004:00080000:0.0:1762167011.740934:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28700, transno 17179876040 00000004:00080000:0.0:1762167011.740937:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f286d80, transno 17179876041 00000004:00080000:0.0:1762167011.740940:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f286300, transno 17179876042 00000004:00080000:0.0:1762167011.740944:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284000, transno 17179876043 00000004:00080000:0.0:1762167011.740947:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f287480, transno 17179876044 00000004:00080000:0.0:1762167011.740951:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f284e00, transno 17179876045 00000004:00080000:0.0:1762167011.740956:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc5180, transno 17179876046 00000004:00080000:0.0:1762167011.740961:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f286680, transno 17179876047 00000100:00100000:1.0:1762167011.740962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.740963:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454535296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (302us total) trans 21474843654 rc 0/0 00000004:00080000:0.0:1762167011.740967:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f287100, transno 17179876048 00000004:00080000:0.0:1762167011.740974:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc4000, transno 17179876049 00000100:00100000:2.0:1762167011.740978:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17429 00000004:00080000:0.0:1762167011.740980:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36f285180, transno 17179876050 00000004:00080000:0.0:1762167011.740986:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc6a00, transno 17179876051 00000004:00080000:0.0:1762167011.740989:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc5500, transno 17179876052 00000004:00080000:0.0:1762167011.740993:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc7800, transno 17179876053 00000100:00100000:2.0:1762167011.740997:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454534912 00000004:00080000:0.0:1762167011.740997:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348256d80, transno 17179876054 00000004:00080000:0.0:1762167011.741002:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc6680, transno 17179876055 00000100:00100000:2.0:1762167011.741003:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454534912 00000004:00080000:0.0:1762167011.741005:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc5f80, transno 17179876056 00000004:00080000:0.0:1762167011.741011:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee348255c00, transno 17179876057 00000004:00080000:0.0:1762167011.741014:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc4380, transno 17179876058 00000004:00080000:0.0:1762167011.741017:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc7b80, transno 17179876059 00000004:00080000:0.0:1762167011.741020:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fcc7100, transno 17179876060 00000004:00080000:0.0:1762167011.741023:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240e300, transno 17179876061 00000004:00080000:0.0:1762167011.741026:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240c000, transno 17179876062 00002000:00010000:3.0:1762167011.741031:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.741034:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:0.0:1762167011.741034:0:3294:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37fccd180 x1847765454534272/t17179876080(17179876080) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167027 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1762167011.741038:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17431 00002000:00010000:3.0:1762167011.741039:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167011.741044:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.741047:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:0.0:1762167011.741049:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccd180/2, rc 0, transno 17179876080 00000100:00100000:2.0:1762167011.741052:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454534912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.741053:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454535424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.741057:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454534272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.741076:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454535808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 265us (367us total) trans 17179876081 rc 0/0 00000100:00100000:0.0:1762167011.741081:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843634 gen 2 00000100:00100000:3.0:1762167011.741083:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17430 00000004:00080000:0.0:1762167011.741085:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b06d80, transno 21474843625 00000100:00100000:1.0:1762167011.741094:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167011.741095:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b07800, transno 21474843626 00000004:00080000:0.0:1762167011.741100:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b05880, transno 21474843627 00000004:00080000:0.0:1762167011.741104:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b06a00, transno 21474843628 00000004:00080000:0.0:1762167011.741108:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b05180, transno 21474843629 00000004:00080000:0.0:1762167011.741112:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b04e00, transno 21474843630 00000100:00100000:3.0:1762167011.741114:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454535424 00000100:00100000:3.0:1762167011.741117:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454535424 00000004:00080000:0.0:1762167011.741117:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243180e00, transno 21474843631 00000004:00080000:0.0:1762167011.741121:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee347b04700, transno 21474843632 00000004:00080000:0.0:1762167011.741123:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240f480, transno 21474843633 00000004:00080000:0.0:1762167011.741126:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240c380, transno 21474843634 00000100:00100000:0.0:1762167011.741132:0:3294:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36dc31f80 x1847765454534784/t21474843653(21474843653) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167027 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1762167011.741139:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17432 00000004:00080000:0.0:1762167011.741140:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc31f80/2, rc 0, transno 21474843653 00000100:00100000:1.0:1762167011.741144:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454535936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.741146:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454534784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.741148:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454535424:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167011.741168:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc31180/2, rc 0, transno 21474843654 00000100:00100000:0.0:1762167011.741173:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454535296:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167011.741175:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 262144 -> 262144 00000100:00100000:1.0:1762167011.741181:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762167011.741182:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000004:00080000:0.0:1762167011.741185:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb10380/2, rc 0, transno 17179876081 00002000:00010000:2.0:1762167011.741187:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167011.741193:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000100:00100000:0.0:1762167011.741193:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454535808:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167011.741199:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000004:00080000:1.0:1762167011.741214:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccfb80/2, rc 0, transno 17179876079 00000100:00100000:1.0:1762167011.741222:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454534400:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167011.741241:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03100/2, rc 0, transno 17179876082 00000100:00100000:2.0:1762167011.741245:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454534912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (287us total) trans 17179876082 rc 0/0 00000100:00100000:1.0:1762167011.741250:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454534912:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167011.741252:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167011.741259:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17431 00002000:00010000:3.0:1762167011.741260:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.741265:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167011.741268:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.741271:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167011.741274:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454535936 00000100:00100000:1.0:1762167011.741279:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454535936 00000100:00100000:3.0:1762167011.741308:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454535424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (215us total) trans 17179876083 rc 0/0 00000100:00100000:1.0:1762167011.741313:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17433 00000100:00100000:3.0:1762167011.741322:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17432 00000100:00100000:1.0:1762167011.741326:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454535936:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167011.741439:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 6 in flight, 10 done 00000004:00080000:3.0:1762167011.741443:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccca80/2, rc 0, transno 17179876078 00000100:00100000:3.0:1762167011.741449:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454534144:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167011.741465:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f797b80/2, rc 0, transno 21474843650 00000100:00100000:3.0:1762167011.741470:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454534528:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167011.741478:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00000004:00080000:3.0:1762167011.741483:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc31880/2, rc 0, transno 21474843651 00002000:00010000:1.0:1762167011.741484:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.741491:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:3.0:1762167011.741492:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454535040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.741492:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00010000:1.0:1762167011.741495:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.741499:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167011.741503:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454536192:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167011.741505:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc32300/2, rc 0, transno 21474843652 00000100:00100000:3.0:1762167011.741509:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454535552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.741520:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454536064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.741544:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454535936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (364us total) trans 21474843655 rc 0/0 00000100:00100000:0.0:1762167011.741553:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.741557:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17433 00000100:00100000:1.0:1762167011.741575:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454536192 00000100:00100000:1.0:1762167011.741579:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454536192 00000100:00100000:0.0:1762167011.741596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.741609:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454536064 00000004:00080000:2.0:1762167011.741611:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 8 in progress, 3 in flight, 30 done 00000100:00100000:1.0:1762167011.741614:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454536064 00000100:00100000:3.0:1762167011.741620:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.741634:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17434 00000100:00100000:0.0:1762167011.741645:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454536192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.741647:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17435 00000100:00100000:1.0:1762167011.741659:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454536064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.741661:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452002048 00000100:00100000:3.0:1762167011.741667:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452002048 00000100:00100000:2.0:1762167011.741674:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1762167011.741686:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454536448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.741719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.741749:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20054 00000100:00100000:2.0:1762167011.741752:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454536320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.741783:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56222:x1847765452002048:12345-192.168.203.35@tcp:101:lfs.0 00002000:00010000:0.0:1762167011.741792:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762167011.741795:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.741798:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00010000:00010000:3.0:1762167011.741799:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1762167011.741801:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.741803:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167011.741809:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167011.741815:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bee0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40e6 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167011.741816:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.741822:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.741827:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167011.741831:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.741833:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.741842:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454536192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (293us total) trans 21474843656 rc 0/0 00000004:00080000:2.0:1762167011.741844:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc33800/2, rc 0, transno 21474843656 00000100:00100000:0.0:1762167011.741852:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17434 00000100:00100000:2.0:1762167011.741853:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454536192:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167011.741869:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167011.741871:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454536448 00000100:00100000:0.0:1762167011.741876:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454536448 00000100:00100000:1.0:1762167011.741877:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454536064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (281us total) trans 21474843657 rc 0/0 00010000:00010000:3.0:1762167011.741885:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bee0 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40e6 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.741889:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17435 00000100:00100000:0.0:1762167011.741904:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454536320 00000100:00100000:0.0:1762167011.741907:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454536320 00010000:00010000:3.0:1762167011.741909:0:30819:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167011.741912:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17436 00000100:00100000:1.0:1762167011.741926:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454536448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.741927:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17437 00010000:00010000:3.0:1762167011.741929:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bee0 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40e6 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.741937:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454536320:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1762167011.741945:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167011.741948:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762167011.741951:0:30819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bee0 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40e6 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.741959:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922800, rc 0) 00000100:00100000:3.0:1762167011.742001:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56222:x1847765452002048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 243us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.742008:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20054 00002000:00010000:1.0:1762167011.742048:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.742052:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.742054:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167011.742057:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.742059:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167011.742064:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762167011.742068:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.742071:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167011.742074:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.742077:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167011.742088:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3296:x1847765454536448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (368us total) trans 17179876084 rc 0/0 00000100:00100000:1.0:1762167011.742095:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17436 00000100:00100000:0.0:1762167011.742126:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454536320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (318us total) trans 17179876085 rc 0/0 00000100:00100000:1.0:1762167011.742130:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.742138:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17437 00000004:00080000:3.0:1762167011.742150:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03480/2, rc 0, transno 17179876085 00000100:00100000:0.0:1762167011.742155:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454535680 00000100:00100000:3.0:1762167011.742156:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454536320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.742158:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454535680 00000004:00080000:1.0:1762167011.742168:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fccdf80/2, rc 0, transno 17179876076 00000100:00100000:1.0:1762167011.742175:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454534656:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167011.742185:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36de03b80/2, rc 0, transno 17179876077 00000100:00100000:1.0:1762167011.742189:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36de03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454535168:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167011.742197:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f795180/2, rc 0, transno 21474843649 00000100:00100000:1.0:1762167011.742200:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454534016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.742219:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17438 00000100:00100000:0.0:1762167011.742229:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454535680:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762167011.742243:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167011.742252:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167011.742260:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167011.742266:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167011.742270:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167011.742282:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167011.742295:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:1.0:1762167011.742298:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167011.742304:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bee0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40e6 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.742314:0:3280:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bee0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40e6 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167011.742314:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762167011.742321:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.742326:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167011.742330:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00010000:00010000:1.0:1762167011.742332:0:3280:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bee0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40e6 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167011.742334:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00010000:00010000:1.0:1762167011.742373:0:3280:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bee0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40e6 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.742385:0:3280:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1847765454536576:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167011.742401:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454535680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (272us total) trans 21474843658 rc 0/0 00000100:00100000:0.0:1762167011.742408:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17438 00000100:00100000:1.0:1762167011.742444:0:3280:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000004:00080000:1.0:1762167011.742470:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243181180/2, rc 0, transno 17179876083 00000100:00100000:1.0:1762167011.742475:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454535424:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167011.742489:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc32d80/2, rc 0, transno 21474843655 00000100:00100000:1.0:1762167011.742493:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454535936:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167011.742500:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc32680/2, rc 0, transno 21474843658 00000100:00100000:2.0:1762167011.742507:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454535680:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167011.742525:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc28380/2, rc 0, transno 17179876084 00000100:00100000:1.0:1762167011.742532:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454536448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167011.742547:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36dc31500/2, rc 0, transno 21474843657 00000100:00100000:1.0:1762167011.742552:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454536064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.744642:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.744756:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452002176 00000100:00100000:1.0:1762167011.744794:0:3280:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1847765454536576:192.168.203.35@tcp:105: 00000100:00100000:0.0:1762167011.744804:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452002176 00010000:00010000:1.0:1762167011.744821:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 30820 initiator: MDT0 00010000:00010000:1.0:1762167011.744832:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bed9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167011.744853:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7387 00000100:00100000:0.0:1762167011.744872:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56222:x1847765452002176:12345-192.168.203.35@tcp:49:lfs.0 00000100:00100000:0.0:1762167011.745007:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56222:x1847765452002176:12345-192.168.203.35@tcp:49:lfs.0 Request processed in 144us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167011.745015:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7387 00000100:00100000:3.0:1762167011.746930:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.747024:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452002432 00000100:00100000:0.0:1762167011.747032:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452002432 00000100:00100000:0.0:1762167011.747089:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7388 00000100:00100000:0.0:1762167011.747099:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56222:x1847765452002432:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167011.747389:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56222:x1847765452002432:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 287us (463us total) trans 8589953147 rc 0/0 00000100:00100000:0.0:1762167011.747398:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7388 00010000:00010000:2.0:1762167011.752021:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762167011.757940:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.758105:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452002560 00000100:00100000:3.0:1762167011.758116:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452002560 00000100:00100000:3.0:1762167011.758185:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20055 00000100:00100000:3.0:1762167011.758196:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56223:x1847765452002560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167011.758219:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.758243:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bee7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40ed expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.758309:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0beee lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758323:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0beee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758341:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0beee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758383:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bef5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758390:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758397:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758506:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758513:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758521:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167011.758552:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:3.0:1762167011.758556:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167011.758572:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758583:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758590:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0beee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758596:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0beee lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758602:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0beee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758607:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167011.758611:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0beee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758617:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0beee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758629:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167011.758632:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167011.758636:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0beee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758643:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0beee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758658:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758663:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bef5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758674:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bef5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758679:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167011.758682:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bef5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758687:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bef5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758694:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee345a77200) 00010000:00010000:3.0:1762167011.758697:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167011.758700:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bef5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758706:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bef5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.758738:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bee7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ed expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.758751:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ed expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.758758:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167011.758824:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167011.758827:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:3.0:1762167011.758891:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56223:x1847765452002560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 694us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.758899:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20055 00000100:00100000:3.0:1762167011.761449:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.761529:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452002816 00000100:00100000:2.0:1762167011.761540:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452002816 00000100:00100000:2.0:1762167011.761593:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20056 00000100:00100000:2.0:1762167011.761605:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56223:x1847765452002816:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.761625:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.761643:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bf03 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40f4 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.761744:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bf0a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.761759:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.761813:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.761826:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:2.0:1762167011.761975:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c600/0xf915a5bdf3d0bf03 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40f4 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.761992:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bf0a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40f4 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.762005:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.762009:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762167011.762013:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00000100:00100000:2.0:1762167011.762125:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56223:x1847765452002816:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 522us (686us total) trans 8589953148 rc 0/0 00000100:00100000:2.0:1762167011.762133:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20056 00000100:00100000:0.0:1762167011.765950:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.766086:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452003072 00000100:00100000:2.0:1762167011.766097:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452003072 00000100:00100000:2.0:1762167011.766151:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20057 00000100:00100000:2.0:1762167011.766161:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56223:x1847765452003072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.766183:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.766203:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bf18 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb40fb expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.766322:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bf1f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.766337:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bf1f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.766348:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bf1f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.766373:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:2.0:1762167011.766495:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0bf18 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40fb expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.766513:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bf1f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40fb expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.766522:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.766525:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167011.766528:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1cc00, rc 0) 00000100:00100000:2.0:1762167011.766591:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56223:x1847765452003072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 432us (662us total) trans 8589953149 rc 0/0 00000100:00100000:2.0:1762167011.766599:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20057 00000100:00100000:3.0:1762167011.795602:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.795720:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452003200 00000100:00100000:1.0:1762167011.795731:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452003200 00000100:00100000:1.0:1762167011.795834:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3209 00000100:00100000:1.0:1762167011.795844:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765452003200:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.795879:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.795894:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.795896:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.795901:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.795914:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.799217:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.799249:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.799259:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.799266:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.799270:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.799278:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.799295:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.799303:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.799673:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765452003200:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3827us (4076us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.799684:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3209 00000100:00100000:0.0:1762167011.802434:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.802522:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452003328 00000100:00100000:1.0:1762167011.802532:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452003328 00000100:00100000:1.0:1762167011.802610:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3210 00000100:00100000:1.0:1762167011.802623:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765452003328:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.802661:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.802680:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0be07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb407d expref: 35 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.802692:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.802694:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.802696:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.802728:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0be07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb407d expref: 35 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.802741:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0be07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb407d expref: 35 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.802755:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454536704:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.802858:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.804123:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454536704:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.804143:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.804385:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.804489:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452003456 00000100:00100000:2.0:1762167011.804505:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452003456 00010000:00010000:2.0:1762167011.804538:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0be07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb407d expref: 36 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.804575:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7642 00000100:00100000:2.0:1762167011.804585:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2360:x1847765452003456:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167011.804600:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.804623:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0be07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb407d expref: 36 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.804635:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0be07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb407d expref: 36 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.804656:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29400/0xf915a5bdf3d0be07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb407d expref: 36 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.804670:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.804673:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.804677:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.804686:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.804718:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.804743:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.804754:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.804809:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765452003456:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 225us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.804820:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7642 00010000:00010000:1.0:1762167011.806822:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.806845:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.806853:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.806859:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480ed600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.806863:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.806871:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.806887:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.806903:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.806985:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765452003328:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4363us (4560us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.806996:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3210 00000100:00100000:3.0:1762167011.809564:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.809630:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452003584 00000100:00100000:1.0:1762167011.809638:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452003584 00000100:00100000:1.0:1762167011.809699:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3211 00000100:00100000:1.0:1762167011.809710:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765452003584:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.809745:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.809795:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0be23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb408b expref: 30 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.809804:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.809806:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.809809:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.809843:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0be23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb408b expref: 30 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.809856:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0be23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb408b expref: 30 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.809871:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454536832:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.809937:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.811820:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454536832:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.811840:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.812158:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.812252:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452003712 00000100:00100000:2.0:1762167011.812260:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452003712 00010000:00010000:2.0:1762167011.812300:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0be23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb408b expref: 31 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.812340:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7643 00000100:00100000:2.0:1762167011.812365:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452003712:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167011.812380:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.812401:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0be23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb408b expref: 31 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.812412:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0be23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb408b expref: 31 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.812429:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29c00/0xf915a5bdf3d0be23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb408b expref: 31 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.812441:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.812443:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.812446:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.812455:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.812479:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167011.812519:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452003712:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 172us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.812524:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7643 00010000:00010000:1.0:1762167011.812568:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.812574:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.814812:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.814828:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.814836:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.814843:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.814847:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.814854:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.814869:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.814875:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.814955:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765452003584:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5244us (5394us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.814966:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3211 00000100:00100000:0.0:1762167011.817503:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.817588:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452003840 00000100:00100000:1.0:1762167011.817598:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452003840 00000100:00100000:1.0:1762167011.817667:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3212 00000100:00100000:1.0:1762167011.817677:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765452003840:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.817711:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.817730:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0be3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4099 expref: 34 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.817737:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.817739:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.817742:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.817806:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0be3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4099 expref: 34 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.817819:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0be3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4099 expref: 34 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.817833:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454536960:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.817914:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1762167011.819460:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.819547:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454536960:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.819569:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.819577:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452003968 00000100:00100000:3.0:1762167011.819583:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452003968 00010000:00010000:3.0:1762167011.819614:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0be3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4099 expref: 35 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167011.819651:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7644 00000100:00100000:3.0:1762167011.819661:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765452003968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.819673:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.819695:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0be3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4099 expref: 35 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.819707:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0be3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4099 expref: 35 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.819729:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a28800/0xf915a5bdf3d0be3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4099 expref: 35 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.819744:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.819746:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.819750:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.819758:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.819835:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.819855:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.819867:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.819893:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765452003968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 233us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.819901:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7644 00010000:00010000:1.0:1762167011.821475:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.821491:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.821499:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.821505:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372975000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.821509:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.821516:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.821530:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.821537:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0bf42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.821657:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452003840:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3978us (4160us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.821667:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3212 00000100:00100000:0.0:1762167011.824911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.825011:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004096 00000100:00100000:1.0:1762167011.825020:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004096 00000100:00100000:1.0:1762167011.825084:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3213 00000100:00100000:1.0:1762167011.825094:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765452004096:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.825132:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.825149:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0be5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a7 expref: 33 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.825157:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.825159:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.825162:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.825194:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0be5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a7 expref: 33 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.825208:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0be5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a7 expref: 33 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.825223:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454537088:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.825305:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.826614:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454537088:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.826637:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.826969:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.827119:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004224 00000100:00100000:3.0:1762167011.827126:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004224 00010000:00010000:3.0:1762167011.827158:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0be5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a7 expref: 34 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167011.827194:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7645 00000100:00100000:3.0:1762167011.827204:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765452004224:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.827217:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.827238:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0be5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a7 expref: 34 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.827250:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0be5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a7 expref: 34 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.827270:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee346a29200/0xf915a5bdf3d0be5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40a7 expref: 34 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.827284:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.827286:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.827291:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.827369:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.827401:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.827422:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.827433:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.827452:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452004224:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 249us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.827461:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7645 00010000:00010000:1.0:1762167011.830369:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.830386:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.830393:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.830400:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.830404:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.830412:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.830429:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.830436:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.830520:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765452004096:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5424us (5613us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.830529:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3213 00000100:00100000:3.0:1762167011.833266:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.833343:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004352 00000100:00100000:1.0:1762167011.833368:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004352 00000100:00100000:1.0:1762167011.833443:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3214 00000100:00100000:1.0:1762167011.833454:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452004352:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.833488:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.833504:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0be77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40b5 expref: 29 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.833512:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.833514:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.833518:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.833550:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0be77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40b5 expref: 29 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.833563:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0be77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40b5 expref: 29 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.833578:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454537216:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.833656:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1762167011.835726:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.835817:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454537216:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.835841:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.835950:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004480 00000100:00100000:3.0:1762167011.835958:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004480 00010000:00010000:3.0:1762167011.835990:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0be77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40b5 expref: 30 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167011.836029:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7646 00000100:00100000:3.0:1762167011.836038:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452004480:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.836052:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.836084:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0be77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40b5 expref: 30 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.836100:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0be77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40b5 expref: 30 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.836124:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a28600/0xf915a5bdf3d0be77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40b5 expref: 30 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167011.836137:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.836140:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.836144:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.836152:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.836177:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.836200:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.836212:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.836234:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452004480:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 195us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.836246:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7646 00010000:00010000:1.0:1762167011.838601:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.838614:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.838621:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.838626:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480ed600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.838628:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.838634:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.838645:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.838653:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.838712:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452004352:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5259us (5453us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.838719:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3214 00000100:00100000:0.0:1762167011.841475:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.841521:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004608 00000100:00100000:1.0:1762167011.841532:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004608 00000100:00100000:1.0:1762167011.841619:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3215 00000100:00100000:1.0:1762167011.841630:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452004608:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.841665:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.841684:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0be93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40c3 expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.841692:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.841695:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.841698:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.841743:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0be93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40c3 expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.841758:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0be93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40c3 expref: 28 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.841821:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454537344:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.841903:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.844431:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454537344:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.844456:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.845883:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.845969:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004736 00000100:00100000:2.0:1762167011.845977:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004736 00010000:00010000:2.0:1762167011.846016:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0be93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40c3 expref: 29 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.846060:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7647 00000100:00100000:2.0:1762167011.846070:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452004736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167011.846086:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.846107:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0be93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40c3 expref: 29 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.846121:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0be93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40c3 expref: 29 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.846145:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee346a29000/0xf915a5bdf3d0be93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40c3 expref: 29 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.846161:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.846163:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.846168:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.846177:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.846212:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167011.846272:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452004736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 203us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.846280:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7647 00010000:00010000:1.0:1762167011.846363:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.846383:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.849584:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.849598:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.849604:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.849608:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.849611:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.849616:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.849630:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.849635:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.849711:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765452004608:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 8077us (8241us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.849721:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3215 00000100:00100000:0.0:1762167011.852849:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.852889:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004864 00000100:00100000:1.0:1762167011.852901:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004864 00000100:00100000:1.0:1762167011.852975:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3216 00000100:00100000:1.0:1762167011.852988:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765452004864:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.853028:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.853051:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0beaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d1 expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.853060:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.853062:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.853066:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.853110:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0beaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d1 expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.853130:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0beaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d1 expref: 32 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.853145:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454537472:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.853239:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167011.858498:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.858560:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452004992 00000100:00100000:2.0:1762167011.858572:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452004992 00010000:00010000:2.0:1762167011.858612:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0beaf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d1 expref: 33 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.858663:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7648 00000100:00100000:2.0:1762167011.858675:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765452004992:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762167011.858683:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:26246:1847765454537472:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167011.858694:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167011.858715:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.858727:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0beaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d1 expref: 33 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.858743:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0beaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d1 expref: 33 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.858807:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fc66600/0xf915a5bdf3d0beaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40d1 expref: 33 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.858824:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.858827:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.858832:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.858852:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.858881:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.858905:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.858916:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.858948:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765452004992:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 275us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.858956:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7648 00010000:00010000:1.0:1762167011.861616:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.861635:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.861642:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.861648:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480ed600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.861653:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.861663:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.861679:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.861686:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0bf5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.861802:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765452004864:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 8814us (8964us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.861813:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3216 00000100:00100000:0.0:1762167011.864846:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.864973:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452005120 00000100:00100000:1.0:1762167011.864984:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452005120 00000100:00100000:1.0:1762167011.865063:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3217 00000100:00100000:1.0:1762167011.865075:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765452005120:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:1.0:1762167011.865110:0:26246:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.865275:0:26246:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0becb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40df expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.865284:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.865287:0:26246:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167011.865291:0:26246:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.865333:0:26246:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0becb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40df expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.865346:0:26246:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0becb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40df expref: 27 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.865373:0:26246:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454537600:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167011.865458:0:26246:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1762167011.867515:0:26246:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:26246:1847765454537600:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167011.867542:0:26246:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.868048:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.868372:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452005248 00000100:00100000:2.0:1762167011.868389:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452005248 00010000:00010000:2.0:1762167011.868498:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0becb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40df expref: 28 pid: 12400 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.868540:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7649 00000100:00100000:2.0:1762167011.868549:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452005248:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167011.868564:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.868587:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0becb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40df expref: 28 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.868605:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0becb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40df expref: 28 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.868629:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee372abbe00/0xf915a5bdf3d0becb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40df expref: 28 pid: 12400 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.868645:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.868647:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.868651:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.868661:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.868693:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167011.868715:0:26246:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.868726:0:26246:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167011.868752:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765452005248:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 203us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.868804:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7649 00010000:00010000:1.0:1762167011.871338:0:26246:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.871368:0:26246:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.871377:0:26246:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.871388:0:26246:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167011.871392:0:26246:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.871401:0:26246:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.871417:0:26246:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167011.871424:0:26246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26246 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167011.871518:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765452005120:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6442us (6677us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1762167011.871529:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3217 00000100:00100000:3.0:1762167011.880896:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.881083:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452005376 00000100:00100000:2.0:1762167011.881093:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452005376 00000100:00100000:2.0:1762167011.881163:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 662 00000100:00100000:2.0:1762167011.881175:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56223:x1847765452005376:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762167011.881192:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.881217:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bf1f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40fb expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.881237:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.881243:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167011.881308:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56223:x1847765452005376:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 136us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.881317:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 662 00000100:00100000:3.0:1762167011.882885:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.882943:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452005632 00000100:00100000:0.0:1762167011.882952:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452005632 00000100:00100000:0.0:1762167011.883004:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7389 00000100:00100000:0.0:1762167011.883014:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56223:x1847765452005632:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167011.883256:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56223:x1847765452005632:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 242us (376us total) trans 8589953150 rc 0/0 00000100:00100000:0.0:1762167011.883264:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7389 00000100:00100000:0.0:1762167011.886856:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.886904:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452005888 00000100:00100000:2.0:1762167011.886917:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452005888 00000100:00100000:2.0:1762167011.886979:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20058 00000100:00100000:2.0:1762167011.886990:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765452005888:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167011.887017:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.887038:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bf6c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4102 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.887146:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.887161:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ed expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.887169:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.887203:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ed expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.887215:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ed expref: 897 pid: 30817 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.887228:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454537728:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167011.887312:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c000 going to sleep for 11 seconds 00000100:00100000:3.0:1762167011.889344:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.889467:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452006016 00000100:00100000:0.0:1762167011.889476:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452006016 00010000:00010000:0.0:1762167011.889512:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ed expref: 898 pid: 30817 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1762167011.889566:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7650 00000100:00100000:0.0:1762167011.889576:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765452006016:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167011.889592:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167011.889601:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ed expref: 898 pid: 30817 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1762167011.889616:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ed expref: 898 pid: 30817 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.889628:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454537728:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167011.889640:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0befc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40ed expref: 898 pid: 30817 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167011.889653:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.889659:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167011.889667:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.889676:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.889684:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.889708:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.889727:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.889745:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:2.0:1762167011.889800:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000100:00100000:0.0:1762167011.889802:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765452006016:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 226us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167011.889812:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7650 00010000:00010000:2.0:1762167011.889947:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bf6c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4102 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.889962:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4102 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.889969:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.889971:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762167011.889974:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:2.0:1762167011.890019:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765452005888:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 3032us (3179us total) trans 8589953151 rc 0/0 00000100:00100000:2.0:1762167011.890026:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20058 00000100:00100000:3.0:1762167011.892429:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.892471:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452006144 00000100:00100000:2.0:1762167011.892481:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452006144 00000100:00100000:2.0:1762167011.892534:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20059 00000100:00100000:2.0:1762167011.892544:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765452006144:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167011.892565:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.892582:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf81 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4109 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.892657:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.892670:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4102 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.892678:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.892708:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4102 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.892721:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4102 expref: 898 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:2.0:1762167011.892735:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc28000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454537856:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167011.892827:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c000 going to sleep for 11 seconds 00000100:00100000:2.0:1762167011.894586:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc28000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454537856:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167011.894614:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167011.895909:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167011.896036:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452006272 00000100:00100000:0.0:1762167011.896045:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452006272 00010000:00010000:0.0:1762167011.896081:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4102 expref: 899 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1762167011.896127:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7651 00000100:00100000:0.0:1762167011.896138:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765452006272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167011.896158:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167011.896166:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4102 expref: 899 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1762167011.896180:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4102 expref: 899 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1762167011.896202:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0bf73 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4102 expref: 899 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1762167011.896217:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167011.896222:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.896232:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.896239:0:5742:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167011.896269:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.896295:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.896304:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.896324:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765452006272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167011.896333:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7651 00000004:00200000:2.0:1762167011.896344:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.896361:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.896383:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.896415:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf81 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4109 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.896430:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4109 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.896438:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.896441:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.896444:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ce00, rc 0) 00000100:00100000:2.0:1762167011.896488:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765452006144:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 3945us (4064us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.896495:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20059 00000100:00100000:3.0:1762167011.898688:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.898845:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452006400 00000100:00100000:1.0:1762167011.898854:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452006400 00000100:00100000:1.0:1762167011.899553:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17439 00000100:00100000:1.0:1762167011.899566:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765452006400:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167011.899582:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167011.899601:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4110 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167011.899625:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888de, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167011.899649:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.899652:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167011.899660:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4110 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167011.899676:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4110 expref: 27 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167011.899688:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f4d9c00, rc 0) 00000100:00100000:1.0:1762167011.899752:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765452006400:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 190us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.899759:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17439 00000100:00100000:0.0:1762167011.902622:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.902700:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452006656 00000100:00100000:2.0:1762167011.902711:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452006656 00000100:00100000:2.0:1762167011.902817:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20060 00000100:00100000:2.0:1762167011.902827:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765452006656:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:2.0:1762167011.902882:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167011.902908:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0bf88 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4109 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.902926:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.902931:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.903182:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.903196:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.903204:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000001:00080000:2.0:1762167011.903327:0:30819:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953152 00000004:00010000:2.0:1762167011.903367:0:30819:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004c17dfeb reply state 000000002b5f1b0f transno 8589953153 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167011.903376:0:30819:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167011.903466:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765452006656:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 640us (852us total) trans 8589953153 rc 0/0 00000100:00100000:2.0:1762167011.903474:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20060 00000020:00080000:2.0:1762167011.903480:0:30819:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167011.905115:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.905129:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.905137:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.905143:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167011.905147:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.905154:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.905168:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.905171:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167011.905175:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.905184:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bf96 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167011.906600:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.906669:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452006912 00000100:00100000:2.0:1762167011.906678:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452006912 00000100:00100000:2.0:1762167011.906734:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7390 00000100:00100000:2.0:1762167011.906744:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765452006912:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167011.907111:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765452006912:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 368us (517us total) trans 8589953154 rc 0/0 00000100:00100000:2.0:1762167011.907120:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7390 00000100:00100000:3.0:1762167011.908388:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.908503:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452007168 00000100:00100000:2.0:1762167011.908513:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452007168 00000100:00100000:2.0:1762167011.908560:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20061 00000100:00100000:2.0:1762167011.908569:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765452007168:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167011.908586:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.908589:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762167011.908615:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bf0a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40f4 expref: 899 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.908637:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0bee0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb40e6 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.908648:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167011.908658:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167011.908673:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bf9d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4117 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.908917:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bfa4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.908931:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bfa4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167011.908940:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bfa4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000040:00080000:2.0:1762167011.909462:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5636, 88 off456192 00000004:00080000:2.0:1762167011.909470:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632701706750ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.909527:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5644, 88 off457248 00000004:00080000:2.0:1762167011.909532:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632701769564ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.910179:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5645, 88 off457336 00000004:00080000:2.0:1762167011.910186:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632702423088ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.910205:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5637, 88 off456280 00000004:00080000:2.0:1762167011.910210:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632702446858ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.910237:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5646, 88 off457424 00000004:00080000:2.0:1762167011.910241:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632702478707ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.910259:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5638, 88 off456368 00000004:00080000:2.0:1762167011.910263:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632702500072ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.910295:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5639, 88 off456456 00000004:00080000:2.0:1762167011.910300:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632702537028ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.910318:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5647, 88 off457512 00000004:00080000:2.0:1762167011.910322:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632702558933ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.910336:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5648, 88 off457600 00000004:00080000:2.0:1762167011.910339:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632702576207ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.910364:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5640, 88 off456544 00000004:00080000:2.0:1762167011.910370:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632702607207ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.910387:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5649, 88 off457688 00000004:00080000:2.0:1762167011.910390:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632702627730ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.910405:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5641, 88 off456632 00000004:00080000:2.0:1762167011.910409:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632702646419ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.910425:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5642, 88 off456720 00000004:00080000:2.0:1762167011.910430:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632702666922ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.910448:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5650, 88 off457776 00000004:00080000:2.0:1762167011.910452:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632702689577ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.910470:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5643, 88 off456808 00000004:00080000:2.0:1762167011.910474:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632702711123ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.910502:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5651, 88 off457864 00000004:00080000:2.0:1762167011.910507:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632702744038ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.910525:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5652, 88 off457952 00000004:00080000:2.0:1762167011.910529:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632702765983ns, next at 630703976179ns, rc = 0 00000040:00080000:2.0:1762167011.910547:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5644, 88 off456896 00000004:00080000:2.0:1762167011.910550:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632702787609ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.910584:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5645, 88 off456984 00000004:00080000:2.0:1762167011.910588:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632702825602ns, next at 630704042948ns, rc = 0 00000040:00080000:2.0:1762167011.910604:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5653, 88 off458040 00000004:00080000:2.0:1762167011.910607:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632702844663ns, next at 630703976179ns, rc = 0 00000001:00080000:1.0:1762167011.934729:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953150 is committed 00000001:00080000:1.0:1762167011.934753:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953155 is committed 00000004:00080000:1.0:1762167011.934758:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3764 committed 00000004:00080000:1.0:1762167011.934801:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3751 committed 00000004:00080000:1.0:1762167011.934808:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3750 committed 00000004:00080000:1.0:1762167011.934810:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3763 committed 00000004:00080000:1.0:1762167011.934812:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3762 committed 00000004:00080000:1.0:1762167011.934815:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3749 committed 00000004:00080000:1.0:1762167011.934817:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3761 committed 00000004:00080000:1.0:1762167011.934819:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3748 committed 00000004:00080000:1.0:1762167011.934821:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3747 committed 00000004:00080000:1.0:1762167011.934823:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3760 committed 00000004:00080000:1.0:1762167011.934826:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3746 committed 00000004:00080000:1.0:1762167011.934828:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3759 committed 00000004:00080000:1.0:1762167011.934830:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3758 committed 00000004:00080000:1.0:1762167011.934831:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3745 committed 00000004:00080000:1.0:1762167011.934833:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3744 committed 00000004:00080000:1.0:1762167011.934839:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3757 committed 00000004:00080000:1.0:1762167011.934841:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3743 committed 00000004:00080000:1.0:1762167011.934844:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3756 committed 00000004:00080000:1.0:1762167011.934846:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3755 committed 00000004:00080000:1.0:1762167011.934848:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3742 committed 00000100:00100000:0.0:1762167011.935245:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454538112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.935309:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.935342:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454538624:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167011.935376:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bfa4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4117 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.935377:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167011.935393:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167011.935397:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1762167011.935409:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:3.0:1762167011.935418:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0bf9d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4117 expref: 891 pid: 30819 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762167011.935419:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454538240:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762167011.935447:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bfa4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4117 expref: 890 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167011.935448:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.935467:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454538752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.935483:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167011.935491:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167011.935495:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762167011.935498:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1de00, rc 0) 00000100:00100000:0.0:1762167011.935516:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454538112 00000100:00100000:0.0:1762167011.935525:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454538112 00000100:00100000:3.0:1762167011.935559:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765452007168:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 26990us (27173us total) trans 8589953155 rc 0/0 00000100:00100000:0.0:1762167011.935565:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454538624 00000100:00100000:3.0:1762167011.935569:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20061 00000100:00100000:0.0:1762167011.935571:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454538624 00000100:00100000:0.0:1762167011.935597:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454538240 00000100:00100000:0.0:1762167011.935600:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454538240 00000100:00100000:0.0:1762167011.935641:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454538752 00000100:00100000:0.0:1762167011.935644:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454538752 00000100:00100000:3.0:1762167011.935677:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17440 00000100:00100000:3.0:1762167011.935688:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454538112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.935702:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454538368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.935734:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.935755:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454538880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.935803:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.935818:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1762167011.935824:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454537984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.935842:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.935851:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454538496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.935870:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.935895:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454538368 00000100:00100000:2.0:1762167011.935898:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454538368 00002000:00010000:3.0:1762167011.935916:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167011.935919:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454538880 00002000:00010000:3.0:1762167011.935921:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:2.0:1762167011.935924:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454538880 00000100:00100000:2.0:1762167011.935934:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454537984 00002000:00010000:3.0:1762167011.935937:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.935941:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.935944:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.935947:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454537984 00000100:00100000:2.0:1762167011.935964:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454538496 00000100:00100000:2.0:1762167011.935967:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454538496 00000100:00100000:3.0:1762167011.935990:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454538112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 301us (678us total) trans 21474843659 rc 0/0 00000100:00100000:2.0:1762167011.935990:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17441 00000100:00100000:2.0:1762167011.935999:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454538624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.936003:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17440 00000100:00100000:1.0:1762167011.936023:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17442 00000100:00100000:3.0:1762167011.936039:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17443 00000100:00100000:1.0:1762167011.936044:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454538240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.936051:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3293:x1847765454538752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167011.936152:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.936156:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.936160:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:2.0:1762167011.936163:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167011.936165:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.936208:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454538624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (830us total) trans 21474843660 rc 0/0 00000100:00100000:3.0:1762167011.936211:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454538752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (724us total) trans 21474843661 rc 0/0 00002000:00010000:1.0:1762167011.936220:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167011.936222:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17441 00002000:00010000:1.0:1762167011.936226:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:3.0:1762167011.936231:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17443 00002000:00010000:1.0:1762167011.936232:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167011.936237:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.936240:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.936244:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17444 00000100:00100000:3.0:1762167011.936252:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17445 00000100:00100000:2.0:1762167011.936256:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454538368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.936264:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454538880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.936286:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454538240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 253us (839us total) trans 21474843662 rc 0/0 00000100:00100000:1.0:1762167011.936296:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17442 00000100:00100000:1.0:1762167011.936321:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17446 00000100:00100000:1.0:1762167011.936330:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3295:x1847765454537984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167011.936418:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762167011.936422:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.936425:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167011.936427:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.936429:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167011.936438:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454538368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (701us total) trans 21474843663 rc 0/0 00000100:00100000:2.0:1762167011.936446:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17444 00000100:00100000:3.0:1762167011.936468:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454538880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (662us total) trans 21474843664 rc 0/0 00000100:00100000:3.0:1762167011.936476:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17445 00002000:00010000:1.0:1762167011.936483:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762167011.936489:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.936492:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.936496:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000100:00100000:3.0:1762167011.936499:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17447 00002000:00010000:1.0:1762167011.936502:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00000100:00100000:3.0:1762167011.936511:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454538496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.936544:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454537984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (699us total) trans 21474843665 rc 0/0 00000100:00100000:1.0:1762167011.936552:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17446 00002000:00010000:3.0:1762167011.936618:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.936621:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.936625:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000004:00080000:2.0:1762167011.936625:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aa9880/2, rc 0, transno 21474843665 00002000:00010000:3.0:1762167011.936633:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.936635:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.936644:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454537984:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167011.936661:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aa9180/2, rc 0, transno 21474843663 00000100:00100000:2.0:1762167011.936667:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454538368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.936672:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3295:x1847765454538496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (797us total) trans 21474843666 rc 0/0 00000100:00100000:3.0:1762167011.936682:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17447 00000004:00080000:2.0:1762167011.936683:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff81f80/2, rc 0, transno 21474843664 00000100:00100000:2.0:1762167011.936690:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454538880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167011.936705:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454539392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.936734:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167011.936752:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454539008:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167011.936797:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aaa300/2, rc 0, transno 21474843666 00000100:00100000:2.0:1762167011.936803:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454538496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.936809:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.936814:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454539904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.936834:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454539520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.936841:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.936869:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454539392 00000100:00100000:3.0:1762167011.936875:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454539392 00000100:00100000:1.0:1762167011.936876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.936906:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17448 00000100:00100000:3.0:1762167011.936915:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454539392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167011.937084:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.937087:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.937090:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167011.937092:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.937094:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167011.937125:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454539392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (390us total) trans 17179876086 rc 0/0 00000100:00100000:3.0:1762167011.937132:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17448 00000100:00100000:2.0:1762167011.938045:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454539008 00000100:00100000:2.0:1762167011.938052:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454539008 00000100:00100000:2.0:1762167011.938089:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454539520 00000100:00100000:2.0:1762167011.938092:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454539520 00000100:00100000:2.0:1762167011.938106:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17449 00000100:00100000:2.0:1762167011.938113:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3296:x1847765454539008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167011.938231:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167011.938234:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167011.938237:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167011.938239:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167011.938241:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167011.938286:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3296:x1847765454539008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (1477us total) trans 17179876087 rc 0/0 00000100:00100000:2.0:1762167011.938296:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17449 00000100:00100000:2.0:1762167011.938310:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17450 00000100:00100000:2.0:1762167011.938316:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3296:x1847765454539520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.938426:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3296:x1847765454539520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (1561us total) trans 17179876088 rc 0/0 00000100:00100000:2.0:1762167011.938432:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17450 00000004:00080000:2.0:1762167011.938470:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c1500/2, rc 0, transno 17179876087 00000100:00100000:2.0:1762167011.938481:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454539008:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167011.938491:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c0a80/2, rc 0, transno 17179876088 00000100:00100000:2.0:1762167011.938495:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454539520:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167011.938515:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c0700/2, rc 0, transno 17179876086 00000100:00100000:2.0:1762167011.938519:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454539392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.938576:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454540032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.938605:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167011.938632:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454540032 00000100:00100000:2.0:1762167011.938636:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454540032 00000100:00100000:2.0:1762167011.938657:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17451 00000100:00100000:2.0:1762167011.938663:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3296:x1847765454540032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167011.938759:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3296:x1847765454540032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (152us total) trans 17179876089 rc 0/0 00000100:00100000:2.0:1762167011.938789:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17451 00000004:00080000:2.0:1762167011.938814:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee359065500/2, rc 0, transno 17179876089 00000100:00100000:2.0:1762167011.938818:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454540032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.939084:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454539136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.939111:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.939128:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454539648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.939145:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.939157:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454540160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.939172:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167011.939193:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aab480/2, rc 0, transno 21474843662 00000100:00100000:0.0:1762167011.939197:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454538240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167011.939206:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff83800/2, rc 0, transno 21474843661 00000100:00100000:0.0:1762167011.939209:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454538752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167011.939219:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aa8a80/2, rc 0, transno 21474843659 00000100:00100000:0.0:1762167011.939222:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454538112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167011.939232:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee346aaaa00/2, rc 0, transno 21474843660 00000100:00100000:0.0:1762167011.939236:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454538624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.939245:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1762167011.939251:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454539264:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.939256:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762167011.939269:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454540416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.939277:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.939298:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454539776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.939309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167011.939329:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454539136 00000100:00100000:0.0:1762167011.939333:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454539136 00000100:00100000:0.0:1762167011.939373:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17452 00000100:00100000:1.0:1762167011.939379:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454539904 00000100:00100000:0.0:1762167011.939382:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3293:x1847765454539136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167011.939387:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454539904 00000100:00100000:1.0:1762167011.939430:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454539648 00000100:00100000:1.0:1762167011.939433:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454539648 00000100:00100000:1.0:1762167011.939451:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454540160 00000100:00100000:1.0:1762167011.939454:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454540160 00000100:00100000:1.0:1762167011.939467:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454539264 00000100:00100000:1.0:1762167011.939469:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454539264 00000100:00100000:1.0:1762167011.939481:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454540416 00000100:00100000:1.0:1762167011.939484:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454540416 00000100:00100000:1.0:1762167011.939505:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17453 00002000:00010000:0.0:1762167011.939512:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167011.939514:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454539904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167011.939517:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.939524:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.939527:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.939529:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.939562:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454539136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (448us total) trans 17179876090 rc 0/0 00000100:00100000:0.0:1762167011.939569:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17452 00000100:00100000:0.0:1762167011.939588:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17454 00000100:00100000:0.0:1762167011.939598:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3293:x1847765454539648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.939601:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17455 00000100:00100000:3.0:1762167011.939615:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454540160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167011.939642:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167011.939646:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.939650:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167011.939653:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167011.939656:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167011.939694:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454539904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (2852us total) trans 17179876091 rc 0/0 00000100:00100000:1.0:1762167011.939702:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17453 00000100:00100000:1.0:1762167011.939722:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17456 00000100:00100000:1.0:1762167011.939731:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454539264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.939748:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454539648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (600us total) trans 17179876092 rc 0/0 00000100:00100000:0.0:1762167011.939756:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17454 00000100:00100000:0.0:1762167011.939799:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17457 00000100:00100000:0.0:1762167011.939809:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454540416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.939884:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454539264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (609us total) trans 17179876094 rc 0/0 00000100:00100000:1.0:1762167011.939891:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17456 00002000:00010000:3.0:1762167011.939910:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.939915:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.939918:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167011.939921:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.939924:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.939966:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3296:x1847765454540416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (656us total) trans 21474843667 rc 0/0 00000100:00100000:0.0:1762167011.939974:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17457 00000100:00100000:3.0:1762167011.939983:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454540160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 366us (803us total) trans 17179876093 rc 0/0 00000100:00100000:1.0:1762167011.939985:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167011.939996:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17455 00000004:00080000:0.0:1762167011.940014:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff82300/2, rc 0, transno 21474843667 00000100:00100000:3.0:1762167011.940016:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454539776 00000100:00100000:1.0:1762167011.940021:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37ff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454540288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167011.940023:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454539776 00000100:00100000:0.0:1762167011.940024:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454540416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167011.940054:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167011.940134:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c0e00/2, rc 0, transno 17179876091 00000100:00100000:2.0:1762167011.940141:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454539904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167011.940224:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454540288 00000100:00100000:3.0:1762167011.940229:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454540288 00000004:00080000:1.0:1762167011.940233:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c3480/2, rc 0, transno 17179876090 00000100:00100000:1.0:1762167011.940240:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454539136:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167011.940250:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c2680/2, rc 0, transno 17179876092 00000100:00100000:1.0:1762167011.940253:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454539648:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167011.940261:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee359065f80/2, rc 0, transno 17179876093 00000100:00100000:1.0:1762167011.940264:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454540160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167011.940272:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c1c00/2, rc 0, transno 17179876094 00000100:00100000:1.0:1762167011.940275:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454539264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167011.941562:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17458 00000100:00100000:0.0:1762167011.941577:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454539776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167011.941720:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.941723:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.941726:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167011.941729:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.941731:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.941801:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454539776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (1817us total) trans 17179876095 rc 0/0 00000100:00100000:0.0:1762167011.941809:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17458 00000100:00100000:0.0:1762167011.941826:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17459 00000100:00100000:0.0:1762167011.941833:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454540288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167011.941921:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.941925:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.941927:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167011.941930:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167011.941932:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.941959:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454540288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (1904us total) trans 21474843668 rc 0/0 00000100:00100000:0.0:1762167011.941965:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17459 00000004:00080000:0.0:1762167011.942008:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c2300/2, rc 0, transno 17179876095 00000100:00100000:0.0:1762167011.942013:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454539776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167011.942025:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37ff82a00/2, rc 0, transno 21474843668 00000100:00100000:0.0:1762167011.942028:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37ff82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454540288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167011.942946:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.943011:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452007296 00000100:00100000:3.0:1762167011.943019:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452007296 00000100:00100000:3.0:1762167011.943063:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17460 00000100:00100000:3.0:1762167011.943071:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765452007296:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167011.943085:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.943102:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb411e expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.943136:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bdac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4068 expref: 28 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167011.943145:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.943147:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.943151:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.943181:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bdac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4068 expref: 28 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167011.943195:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bdac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4068 expref: 28 pid: 6533 timeout: 732 lvb_type: 1 00000100:00100000:3.0:1762167011.943210:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348256680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454540544:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167011.943285:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167011.944934:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348256680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454540544:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167011.944967:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.944986:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:3.0:1762167011.945043:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56065:x1847765452007296:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1972us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.945052:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17460 00000100:00100000:0.0:1762167011.945101:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.945141:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452007424 00000100:00100000:3.0:1762167011.945149:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452007424 00010000:00010000:3.0:1762167011.945175:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bdac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4068 expref: 28 pid: 6533 timeout: 732 lvb_type: 1 00000100:00100000:3.0:1762167011.945210:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7652 00000100:00100000:3.0:1762167011.945219:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452007424:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.945233:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.945254:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bdac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4068 expref: 28 pid: 6533 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.945267:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bdac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4068 expref: 28 pid: 6533 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.945291:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0bdac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4068 expref: 28 pid: 6533 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.945458:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.945461:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.945469:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.945480:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.945515:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.945529:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348256680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454540672:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167011.945589:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720f00 going to sleep for 11 seconds 00000100:00100000:0.0:1762167011.947331:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.947504:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452007552 00000100:00100000:3.0:1762167011.947512:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348256680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454540672:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167011.947512:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452007552 00010000:00010000:3.0:1762167011.947534:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167011.947583:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17461 00000100:00100000:3.0:1762167011.947596:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765452007424:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2371us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.947596:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56065:x1847765452007552:12345-192.168.203.35@tcp:101:fsx.0 00000100:00100000:3.0:1762167011.947613:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7652 00010000:00010000:2.0:1762167011.947616:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.947639:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4125 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.947678:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bdb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb406f expref: 32 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.947687:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.947689:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.947693:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.947724:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb406f expref: 32 pid: 6533 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.947737:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bdb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb406f expref: 32 pid: 6533 timeout: 732 lvb_type: 1 00000100:00100000:2.0:1762167011.947749:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454540800:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167011.947855:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c540 going to sleep for 11 seconds 00000100:00100000:2.0:1762167011.949116:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454540800:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167011.949143:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.949160:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00000100:00100000:2.0:1762167011.949203:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56065:x1847765452007552:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 1611us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.949212:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17461 00000100:00100000:0.0:1762167011.949610:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.949652:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452007680 00000100:00100000:3.0:1762167011.949659:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452007680 00010000:00010000:3.0:1762167011.949685:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bdb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb406f expref: 32 pid: 6533 timeout: 732 lvb_type: 1 00000100:00100000:3.0:1762167011.949718:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7653 00000100:00100000:3.0:1762167011.949730:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452007680:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.949745:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.949793:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bdb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb406f expref: 32 pid: 6533 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.949807:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb406f expref: 32 pid: 6533 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.949828:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0bdb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb406f expref: 32 pid: 6533 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.949838:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.949847:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.949857:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.949867:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.949896:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 31 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.949908:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348256680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765454540928:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167011.949962:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720f00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167011.951123:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348256680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5742:1847765454540928:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167011.951141:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167011.951186:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452007680:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1460us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.951195:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7653 00000100:00100000:3.0:1762167011.952004:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.952083:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452007808 00000100:00100000:2.0:1762167011.952091:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452007808 00000100:00100000:2.0:1762167011.952135:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17462 00000100:00100000:2.0:1762167011.952142:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765452007808:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:2.0:1762167011.952157:0:33892:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.952169:0:33892:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb412c expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.952189:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bdba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4076 expref: 28 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.952195:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.952197:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167011.952199:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.952221:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bdba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4076 expref: 28 pid: 33892 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762167011.952229:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bdba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4076 expref: 28 pid: 33892 timeout: 732 lvb_type: 1 00000100:00100000:2.0:1762167011.952240:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36f330700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454541056:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167011.952299:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee347d2c540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167011.953929:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.954055:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36f330700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454541056:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167011.954086:0:33892:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 28 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.954104:0:33892:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c200, rc 0) 00000100:00100000:3.0:1762167011.954113:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452007936 00000100:00100000:3.0:1762167011.954123:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452007936 00010000:00010000:3.0:1762167011.954155:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bdba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4076 expref: 29 pid: 33892 timeout: 732 lvb_type: 1 00000100:00100000:2.0:1762167011.954166:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56065:x1847765452007808:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2020us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.954174:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17462 00000100:00100000:3.0:1762167011.954208:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7654 00000100:00100000:3.0:1762167011.954219:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765452007936:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.954233:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.954255:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bdba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4076 expref: 28 pid: 33892 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.954274:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bdba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4076 expref: 28 pid: 33892 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.954294:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bdba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4076 expref: 28 pid: 33892 timeout: 732 lvb_type: 1 00010000:00010000:3.0:1762167011.954309:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.954312:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167011.954318:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.954328:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.954492:0:5742:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 27 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167011.954508:0:5742:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454541184:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167011.954577:0:5742:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720f00 going to sleep for 11 seconds 00000100:00100000:0.0:1762167011.956287:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.956300:0:5742:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5742:1847765454541184:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167011.956319:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167011.956322:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.956372:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452008064 00000100:00100000:1.0:1762167011.956380:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452008064 00000100:00100000:3.0:1762167011.956385:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37ff81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765452007936:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2166us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.956396:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7654 00002000:00010000:1.0:1762167011.956421:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (152547->18446744073709551615) 00002000:00100000:1.0:1762167011.956427:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb5f80 with x1847765452008064 ext(152547->18446744073709551615) 00002000:00010000:1.0:1762167011.956439:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb5f80. 00000100:00100000:2.0:1762167011.956444:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452008192 00000100:00100000:0.0:1762167011.956450:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.956451:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452008192 00002000:00010000:2.0:1762167011.956471:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:1.0:1762167011.956471:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452008320 00000100:00100000:1.0:1762167011.956477:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452008320 00002000:00100000:2.0:1762167011.956478:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb4e00 with x1847765452008192 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.956488:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fcb4e00. 00002000:00010000:1.0:1762167011.956496:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167011.956500:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb4380 with x1847765452008320 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167011.956507:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb4380. 00000100:00100000:2.0:1762167011.956513:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3218 00000100:00100000:2.0:1762167011.956523:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765452008064:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:3.0:1762167011.956581:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3219 00000100:00100000:0.0:1762167011.956588:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3220 00000100:00100000:3.0:1762167011.956592:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452008192:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:0.0:1762167011.956598:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765452008320:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167011.956841:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167011.956841:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167011.956846:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167011.956846:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167011.956849:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.956852:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167011.956853:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167011.956855:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167011.956855:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167011.956858:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167011.956886:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765452008320:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 291us (439us total) trans 21474843669 rc 0/0 00000100:00100000:0.0:1762167011.956894:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3220 00002000:00010000:0.0:1762167011.956897:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:0.0:1762167011.956900:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb4380 with x1847765452008320 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167011.956905:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb4380. 00000100:00100000:3.0:1762167011.956931:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452008192:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 297us (563us total) trans 17179876096 rc 0/0 00002000:00010000:2.0:1762167011.956938:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 262144 -> 152547 00000100:00100000:3.0:1762167011.956939:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3219 00002000:00010000:2.0:1762167011.956945:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167011.956946:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00010000:2.0:1762167011.956949:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00100000:3.0:1762167011.956952:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb4e00 with x1847765452008192 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167011.956954:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:2.0:1762167011.956959:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 309 00002000:00010000:3.0:1762167011.956961:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fcb4e00. 00000100:00100000:2.0:1762167011.957128:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765452008064:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 607us (847us total) trans 21474843670 rc 0/0 00000100:00100000:2.0:1762167011.957136:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3218 00002000:00010000:2.0:1762167011.957139:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (152547->18446744073709551615) 00002000:00100000:2.0:1762167011.957141:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fcb5f80 with x1847765452008064 ext(152547->18446744073709551615) 00002000:00010000:2.0:1762167011.957146:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fcb5f80. 00000100:00100000:1.0:1762167011.958706:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.958873:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452008448 00000100:00100000:3.0:1762167011.958881:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452008448 00000100:00100000:3.0:1762167011.958927:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20062 00000100:00100000:3.0:1762167011.958936:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765452008448:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167011.958957:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.958976:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0bfc0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4133 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.959051:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.959066:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.959076:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167011.959106:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:3.0:1762167011.959110:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167011.959126:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167011.959149:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0bfc0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4133 expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.959167:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4133 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.959177:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167011.959179:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167011.959183:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922200, rc 0) 00000100:00100000:3.0:1762167011.959231:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765452008448:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 296us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.959237:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20062 00000100:00100000:2.0:1762167011.961957:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.962050:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452008576 00000100:00100000:1.0:1762167011.962060:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452008576 00002000:00100000:1.0:1762167011.962109:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->28671) req@ffff9ee36f330700 x1847765452008576/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.962121:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f330700 with x1847765452008576 ext(24576->28671) 00002000:00010000:1.0:1762167011.962128:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f330700 00000100:00100000:1.0:1762167011.962159:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3221 00000100:00100000:1.0:1762167011.962169:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452008576:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:1.0:1762167011.962404:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452008576:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 235us (454us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762167011.962412:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3221 00002000:00100000:1.0:1762167011.962419:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->28671) req@ffff9ee36f330700 x1847765452008576/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/4536 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167011.962427:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36f330700 with x1847765452008576 ext(24576->28671) 00002000:00010000:1.0:1762167011.962431:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36f330700 00000100:00100000:1.0:1762167011.964468:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.964586:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452008704 00000100:00100000:2.0:1762167011.964596:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452008704 00002000:00100000:2.0:1762167011.964643:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (61440->65535) req@ffff9ee346a2c380 x1847765452008704/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/0 e 0 to 0 dl 1762167022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167011.964655:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346a2c380 with x1847765452008704 ext(61440->65535) 00002000:00010000:2.0:1762167011.964660:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346a2c380 00000100:00100000:2.0:1762167011.964698:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3222 00000100:00100000:2.0:1762167011.964709:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765452008704:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167011.964927:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2358:x1847765452008704:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 220us (465us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167011.964936:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3222 00002000:00100000:2.0:1762167011.964958:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (61440->65535) req@ffff9ee346a2c380 x1847765452008704/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:42/0 lens 488/4536 e 0 to 0 dl 1762167022 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167011.964968:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee346a2c380 with x1847765452008704 ext(61440->65535) 00002000:00010000:2.0:1762167011.964971:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee346a2c380 00000100:00100000:0.0:1762167011.968297:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.968468:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452008960 00000100:00100000:2.0:1762167011.968478:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452008960 00000100:00100000:2.0:1762167011.968536:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7391 00000100:00100000:2.0:1762167011.968546:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765452008960:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:2.0:1762167011.968974:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765452008960:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 427us (684us total) trans 8589953156 rc 0/0 00000100:00100000:2.0:1762167011.968982:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7391 00000100:00100000:0.0:1762167011.979598:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.979795:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452009088 00000100:00100000:3.0:1762167011.979806:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452009088 00000100:00100000:3.0:1762167011.979871:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20063 00000100:00100000:3.0:1762167011.979883:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56224:x1847765452009088:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167011.979909:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.979930:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0bfce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb413a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.980023:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bfd5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980042:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bfd5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980053:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bfd5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980067:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bfdc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980074:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bfdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980081:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bfdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980199:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bfe3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980209:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980217:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:3.0:1762167011.980252:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:3.0:1762167011.980257:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167011.980276:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980287:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bfe3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980295:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bfd5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980305:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bfd5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980311:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bfd5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980316:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167011.980320:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bfd5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980327:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bfd5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980338:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167011.980341:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167011.980345:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bfd5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980363:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0bfd5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980376:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bfdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980383:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bfdc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980388:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bfdc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980393:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167011.980396:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bfdc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980405:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bfdc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980412:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee345a77200) 00010000:00010000:3.0:1762167011.980415:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167011.980418:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bfdc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980423:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0bfdc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.980457:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0bfce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb413a expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.980470:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bfe3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb413a expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.980489:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167011.980491:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167011.980494:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00000100:00100000:3.0:1762167011.980549:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56224:x1847765452009088:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 669us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.980557:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20063 00000100:00100000:1.0:1762167011.984019:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.984157:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452009216 00000100:00100000:3.0:1762167011.984169:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452009216 00000100:00100000:3.0:1762167011.984237:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 663 00000100:00100000:3.0:1762167011.984248:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2359:x1847765452009216:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167011.984265:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167011.984291:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bfe3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb413a expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.984313:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167011.984318:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167011.984388:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:2359:x1847765452009216:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 141us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167011.984396:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 663 00000100:00100000:0.0:1762167011.985229:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.985333:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452009472 00000100:00100000:3.0:1762167011.985339:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452009472 00000100:00100000:3.0:1762167011.985396:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20064 00000100:00100000:3.0:1762167011.985404:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56224:x1847765452009472:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167011.985423:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.985442:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bfea lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4141 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.985544:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.985559:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4133 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.985568:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.985600:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4133 expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.985613:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4133 expref: 893 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167011.985634:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454541312:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167011.985707:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167011.987521:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454541312:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167011.987543:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167011.988170:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.988266:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452009600 00000100:00100000:1.0:1762167011.988273:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452009600 00010000:00010000:1.0:1762167011.988308:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4133 expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.988359:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7655 00000100:00100000:1.0:1762167011.988369:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765452009600:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167011.988388:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167011.988395:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4133 expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1762167011.988407:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4133 expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1762167011.988432:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922200/0xf915a5bdf3d0bfc7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4133 expref: 894 pid: 30819 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1762167011.988448:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167011.988452:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167011.988462:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167011.988469:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167011.988528:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167011.988575:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.988585:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167011.988597:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:2361:x1847765452009600:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 228us (427us total) trans 0 rc 0/0 00000004:00200000:3.0:1762167011.988605:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000100:00100000:1.0:1762167011.988606:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7655 00010000:00010000:3.0:1762167011.988752:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0bfea lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4141 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.988813:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4141 expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.988822:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:3.0:1762167011.988826:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167011.988829:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922a00, rc 0) 00000100:00100000:3.0:1762167011.988872:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56224:x1847765452009472:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3469us (3658us total) trans 8589953157 rc 0/0 00000100:00100000:3.0:1762167011.988880:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20064 00000100:00100000:0.0:1762167011.990513:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167011.990591:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452009728 00000100:00100000:3.0:1762167011.990600:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452009728 00000100:00100000:3.0:1762167011.990657:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20065 00000100:00100000:3.0:1762167011.990667:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56224:x1847765452009728:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167011.990701:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167011.990721:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bfff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4148 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.990835:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.990850:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4141 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.990858:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167011.990892:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4141 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167011.990906:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4141 expref: 894 pid: 30817 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167011.990919:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454541440:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167011.991004:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167011.992854:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454541440:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167011.992882:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167011.992965:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167011.993039:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452009856 00000100:00100000:1.0:1762167011.993047:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452009856 00010000:00010000:1.0:1762167011.993081:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4141 expref: 895 pid: 30817 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167011.993111:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7656 00000100:00100000:1.0:1762167011.993121:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2361:x1847765452009856:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167011.993140:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167011.993147:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4141 expref: 895 pid: 30817 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1762167011.993166:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4141 expref: 895 pid: 30817 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1762167011.993186:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0bff1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4141 expref: 895 pid: 30817 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1762167011.993200:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167011.993210:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167011.993218:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167011.993226:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167011.993256:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167011.993304:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765452009856:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 184us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167011.993312:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7656 00010000:00010000:2.0:1762167011.993313:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.993328:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167011.993384:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:2.0:1762167011.993389:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167011.993411:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.993443:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0bfff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4148 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.993460:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4148 expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.993468:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:2.0:1762167011.993470:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167011.993473:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923000, rc 0) 00000100:00100000:2.0:1762167011.993516:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56224:x1847765452009728:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2849us (3009us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167011.993522:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20065 00000100:00100000:0.0:1762167011.996284:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167011.999363:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452010112 00000100:00100000:2.0:1762167011.999379:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452010112 00000100:00100000:2.0:1762167011.999457:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20066 00000100:00100000:2.0:1762167011.999470:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56224:x1847765452010112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167011.999504:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167011.999526:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c00d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb414f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.999653:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c014 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.999667:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c014 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167011.999679:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c014 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:2.0:1762167011.999691:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00010000:00010000:2.0:1762167011.999844:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c00d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb414f expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.999862:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c014 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb414f expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167011.999871:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:2.0:1762167011.999873:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167011.999877:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c800, rc 0) 00000100:00100000:2.0:1762167011.999944:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56224:x1847765452010112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 477us (3669us total) trans 8589953158 rc 0/0 00000100:00100000:2.0:1762167011.999952:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20066 00000100:00100000:0.0:1762167012.004004:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.004045:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.004075:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.004137:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452010240 00000100:00100000:1.0:1762167012.004138:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452010368 00000100:00100000:3.0:1762167012.004149:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452010240 00000100:00100000:1.0:1762167012.004149:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452010368 00000100:00100000:3.0:1762167012.004207:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452010496 00000100:00100000:3.0:1762167012.004211:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452010496 00000100:00100000:1.0:1762167012.004283:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17463 00000100:00100000:3.0:1762167012.004292:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17464 00000100:00100000:3.0:1762167012.004306:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765452010368:12345-192.168.203.35@tcp:1:lfs.0 00000100:00100000:1.0:1762167012.004306:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17465 00000100:00100000:1.0:1762167012.004318:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452010496:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:3.0:1762167012.004360:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.004362:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.004393:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 30 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.004394:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.004414:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167012.004415:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167012.004419:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167012.004419:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167012.004426:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.004426:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.004483:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 32 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.004488:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 30 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.004502:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 32 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1762167012.004504:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 30 pid: 33892 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167012.004532:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348257b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454541568:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167012.004532:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454541696:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167012.004643:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762167012.004643:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1762167012.004667:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452010240:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167012.004692:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.004703:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 30 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.004709:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167012.004711:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762167012.004714:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.004744:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 30 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.004754:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 30 pid: 33892 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1762167012.004784:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee346a2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454541824:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167012.004821:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167012.007678:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.007743:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.007798:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452010624 00000100:00100000:2.0:1762167012.007808:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452010624 00000100:00100000:3.0:1762167012.007845:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348257b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:33894:1847765454541568:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167012.007851:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 33 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167012.007874:0:33894:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167012.007897:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7657 00000100:00100000:2.0:1762167012.007909:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452010624:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762167012.007916:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167012.007937:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762167012.007940:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452010752 00000100:00100000:3.0:1762167012.007945:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452010752 00010000:00010000:2.0:1762167012.007966:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 33 pid: 33892 timeout: 732 lvb_type: 0 00002000:00100000:3.0:1762167012.007981:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->65535) req@ffff9ee24786b480 x1847765452010752/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/0 e 0 to 0 dl 1762167023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1762167012.007985:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 33 pid: 33892 timeout: 732 lvb_type: 0 00002000:00100000:3.0:1762167012.008005:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24786b480 with x1847765452010752 ext(24576->65535) 00010000:00010000:3.0:1762167012.008015:0:21530:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 31 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167012.008026:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0bfb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4125 expref: 33 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167012.008028:0:21530:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 31 pid: 33892 timeout: 732 lvb_type: 0 00002000:00010000:3.0:1762167012.008048:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee24786b480 00010000:00010000:2.0:1762167012.008055:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.008059:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.008065:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.008074:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 27 00010000:00010000:2.0:1762167012.008077:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.008085:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765452010752:12345-192.168.203.35@tcp:4:fsx.0 00010000:00010000:2.0:1762167012.008109:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167012.008159:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452010624:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 252us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.008168:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7657 00000100:00100000:2.0:1762167012.008185:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452010880 00000100:00100000:2.0:1762167012.008190:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452010880 00010000:00010000:2.0:1762167012.008206:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 33 pid: 33892 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167012.008234:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:12402:1847765454541696:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167012.008241:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7658 00010000:00010000:3.0:1762167012.008251:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167012.008252:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452010880:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.008268:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.008283:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 33 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:2.0:1762167012.008295:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 33 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167012.008311:0:33894:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.008313:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0bfb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb412c expref: 33 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167012.008333:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.008338:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.008342:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.008358:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.008371:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.008376:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.008394:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.008404:0:33894:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.008410:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee346a2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454541824:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167012.008412:0:33894:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167012.008420:0:33894:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.008429:0:33894:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.008443:0:33894:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.008444:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.008463:0:33894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c029 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.008517:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765452010368:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 4216us (4474us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167012.008526:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17464 00010000:00010000:2.0:1762167012.009059:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167012.009122:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452010880:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 871us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.009131:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7658 00010000:00010000:0.0:1762167012.009153:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.009163:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.009182:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.009189:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.009196:0:12402:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.009209:0:12402:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480ed600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167012.009212:0:12402:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.009219:0:12402:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.009231:0:12402:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.009237:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c022 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.009292:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452010496:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 4978us (5216us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.009300:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17465 00000100:00100000:0.0:1762167012.011647:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765452010752:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 3557us (3896us total) trans 21474843671 rc 0/0 00000100:00100000:0.0:1762167012.011665:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 27 00002000:00100000:0.0:1762167012.011678:0:21530:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x7ff:0x0] (24576->65535) req@ffff9ee24786b480 x1847765452010752/t21474843671(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/448 e 0 to 0 dl 1762167023 ref 1 fl Complete:H/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167012.011688:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24786b480 with x1847765452010752 ext(24576->65535) 00010000:00010000:0.0:1762167012.011697:0:21530:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 31 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1762167012.011717:0:21530:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 31 pid: 33892 timeout: 732 lvb_type: 0 00002000:00010000:0.0:1762167012.011724:0:21530:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ee24786b480 00000100:00100000:2.0:1762167012.014298:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.014368:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452011008 00000100:00100000:3.0:1762167012.014379:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452011008 00010000:00010000:3.0:1762167012.015041:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 31 pid: 33892 timeout: 732 lvb_type: 0 00000100:00100000:3.0:1762167012.015092:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7659 00000100:00100000:3.0:1762167012.015105:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765452011008:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167012.015120:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167012.015143:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 31 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167012.015156:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 31 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167012.015179:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0bfab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb411e expref: 31 pid: 33892 timeout: 732 lvb_type: 0 00010000:00010000:3.0:1762167012.015196:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.015198:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.015202:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.015211:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.015246:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167012.015304:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765452011008:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 203us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167012.015311:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7659 00010000:00010000:1.0:1762167012.015405:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.015416:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.015441:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.015449:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.015458:0:6535:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.015465:0:6535:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372975000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167012.015470:0:6535:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.015479:0:6535:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.015491:0:6535:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.015499:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c030 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.015557:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee247868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452010240:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 11264us (11561us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.015566:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17463 00000100:00100000:2.0:1762167012.017020:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.017107:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452011264 00000100:00100000:0.0:1762167012.017116:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452011264 00000100:00100000:0.0:1762167012.017168:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20067 00000100:00100000:0.0:1762167012.017178:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56224:x1847765452011264:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167012.017226:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167012.017249:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c006 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4148 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.017272:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0bfa4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4117 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.017282:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:0.0:1762167012.017286:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167012.017313:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.017325:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.017331:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000040:00080000:0.0:1762167012.017914:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5646, 88 off457072 00000004:00080000:0.0:1762167012.017925:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632810161268ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.018008:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5654, 88 off458128 00000004:00080000:0.0:1762167012.018017:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632810254022ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.018060:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5655, 88 off458216 00000004:00080000:0.0:1762167012.018066:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632810303235ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.018096:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5647, 88 off457160 00000004:00080000:0.0:1762167012.018100:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632810337384ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.018136:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5656, 88 off458304 00000004:00080000:0.0:1762167012.018141:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632810378089ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.018175:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5648, 88 off457248 00000004:00080000:0.0:1762167012.018180:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632810417383ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.018210:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5649, 88 off457336 00000004:00080000:0.0:1762167012.018216:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632810452953ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.018241:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5657, 88 off458392 00000004:00080000:0.0:1762167012.018245:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632810482529ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.018262:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5658, 88 off458480 00000004:00080000:0.0:1762167012.018265:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632810502762ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.018283:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5650, 88 off457424 00000004:00080000:0.0:1762167012.018287:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632810523922ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.018320:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5659, 88 off458568 00000004:00080000:0.0:1762167012.018325:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632810562372ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.018365:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5651, 88 off457512 00000004:00080000:0.0:1762167012.018371:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632810607582ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.018397:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5652, 88 off457600 00000004:00080000:0.0:1762167012.018402:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632810639448ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.018424:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5660, 88 off458656 00000004:00080000:0.0:1762167012.018428:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632810665587ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.018463:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5653, 88 off457688 00000004:00080000:0.0:1762167012.018468:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632810705608ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.018538:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5662, 88 off458840 00000004:00080000:0.0:1762167012.018543:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632810780762ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.018561:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5663, 88 off458928 00000004:00080000:0.0:1762167012.018566:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632810803342ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.018582:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5654, 88 off457776 00000004:00080000:0.0:1762167012.018586:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632810823622ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.018622:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5655, 88 off457864 00000004:00080000:0.0:1762167012.018627:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632810863618ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.018644:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5664, 88 off459016 00000004:00080000:0.0:1762167012.018648:0:30817:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632810885452ns, next at 630703976179ns, rc = 0 00000004:00010000:1.0:1762167012.035426:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005e41fbae reply state 0000000092001407 transno 8589953159 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.035446:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1762167012.035508:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953159 is committed 00000004:00080000:3.0:1762167012.035517:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3774 committed 00000004:00080000:3.0:1762167012.035535:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3761 committed 00000004:00080000:3.0:1762167012.035548:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3760 committed 00000004:00080000:3.0:1762167012.035551:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3773 committed 00000004:00080000:3.0:1762167012.035554:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3772 committed 00010000:00080000:1.0:1762167012.035555:0:30817:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000004:00080000:3.0:1762167012.035556:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3759 committed 00000004:00080000:3.0:1762167012.035561:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3771 committed 00000004:00080000:3.0:1762167012.035564:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3758 committed 00000004:00080000:3.0:1762167012.035567:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3757 committed 00000004:00080000:3.0:1762167012.035571:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3770 committed 00000004:00080000:3.0:1762167012.035574:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3756 committed 00000004:00080000:3.0:1762167012.035578:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3769 committed 00000100:00100000:1.0:1762167012.035578:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56224:x1847765452011264:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 18395us (18556us total) trans 8589953159 rc 0/0 00000004:00080000:3.0:1762167012.035583:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3768 committed 00000004:00080000:3.0:1762167012.035587:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3755 committed 00000004:00080000:3.0:1762167012.035591:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3754 committed 00000004:00080000:3.0:1762167012.035593:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3767 committed 00000004:00080000:3.0:1762167012.035597:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3753 committed 00000100:00100000:1.0:1762167012.035597:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20067 00000004:00080000:3.0:1762167012.035606:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3766 committed 00000004:00080000:3.0:1762167012.035609:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3765 committed 00000004:00080000:3.0:1762167012.035613:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3752 committed 00010000:00010000:1.0:1762167012.035756:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.035797:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.035805:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.035812:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30cc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167012.035816:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.035824:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.035841:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.035845:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167012.035850:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.035858:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c037 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.035889:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454542208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.035936:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.035973:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454542336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.035973:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454542720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.036006:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.036012:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454542080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.036031:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.036031:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454543232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.036048:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.036049:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454542592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.036061:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454543744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.036065:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.036078:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454543104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.036078:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.036102:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454542208 00000100:00100000:2.0:1762167012.036109:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454542208 00000100:00100000:3.0:1762167012.036120:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24786ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454541952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.036156:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454542720 00000100:00100000:2.0:1762167012.036161:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454542720 00000100:00100000:2.0:1762167012.036177:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454542080 00000100:00100000:2.0:1762167012.036180:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454542080 00000100:00100000:2.0:1762167012.036205:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454543232 00000100:00100000:2.0:1762167012.036208:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454543232 00000100:00100000:2.0:1762167012.036218:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454542592 00000100:00100000:2.0:1762167012.036220:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454542592 00000100:00100000:2.0:1762167012.036228:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454543744 00000100:00100000:2.0:1762167012.036230:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454543744 00000100:00100000:2.0:1762167012.036242:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17466 00000100:00100000:2.0:1762167012.036252:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3294:x1847765454542208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.036439:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.036441:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17467 00000100:00100000:1.0:1762167012.036453:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1847765454542720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.036461:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454542464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.036476:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3294:x1847765454542208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 224us (539us total) trans 21474843672 rc 0/0 00000100:00100000:2.0:1762167012.036484:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17466 00000100:00100000:3.0:1762167012.036495:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.036501:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454541952 00000100:00100000:2.0:1762167012.036506:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454541952 00000100:00100000:3.0:1762167012.036514:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454542976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.036520:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454542464 00000100:00100000:2.0:1762167012.036526:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454542464 00000100:00100000:3.0:1762167012.036542:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.036546:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17468 00000100:00100000:2.0:1762167012.036554:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3293:x1847765454542080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167012.036561:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454543488:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167012.036568:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.036573:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.036576:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167012.036579:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.036581:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.036590:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.036618:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3294:x1847765454542720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (609us total) trans 21474843673 rc 0/0 00000100:00100000:1.0:1762167012.036625:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17467 00000100:00100000:1.0:1762167012.036639:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454542976 00000100:00100000:1.0:1762167012.036642:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454542976 00000100:00100000:3.0:1762167012.036646:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454543488 00000100:00100000:3.0:1762167012.036652:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454543488 00002000:00010000:2.0:1762167012.036661:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167012.036661:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17469 00002000:00010000:2.0:1762167012.036664:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167012.036667:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167012.036669:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00000100:00100000:1.0:1762167012.036670:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3294:x1847765454543232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1762167012.036672:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.036692:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17470 00000100:00100000:0.0:1762167012.036707:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17471 00000100:00100000:3.0:1762167012.036708:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3293:x1847765454542592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.036709:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3293:x1847765454542080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (672us total) trans 17179876097 rc 0/0 00000100:00100000:0.0:1762167012.036721:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3294:x1847765454543744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.036727:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17468 00000100:00100000:2.0:1762167012.036745:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17472 00000100:00100000:2.0:1762167012.036753:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3296:x1847765454541952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167012.036800:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.036804:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.036806:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167012.036809:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.036811:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167012.036849:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3294:x1847765454543232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (798us total) trans 17179876098 rc 0/0 00000100:00100000:1.0:1762167012.036855:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17469 00000100:00100000:1.0:1762167012.036871:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17473 00000100:00100000:1.0:1762167012.036878:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3296:x1847765454542464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167012.036911:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167012.036915:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167012.036918:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167012.036921:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167012.036924:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.036955:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3293:x1847765454542592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 253us (886us total) trans 21474843674 rc 0/0 00000100:00100000:3.0:1762167012.036967:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17470 00000100:00100000:0.0:1762167012.036968:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3294:x1847765454543744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 248us (885us total) trans 17179876099 rc 0/0 00000100:00100000:2.0:1762167012.036974:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3296:x1847765454541952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (533us total) trans 21474843675 rc 0/0 00000100:00100000:0.0:1762167012.036981:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17471 00000100:00100000:2.0:1762167012.036989:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17472 00000100:00100000:3.0:1762167012.036996:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17474 00000100:00100000:0.0:1762167012.037008:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17475 00000100:00100000:3.0:1762167012.037009:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3296:x1847765454542976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167012.037016:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762167012.037021:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3296:x1847765454543488:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1762167012.037022:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1762167012.037022:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00080000:2.0:1762167012.037028:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1762167012.037028:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:1.0:1762167012.037031:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.037033:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:2.0:1762167012.037057:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24786ad80/2, rc 0, transno 21474843675 00000100:00100000:1.0:1762167012.037062:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3296:x1847765454542464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (569us total) trans 21474843676 rc 0/0 00000100:00100000:2.0:1762167012.037069:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24786ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454541952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.037070:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17473 00000004:00080000:2.0:1762167012.037081:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247868a80/2, rc 0, transno 21474843676 00000100:00100000:2.0:1762167012.037086:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454542464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.037113:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.037136:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee247869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454542848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.037143:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454544000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.037171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167012.037183:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3296:x1847765454542976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (638us total) trans 17179876100 rc 0/0 00000100:00100000:3.0:1762167012.037192:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17474 00000100:00100000:1.0:1762167012.037200:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454543360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.037202:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454542336 00000100:00100000:0.0:1762167012.037207:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3296:x1847765454543488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (618us total) trans 17179876101 rc 0/0 00000100:00100000:2.0:1762167012.037208:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454542336 00000100:00100000:0.0:1762167012.037218:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17475 00000100:00100000:1.0:1762167012.037229:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.037239:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454542848 00000100:00100000:2.0:1762167012.037240:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454543360 00000100:00100000:0.0:1762167012.037245:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454542848 00000100:00100000:2.0:1762167012.037246:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454543360 00000100:00100000:1.0:1762167012.037249:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454543872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.037269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.037287:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454543872 00000100:00100000:0.0:1762167012.037292:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454543872 00000100:00100000:2.0:1762167012.037293:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17476 00000100:00100000:2.0:1762167012.037304:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454542336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.037309:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17477 00000100:00100000:1.0:1762167012.037318:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454542848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.037324:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17478 00000100:00100000:0.0:1762167012.037333:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17479 00000100:00100000:3.0:1762167012.037338:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454543360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167012.037358:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3295:x1847765454543872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167012.037435:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.037439:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.037441:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167012.037443:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.037446:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167012.037464:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3295:x1847765454542336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (349us total) trans 17179876102 rc 0/0 00000100:00100000:2.0:1762167012.037471:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17476 00000100:00100000:1.0:1762167012.037472:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3295:x1847765454542848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 157us (300us total) trans 21474843677 rc 0/0 00000100:00100000:1.0:1762167012.037478:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17477 00002000:00010000:0.0:1762167012.037505:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762167012.037506:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167012.037511:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167012.037515:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167012.037518:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167012.037520:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167012.037524:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454543104 00000100:00100000:1.0:1762167012.037527:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454543616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.037528:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454543104 00000100:00100000:1.0:1762167012.037554:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.037559:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17480 00000100:00100000:2.0:1762167012.037566:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3293:x1847765454543104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167012.037575:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 262144 -> 262144 00000100:00100000:0.0:1762167012.037575:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3295:x1847765454543872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (302us total) trans 17179876103 rc 0/0 00002000:00010000:3.0:1762167012.037581:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00000100:00100000:1.0:1762167012.037585:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454544128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167012.037587:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17479 00002000:00010000:3.0:1762167012.037588:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167012.037594:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167012.037598:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167012.037607:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454543616 00000100:00100000:0.0:1762167012.037612:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454543616 00000100:00100000:1.0:1762167012.037617:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.037631:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454544128 00000100:00100000:0.0:1762167012.037635:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454544128 00000100:00100000:3.0:1762167012.037641:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3295:x1847765454543360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 306us (410us total) trans 21474843678 rc 0/0 00000100:00100000:3.0:1762167012.037651:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17478 00000004:00080000:1.0:1762167012.037654:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f794000/2, rc 0, transno 17179876097 00000100:00100000:0.0:1762167012.037659:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17481 00000100:00100000:1.0:1762167012.037669:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454542080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.037672:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee346a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3293:x1847765454543616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167012.037677:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17482 00000004:00080000:1.0:1762167012.037684:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24786a680/2, rc 0, transno 21474843674 00000100:00100000:1.0:1762167012.037692:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24786a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454542592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.037693:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454544128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.037694:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454543104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (187us total) trans 21474843679 rc 0/0 00000004:00080000:1.0:1762167012.037705:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a8000/2, rc 0, transno 21474843679 00000100:00100000:2.0:1762167012.037706:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17480 00000100:00100000:1.0:1762167012.037708:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454543104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.037783:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762167012.037793:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454544256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.037823:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.037823:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.037840:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee346a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3293:x1847765454543616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (284us total) trans 17179876104 rc 0/0 00000100:00100000:0.0:1762167012.037848:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17481 00000100:00100000:2.0:1762167012.037855:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454544256 00000100:00100000:2.0:1762167012.037859:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454544256 00000004:00080000:1.0:1762167012.037861:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb11180/2, rc 0, transno 17179876104 00000100:00100000:1.0:1762167012.037871:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454543616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.037882:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17483 00000100:00100000:2.0:1762167012.037889:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3293:x1847765454544256:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167012.037951:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f796a00/2, rc 0, transno 17179876098 00000100:00100000:3.0:1762167012.037955:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454544128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 267us (337us total) trans 21474843680 rc 0/0 00000100:00100000:1.0:1762167012.037959:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454543232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167012.037970:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17482 00000004:00080000:1.0:1762167012.037975:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb10700/2, rc 0, transno 17179876099 00000100:00100000:1.0:1762167012.037981:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454543744:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167012.037992:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24786aa00/2, rc 0, transno 21474843672 00000100:00100000:1.0:1762167012.037995:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24786aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454542208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.037996:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3293:x1847765454544256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (173us total) trans 17179876105 rc 0/0 00000100:00100000:2.0:1762167012.038003:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17483 00000004:00080000:1.0:1762167012.038006:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24786bb80/2, rc 0, transno 21474843673 00000100:00100000:3.0:1762167012.038012:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454544384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.038012:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24786bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454542720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.038025:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452011392 00000100:00100000:2.0:1762167012.038028:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452011392 00000100:00100000:1.0:1762167012.038037:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167012.038054:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.038059:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20068 00000004:00080000:1.0:1762167012.038061:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f795880/2, rc 0, transno 17179876100 00000100:00100000:1.0:1762167012.038065:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454542976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.038068:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56224:x1847765452011392:12345-192.168.203.35@tcp:101:lfs.0 00000004:00080000:1.0:1762167012.038079:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f796300/2, rc 0, transno 17179876101 00010000:00010000:2.0:1762167012.038080:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167012.038083:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454543488:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167012.038090:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f795500/2, rc 0, transno 17179876102 00010000:00010000:2.0:1762167012.038095:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c03e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4156 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.038098:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454542336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.038102:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454544000 00000100:00100000:1.0:1762167012.038107:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454544000 00000004:00080000:3.0:1762167012.038117:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee247869c00/2, rc 0, transno 21474843677 00000100:00100000:3.0:1762167012.038122:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee247869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454542848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.038131:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454544384 00000004:00080000:3.0:1762167012.038135:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9c00/2, rc 0, transno 21474843678 00000100:00100000:1.0:1762167012.038136:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454544384 00000100:00100000:3.0:1762167012.038143:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454543360:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762167012.038147:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c03e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4156 expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.038157:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17484 00000004:00080000:3.0:1762167012.038159:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e471880/2, rc 0, transno 17179876103 00010000:00010000:2.0:1762167012.038164:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c03e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4156 expref: 891 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.038164:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3296:x1847765454544000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.038167:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454543872:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167012.038190:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:2.0:1762167012.038193:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167012.038197:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:3.0:1762167012.038222:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17485 00000100:00100000:3.0:1762167012.038233:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3295:x1847765454544384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.038241:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56224:x1847765452011392:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 168us (412us total) trans 0 rc 0/0 00000004:00080000:0.0:1762167012.038244:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee245188700/2, rc 0, transno 17179876105 00000100:00100000:2.0:1762167012.038251:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20068 00000100:00100000:0.0:1762167012.038254:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454544256:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1762167012.038259:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.038264:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.038266:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167012.038269:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00000004:00080000:0.0:1762167012.038272:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240d500/2, rc 0, transno 21474843680 00002000:00010000:1.0:1762167012.038273:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167012.038280:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454544128:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.038313:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3296:x1847765454544000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (273us total) trans 21474843681 rc 0/0 00000100:00100000:1.0:1762167012.038322:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17484 00000004:00080000:0.0:1762167012.038333:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24240ce00/2, rc 0, transno 21474843681 00000100:00100000:0.0:1762167012.038340:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454544000:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167012.038346:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167012.038362:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167012.038365:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167012.038368:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167012.038371:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.038421:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3295:x1847765454544384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (367us total) trans 17179876106 rc 0/0 00000100:00100000:3.0:1762167012.038429:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17485 00000004:00080000:2.0:1762167012.038580:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24518a680/2, rc 0, transno 17179876106 00000100:00100000:2.0:1762167012.038584:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454544384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.040631:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.040705:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452011520 00000100:00100000:1.0:1762167012.040713:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452011520 00000100:00100000:1.0:1762167012.040802:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20069 00000100:00100000:1.0:1762167012.040812:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56224:x1847765452011520:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.040830:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.040921:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c045 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb415d expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.041009:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c04c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.041019:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c04c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.041026:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c04c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167012.041045:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 262144 00000004:00200000:1.0:1762167012.041048:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167012.041058:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c04c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.041076:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c045 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb415d expref: 893 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.041088:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c04c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb415d expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.041094:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.041096:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167012.041098:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37299e400, rc 0) 00000100:00100000:1.0:1762167012.041141:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56224:x1847765452011520:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 331us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.041147:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20069 00000100:00100000:2.0:1762167012.043409:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.043451:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.043489:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452011648 00000100:00100000:1.0:1762167012.043499:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452011648 00000100:00100000:2.0:1762167012.043510:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.043554:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452011776 00000100:00100000:1.0:1762167012.043555:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452011904 00000100:00100000:3.0:1762167012.043562:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452011776 00000100:00100000:1.0:1762167012.043562:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452011904 00000100:00100000:1.0:1762167012.043600:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17486 00000100:00100000:1.0:1762167012.043612:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765452011648:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:3.0:1762167012.043618:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17487 00000100:00100000:3.0:1762167012.043630:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452011904:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.043630:0:33894:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167012.043642:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.043652:0:33894:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c053 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4164 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167012.043676:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 152547, mtime: 0x690888e4, atime: 0x690888e3, ctime: 0x690888e4, blocks: 0x135 00010000:00010000:1.0:1762167012.043694:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.043697:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.043702:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c05a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4172 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.043709:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4164 expref: 31 pid: 33894 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167012.043719:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17488 00002000:00010000:3.0:1762167012.043724:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x801:0x0] initial LVB size: 0, mtime: 0x690888e4, atime: 0x690888e3, ctime: 0x690888e4, blocks: 0x3 00010000:00010000:1.0:1762167012.043732:0:33894:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4164 expref: 32 pid: 33894 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762167012.043734:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765452011776:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167012.043737:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.043741:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.043750:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4172 expref: 32 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167012.043753:0:33894:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee2425f5c00, rc 0) 00010000:00010000:0.0:1762167012.043755:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167012.043792:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4172 expref: 32 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167012.043797:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0c061 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb416b expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.043805:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00002000:00010000:0.0:1762167012.043820:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x804:0x0] initial LVB size: 0, mtime: 0x690888e4, atime: 0x690888e3, ctime: 0x690888e4, blocks: 0x3 00010000:00010000:0.0:1762167012.043833:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762167012.043837:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765452011648:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 225us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167012.043838:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452011904:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 208us (326us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167012.043838:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.043848:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0c061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb416b expref: 32 pid: 12400 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167012.043858:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17486 00010000:00010000:0.0:1762167012.043869:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0c061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb416b expref: 32 pid: 12400 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167012.043878:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17487 00010000:00010000:0.0:1762167012.043882:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c400, rc 0) 00000100:00100000:0.0:1762167012.043911:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765452011776:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 181us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.043917:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17488 00000100:00100000:2.0:1762167012.073296:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.073387:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012032 00000100:00100000:0.0:1762167012.073397:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012032 00000100:00100000:0.0:1762167012.073477:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3223 00000100:00100000:0.0:1762167012.073490:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765452012032:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167012.073529:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c068 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.073544:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.073546:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.073551:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c068 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.073563:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c068 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.075896:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c068 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.075914:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c068 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.075923:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.075935:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e30c000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167012.075940:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.075954:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c068 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.075973:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c068 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.075986:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c068 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.076067:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765452012032:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 2576us (2777us total) trans 0 rc 152547/152547 00000100:00100000:1.0:1762167012.076076:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3223 00000100:00100000:2.0:1762167012.079318:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.079423:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012160 00000100:00100000:1.0:1762167012.079434:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012160 00000100:00100000:1.0:1762167012.079513:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3224 00000100:00100000:1.0:1762167012.079524:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2359:x1847765452012160:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167012.079592:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888d5, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167012.079600:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c06f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.079613:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.079616:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.079625:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c06f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.079641:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c06f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167012.097733:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876104 is committed 00000001:00080000:0.0:1762167012.097804:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876075 is committed 00000001:00080000:0.0:1762167012.097816:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876107 is committed 00002000:00010000:1.0:1762167012.097839:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:1.0:1762167012.097845:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00010000:00010000:1.0:1762167012.097859:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c06f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167012.097869:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876105 is committed 00010000:00010000:1.0:1762167012.097878:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c06f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.097887:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c06f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.097895:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372975000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167012.097900:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c06f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167012.097903:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876106 is committed 00010000:00010000:1.0:1762167012.097912:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c06f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.097932:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c06f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.097939:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c06f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.098034:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765452012160:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 18508us (18723us total) trans 17179876107 rc 0/0 00000100:00100000:1.0:1762167012.098044:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3224 00000100:00100000:2.0:1762167012.101078:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.101151:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012288 00000100:00100000:1.0:1762167012.101161:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012288 00000100:00100000:1.0:1762167012.101222:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3225 00000100:00100000:1.0:1762167012.101229:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765452012288:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167012.101269:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888db, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167012.101276:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c076 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.101291:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.101293:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.101297:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.101323:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762167012.116165:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843671 is committed 00000001:00080000:3.0:1762167012.116188:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843668 is committed 00000001:00080000:3.0:1762167012.116217:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843682 is committed 00000001:00080000:3.0:1762167012.116225:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843681 is committed 00002000:00010000:1.0:1762167012.116246:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:1.0:1762167012.116252:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00010000:00010000:1.0:1762167012.116265:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.116275:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.116284:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.116291:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167012.116295:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.116303:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.116322:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c076 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.116330:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c076 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.116426:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765452012288:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 15193us (15354us total) trans 21474843682 rc 0/0 00000100:00100000:1.0:1762167012.116434:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3225 00000100:00100000:2.0:1762167012.118874:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.118975:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012416 00000100:00100000:1.0:1762167012.118986:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012416 00000100:00100000:1.0:1762167012.119054:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3226 00000100:00100000:1.0:1762167012.119064:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765452012416:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167012.119112:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888db, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167012.119120:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c07d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.119132:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.119134:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.119140:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c07d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.119152:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c07d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167012.135041:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876108 is committed 00002000:00010000:0.0:1762167012.135227:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167012.135232:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00010000:00010000:0.0:1762167012.135244:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c07d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.135255:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c07d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.135264:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c07d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.135271:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef2800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167012.135276:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c07d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.135284:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c07d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.135301:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c07d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.135309:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c07d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.135413:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765452012416:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16346us (16542us total) trans 17179876108 rc 0/0 00000100:00100000:0.0:1762167012.135423:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3226 00000100:00100000:0.0:1762167012.137922:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.137964:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012544 00000100:00100000:1.0:1762167012.137976:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012544 00000100:00100000:1.0:1762167012.138043:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3227 00000100:00100000:1.0:1762167012.138055:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765452012544:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:1.0:1762167012.138105:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888dd, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:1.0:1762167012.138114:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c084 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.138129:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.138131:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.138137:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.138152:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167012.153693:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876109 is committed 00002000:00010000:3.0:1762167012.153911:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.153920:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00010000:00010000:3.0:1762167012.153941:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.153957:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.153965:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.153972:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167012.153976:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.153985:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.154003:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c084 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.154010:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c084 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.154106:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765452012544:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16050us (16189us total) trans 17179876109 rc 0/0 00000100:00100000:3.0:1762167012.154116:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3227 00000100:00100000:2.0:1762167012.158683:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.158803:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012672 00000100:00100000:3.0:1762167012.158813:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012672 00000100:00100000:3.0:1762167012.158895:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3228 00000100:00100000:3.0:1762167012.158906:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765452012672:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167012.158954:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888dd, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:3.0:1762167012.158964:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c08b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.158984:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.158987:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.158992:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c08b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.159007:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c08b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167012.175308:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843683 is committed 00002000:00010000:3.0:1762167012.175419:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.175423:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00010000:00010000:3.0:1762167012.175436:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c08b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.175446:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c08b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.175455:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c08b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.175461:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167012.175465:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c08b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.175473:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c08b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.175490:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c08b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.175498:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c08b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.175597:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765452012672:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16691us (16920us total) trans 21474843683 rc 0/0 00000100:00100000:3.0:1762167012.175607:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3228 00000100:00100000:0.0:1762167012.178328:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.178406:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012800 00000100:00100000:3.0:1762167012.178417:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012800 00000100:00100000:3.0:1762167012.178491:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3229 00000100:00100000:3.0:1762167012.178501:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765452012800:12345-192.168.203.35@tcp:4:lfs.0 00010000:00010000:3.0:1762167012.178536:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.178551:0:21530:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4110 expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167012.178559:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.178562:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.178565:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.178601:0:21530:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4110 expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167012.178616:0:21530:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4110 expref: 17 pid: 26444 timeout: 732 lvb_type: 1 00000100:00100000:3.0:1762167012.178635:0:21530:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454544512:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167012.178725:0:21530:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762167012.180167:0:21530:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:21530:1847765454544512:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167012.180249:0:21530:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.180330:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.180404:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452012928 00000100:00100000:3.0:1762167012.180411:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452012928 00010000:00010000:3.0:1762167012.180438:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4110 expref: 18 pid: 26444 timeout: 732 lvb_type: 1 00000100:00100000:1.0:1762167012.180514:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7660 00000100:00100000:1.0:1762167012.180529:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452012928:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167012.180548:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167012.180571:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4110 expref: 18 pid: 26444 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1762167012.180585:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4110 expref: 18 pid: 26444 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1762167012.180605:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0bf8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4110 expref: 18 pid: 26444 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1762167012.180623:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.180626:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.180630:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.180640:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.180669:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167012.180694:0:21530:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.180703:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.180709:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765452012928:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 184us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.180718:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7660 00000001:00080000:1.0:1762167012.194284:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843684 is committed 00002000:00010000:3.0:1762167012.194421:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.194426:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00010000:00010000:3.0:1762167012.194442:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.194453:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.194462:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.194470:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167012.194474:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.194483:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.194502:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.194508:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c092 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.194609:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765452012800:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 16105us (16284us total) trans 21474843684 rc 0/0 00000100:00100000:3.0:1762167012.194620:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3229 00000100:00100000:2.0:1762167012.199939:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.200025:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013056 00000100:00100000:3.0:1762167012.200036:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013056 00000100:00100000:3.0:1762167012.200104:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3230 00000100:00100000:3.0:1762167012.200114:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765452013056:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167012.200175:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888de, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:3.0:1762167012.200183:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c099 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.200196:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.200198:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.200203:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c099 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.200215:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c099 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762167012.214786:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876110 is committed 00002000:00010000:3.0:1762167012.214916:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.214921:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00010000:00010000:3.0:1762167012.214934:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c099 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.214944:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.214953:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.214958:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167012.214963:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.214972:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c099 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.214991:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c099 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.214998:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c099 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.215096:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2359:x1847765452013056:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 14978us (15161us total) trans 17179876110 rc 0/0 00000100:00100000:3.0:1762167012.215106:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3230 00000100:00100000:2.0:1762167012.218116:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.218165:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013184 00000100:00100000:3.0:1762167012.218175:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013184 00000100:00100000:3.0:1762167012.218242:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3231 00000100:00100000:3.0:1762167012.218253:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765452013184:12345-192.168.203.35@tcp:4:lfs.0 00002000:00010000:3.0:1762167012.218303:0:21530:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 262144, mtime: 0x690888e3, atime: 0x690888e0, ctime: 0x690888e3, blocks: 0x203 00010000:00010000:3.0:1762167012.218312:0:21530:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c0a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.218332:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.218335:0:21530:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.218341:0:21530:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c0a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.218369:0:21530:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c0a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167012.239049:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843685 is committed 00002000:00010000:3.0:1762167012.239208:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.239213:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00010000:00010000:3.0:1762167012.239224:0:21530:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c0a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.239235:0:21530:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c0a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.239251:0:21530:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c0a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.239258:0:21530:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167012.239262:0:21530:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c0a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.239271:0:21530:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c0a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.239289:0:21530:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c0a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.239296:0:21530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c0a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21530 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.239406:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2358:x1847765452013184:12345-192.168.203.35@tcp:4:lfs.0 Request processed in 21149us (21293us total) trans 21474843685 rc 0/0 00000100:00100000:3.0:1762167012.239417:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3231 00000100:00100000:0.0:1762167012.248304:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.248715:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013440 00000100:00100000:1.0:1762167012.248727:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013440 00000100:00100000:1.0:1762167012.248852:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20070 00000100:00100000:1.0:1762167012.248864:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56224:x1847765452013440:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167012.248921:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167012.248950:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c04c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb415d expref: 892 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.248970:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.248975:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167012.249268:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.249281:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.249291:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167012.249358:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953160 00000004:00010000:1.0:1762167012.249388:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006fb3a04b reply state 000000002cc47885 transno 8589953161 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.249397:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167012.249495:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56224:x1847765452013440:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 633us (1200us total) trans 8589953161 rc 0/0 00000100:00100000:1.0:1762167012.249503:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20070 00000020:00080000:1.0:1762167012.249509:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167012.250577:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.250591:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.250597:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.250603:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef3600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167012.250607:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.250615:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.250628:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:0.0:1762167012.250631:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167012.250635:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.250640:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c0a7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167012.250996:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.251043:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013568 00000100:00100000:1.0:1762167012.251051:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013568 00000100:00100000:1.0:1762167012.251098:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17489 00000100:00100000:1.0:1762167012.251105:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56224:x1847765452013568:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.251118:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.251133:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c0ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4179 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167012.251152:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 262144, mtime: 0x690888e4, atime: 0x690888d5, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:1.0:1762167012.251167:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.251168:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.251173:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4179 expref: 23 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.251183:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4179 expref: 23 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.251191:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ef3200, rc 0) 00000100:00100000:1.0:1762167012.251228:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56224:x1847765452013568:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 124us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.251233:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17489 00000100:00100000:2.0:1762167012.252451:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.252495:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.252552:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013696 00000100:00100000:3.0:1762167012.252560:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013696 00000100:00100000:0.0:1762167012.252563:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013824 00000100:00100000:0.0:1762167012.252570:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013824 00002000:00010000:0.0:1762167012.252592:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00010000:3.0:1762167012.252593:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (152547->18446744073709551615) 00002000:00100000:0.0:1762167012.252599:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab3100 with x1847765452013824 ext(0->18446744073709551615) 00002000:00100000:3.0:1762167012.252601:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab3800 with x1847765452013696 ext(152547->18446744073709551615) 00002000:00010000:3.0:1762167012.252612:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374ab3800. 00002000:00010000:0.0:1762167012.252613:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee374ab3100. 00000100:00100000:3.0:1762167012.252652:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3232 00000100:00100000:0.0:1762167012.252664:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3233 00000100:00100000:3.0:1762167012.252666:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765452013696:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167012.252678:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765452013824:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167012.253100:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167012.253101:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 262144 -> 152547 00002000:00010000:0.0:1762167012.253104:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.253107:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.253108:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167012.253115:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:0.0:1762167012.253115:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167012.253120:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167012.253121:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.253124:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167012.253185:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765452013824:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 510us (688us total) trans 21474843686 rc 0/0 00000100:00100000:0.0:1762167012.253193:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3233 00002000:00010000:0.0:1762167012.253197:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2065 (0->18446744073709551615) 00002000:00100000:0.0:1762167012.253200:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab3100 with x1847765452013824 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167012.253204:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee374ab3100. 00000100:00100000:3.0:1762167012.253310:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2361:x1847765452013696:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 512us (728us total) trans 17179876111 rc 0/0 00000100:00100000:3.0:1762167012.253319:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3232 00002000:00010000:3.0:1762167012.253323:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2068 (152547->18446744073709551615) 00002000:00100000:3.0:1762167012.253326:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee374ab3800 with x1847765452013696 ext(152547->18446744073709551615) 00002000:00010000:3.0:1762167012.253331:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee374ab3800. 00000100:00100000:2.0:1762167012.254707:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.254879:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452013952 00000100:00100000:1.0:1762167012.254887:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452013952 00000100:00100000:1.0:1762167012.254935:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20071 00000100:00100000:1.0:1762167012.254946:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56224:x1847765452013952:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.254967:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.254985:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c0b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4180 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.255074:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0bc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.255089:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.255101:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167012.255127:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000004:00200000:1.0:1762167012.255132:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167012.255146:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.255168:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c0b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4180 expref: 895 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.255182:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4180 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.255193:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.255196:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167012.255199:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37299e400, rc 0) 00000100:00100000:1.0:1762167012.255234:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56224:x1847765452013952:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 292us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.255240:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20071 00000100:00100000:2.0:1762167012.258720:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.258925:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452014208 00000100:00100000:1.0:1762167012.258935:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452014208 00000100:00100000:1.0:1762167012.258990:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20072 00000100:00100000:1.0:1762167012.259000:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56224:x1847765452014208:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167012.259049:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167012.259075:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0bc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4180 expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.259094:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.259099:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167012.259330:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.259343:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.259381:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167012.259439:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953162 00000004:00010000:1.0:1762167012.259479:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000040889cd8 reply state 000000000b5a7961 transno 8589953163 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.259493:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167012.259591:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56224:x1847765452014208:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 591us (880us total) trans 8589953163 rc 0/0 00000100:00100000:1.0:1762167012.259599:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20072 00000020:00080000:1.0:1762167012.259605:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167012.261108:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.261201:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.261211:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.261218:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167012.261222:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.261230:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.261245:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.261248:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167012.261252:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.261257:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0c3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167012.261274:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.261343:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452014336 00000100:00100000:0.0:1762167012.261363:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452014336 00000100:00100000:0.0:1762167012.261416:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17490 00000100:00100000:0.0:1762167012.261426:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:56224:x1847765452014336:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167012.261441:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.261466:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c0ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4187 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167012.261491:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 262144, mtime: 0x690888e4, atime: 0x690888db, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:0.0:1762167012.261510:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.261512:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.261519:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c0ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4187 expref: 18 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.261534:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c0ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4187 expref: 18 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.261549:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c000, rc 0) 00000100:00100000:0.0:1762167012.261601:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:56224:x1847765452014336:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 176us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.261608:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17490 00000100:00100000:2.0:1762167012.265130:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.265176:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.265223:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452014464 00000100:00100000:3.0:1762167012.265232:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452014464 00002000:00010000:3.0:1762167012.265270:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (152547->18446744073709551615) 00002000:00100000:3.0:1762167012.265275:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98000 with x1847765452014464 ext(152547->18446744073709551615) 00002000:00010000:3.0:1762167012.265287:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa98000. 00000100:00100000:3.0:1762167012.265312:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452014592 00000100:00100000:3.0:1762167012.265315:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452014592 00002000:00010000:3.0:1762167012.265328:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00002000:00100000:3.0:1762167012.265332:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa99500 with x1847765452014592 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167012.265338:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa99500. 00000100:00100000:2.0:1762167012.265344:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3234 00000100:00100000:2.0:1762167012.265368:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765452014464:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167012.265384:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3235 00000100:00100000:3.0:1762167012.265394:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765452014592:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:2.0:1762167012.265667:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 262144 -> 152547 00002000:00010000:3.0:1762167012.265668:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167012.265675:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:2.0:1762167012.265675:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.265681:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167012.265684:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.265686:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167012.265691:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167012.265694:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.265697:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167012.265795:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765452014592:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 366us (582us total) trans 17179876112 rc 0/0 00000100:00100000:2.0:1762167012.265801:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765452014464:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 398us (641us total) trans 21474843687 rc 0/0 00000100:00100000:3.0:1762167012.265809:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3235 00002000:00010000:3.0:1762167012.265815:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2071 (0->18446744073709551615) 00000100:00100000:2.0:1762167012.265818:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3234 00002000:00100000:3.0:1762167012.265820:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa99500 with x1847765452014592 ext(0->18446744073709551615) 00002000:00010000:2.0:1762167012.265824:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2068 (152547->18446744073709551615) 00002000:00010000:3.0:1762167012.265827:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa99500. 00002000:00100000:2.0:1762167012.265829:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98000 with x1847765452014464 ext(152547->18446744073709551615) 00002000:00010000:2.0:1762167012.265838:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa98000. 00000100:00100000:2.0:1762167012.269885:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.269964:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452014720 00000100:00100000:1.0:1762167012.269975:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452014720 00000100:00100000:1.0:1762167012.270034:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20073 00000100:00100000:1.0:1762167012.270045:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56224:x1847765452014720:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.270066:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.270087:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c0d1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb418e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.270171:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c0d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.270185:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.270197:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167012.270223:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000004:00200000:1.0:1762167012.270227:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167012.270243:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.270267:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c0d1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb418e expref: 897 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.270290:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb418e expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.270299:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.270302:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167012.270305:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c200, rc 0) 00000100:00100000:1.0:1762167012.270447:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56224:x1847765452014720:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 403us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.270455:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20073 00000100:00100000:0.0:1762167012.272902:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.272982:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452014976 00000100:00100000:1.0:1762167012.272991:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452014976 00000100:00100000:1.0:1762167012.273044:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20074 00000100:00100000:1.0:1762167012.273054:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56224:x1847765452014976:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167012.273109:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167012.273134:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c0d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb418e expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.273154:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.273159:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167012.273391:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.273405:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.273414:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167012.273463:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953164 00000004:00010000:1.0:1762167012.273489:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006f6eed6c reply state 00000000ca9efe98 transno 8589953165 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.273497:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167012.273713:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56224:x1847765452014976:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 659us (817us total) trans 8589953165 rc 0/0 00000100:00100000:1.0:1762167012.273721:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20074 00000020:00080000:1.0:1762167012.273732:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167012.274951:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.274969:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.274977:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.274982:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167012.274987:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.274994:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.275007:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:0.0:1762167012.275010:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167012.275014:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.275020:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c0df lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167012.275381:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.275430:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452015104 00000100:00100000:1.0:1762167012.275438:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452015104 00000100:00100000:1.0:1762167012.275489:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17491 00000100:00100000:1.0:1762167012.275499:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:56224:x1847765452015104:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.275514:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.275534:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4195 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167012.275568:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 262144, mtime: 0x690888e4, atime: 0x690888db, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:1.0:1762167012.275587:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.275590:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.275597:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4195 expref: 26 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.275611:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4195 expref: 26 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.275622:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37299e400, rc 0) 00000100:00100000:1.0:1762167012.275685:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56224:x1847765452015104:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 186us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.275692:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17491 00000100:00100000:2.0:1762167012.277969:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.278009:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.278052:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452015232 00000100:00100000:0.0:1762167012.278061:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452015232 00002000:00010000:0.0:1762167012.278098:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (152547->18446744073709551615) 00002000:00100000:0.0:1762167012.278103:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9a300 with x1847765452015232 ext(152547->18446744073709551615) 00002000:00010000:0.0:1762167012.278114:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa9a300. 00000100:00100000:0.0:1762167012.278143:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452015360 00000100:00100000:0.0:1762167012.278146:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452015360 00002000:00010000:0.0:1762167012.278158:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167012.278161:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa99f80 with x1847765452015360 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167012.278167:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa99f80. 00000100:00100000:3.0:1762167012.278203:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3236 00000100:00100000:0.0:1762167012.278216:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3237 00000100:00100000:0.0:1762167012.278229:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765452015360:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167012.278312:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765452015232:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167012.278551:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167012.278555:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167012.278558:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167012.278561:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.278564:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 262144 -> 152547 00002000:00010000:0.0:1762167012.278564:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167012.278571:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.278574:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:3.0:1762167012.278577:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.278580:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167012.278628:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765452015360:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 401us (616us total) trans 21474843688 rc 0/0 00000100:00100000:0.0:1762167012.278635:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3237 00002000:00010000:0.0:1762167012.278639:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2071 (0->18446744073709551615) 00002000:00100000:0.0:1762167012.278641:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa99f80 with x1847765452015360 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167012.278646:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa99f80. 00000100:00100000:3.0:1762167012.280125:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765452015232:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 1907us (2159us total) trans 17179876113 rc 0/0 00000100:00100000:3.0:1762167012.280136:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3236 00002000:00010000:3.0:1762167012.280141:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2074 (152547->18446744073709551615) 00002000:00100000:3.0:1762167012.280144:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9a300 with x1847765452015232 ext(152547->18446744073709551615) 00002000:00010000:3.0:1762167012.280151:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa9a300. 00000100:00100000:2.0:1762167012.282406:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.282498:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452015488 00000100:00100000:1.0:1762167012.282508:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452015488 00000100:00100000:1.0:1762167012.285469:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20075 00000100:00100000:1.0:1762167012.285494:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56224:x1847765452015488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.285519:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.285544:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c0ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb419c expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.285631:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c0f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.285646:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.285657:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167012.285682:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000004:00200000:1.0:1762167012.285686:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167012.285702:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.285725:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c0ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb419c expref: 899 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.285743:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb419c expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.285752:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.285755:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167012.285759:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228400, rc 0) 00000100:00100000:1.0:1762167012.285860:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56224:x1847765452015488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 377us (3462us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.285868:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20075 00000100:00100000:2.0:1762167012.288923:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.289619:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452015744 00000100:00100000:1.0:1762167012.289631:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452015744 00000100:00100000:1.0:1762167012.289700:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20076 00000100:00100000:1.0:1762167012.289711:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56224:x1847765452015744:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167012.289897:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167012.289924:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c0f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb419c expref: 898 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.289944:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.289949:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167012.290167:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.290181:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.290192:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167012.290243:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953166 00000004:00010000:1.0:1762167012.290270:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b75b7e9c reply state 00000000f18bdaa2 transno 8589953167 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.290278:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167012.290388:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56224:x1847765452015744:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 678us (1472us total) trans 8589953167 rc 0/0 00000100:00100000:1.0:1762167012.290396:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20076 00000020:00080000:1.0:1762167012.290401:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167012.292030:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167012.292031:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167012.292043:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.292051:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.292057:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480efc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167012.292062:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.292071:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.292085:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.292089:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762167012.292090:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452015872 00010000:00010000:1.0:1762167012.292093:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167012.292100:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452015872 00010000:00010000:1.0:1762167012.292101:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c0fb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167012.292162:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17492 00000100:00100000:0.0:1762167012.292173:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56224:x1847765452015872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167012.292189:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.292208:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0c102 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41a3 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167012.292232:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 262144, mtime: 0x690888e4, atime: 0x690888dd, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:0.0:1762167012.292253:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.292255:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.292263:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0c102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41a3 expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.292279:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0c102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41a3 expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.292290:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c200, rc 0) 00000100:00100000:0.0:1762167012.293364:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56224:x1847765452015872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1177us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.293430:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17492 00000100:00100000:2.0:1762167012.299009:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.299069:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.299070:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452016000 00000100:00100000:3.0:1762167012.299083:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452016000 00002000:00010000:3.0:1762167012.299124:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (152547->18446744073709551615) 00002000:00100000:3.0:1762167012.299130:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98e00 with x1847765452016000 ext(152547->18446744073709551615) 00002000:00010000:3.0:1762167012.299142:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa98e00. 00000100:00100000:0.0:1762167012.299150:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452016128 00000100:00100000:0.0:1762167012.299156:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452016128 00002000:00010000:0.0:1762167012.299177:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00000100:00100000:3.0:1762167012.299179:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3238 00002000:00100000:0.0:1762167012.299183:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9bb80 with x1847765452016128 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167012.299194:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa9bb80. 00000100:00100000:3.0:1762167012.299195:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452016000:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167012.299221:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3239 00000100:00100000:0.0:1762167012.299231:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452016128:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167012.299511:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167012.299516:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167012.299519:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167012.299522:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167012.299524:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167012.299535:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 262144 -> 152547 00002000:00010000:3.0:1762167012.299540:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.299543:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167012.299545:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.299547:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167012.299596:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2360:x1847765452016128:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 364us (524us total) trans 21474843689 rc 0/0 00000100:00100000:3.0:1762167012.299597:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452016000:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 405us (596us total) trans 17179876114 rc 0/0 00000100:00100000:0.0:1762167012.299613:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3239 00000100:00100000:3.0:1762167012.299708:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3238 00002000:00010000:3.0:1762167012.299712:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2076 (152547->18446744073709551615) 00002000:00100000:3.0:1762167012.299715:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98e00 with x1847765452016000 ext(152547->18446744073709551615) 00002000:00010000:3.0:1762167012.299720:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa98e00. 00002000:00010000:0.0:1762167012.299852:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2073 (0->18446744073709551615) 00002000:00100000:0.0:1762167012.299857:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9bb80 with x1847765452016128 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167012.299863:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa9bb80. 00000100:00100000:2.0:1762167012.306220:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.306406:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452016256 00000100:00100000:1.0:1762167012.306417:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452016256 00000100:00100000:1.0:1762167012.306480:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20077 00000100:00100000:1.0:1762167012.306491:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56224:x1847765452016256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.306514:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.306535:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c109 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41aa expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.306618:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c110 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.306632:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c110 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.306642:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c110 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167012.306668:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000004:00200000:1.0:1762167012.306672:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167012.306700:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c110 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.306730:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c109 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41aa expref: 901 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.306749:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c110 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41aa expref: 900 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.306759:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.306809:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167012.306813:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee348228400, rc 0) 00000100:00100000:1.0:1762167012.306887:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56224:x1847765452016256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 398us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.306894:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20077 00000100:00100000:2.0:1762167012.309392:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.309471:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452016512 00000100:00100000:1.0:1762167012.309480:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452016512 00000100:00100000:1.0:1762167012.309535:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20078 00000100:00100000:1.0:1762167012.309560:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56224:x1847765452016512:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167012.309610:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167012.309637:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee348228400/0xf915a5bdf3d0c110 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41aa expref: 900 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.309657:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.309661:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167012.309913:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.309928:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.309941:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:1.0:1762167012.309995:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953168 00000004:00010000:1.0:1762167012.310022:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008ee0fbf8 reply state 00000000c36478bb transno 8589953169 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.310031:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167012.310121:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56224:x1847765452016512:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 568us (739us total) trans 8589953169 rc 0/0 00000100:00100000:1.0:1762167012.310128:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20078 00000020:00080000:1.0:1762167012.310133:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167012.311678:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.311693:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.311701:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.311707:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372975000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167012.311711:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.311719:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.311734:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:0.0:1762167012.311737:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167012.311741:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.311747:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c117 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167012.311915:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.311980:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452016640 00000100:00100000:0.0:1762167012.311988:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452016640 00000100:00100000:0.0:1762167012.312038:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17493 00000100:00100000:0.0:1762167012.312049:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:56224:x1847765452016640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167012.312065:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.312086:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0c11e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41b1 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167012.312115:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 262144, mtime: 0x690888e4, atime: 0x690888dd, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:0.0:1762167012.312132:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.312134:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.312140:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0c11e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b1 expref: 22 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.312151:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0c11e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b1 expref: 22 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.312158:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ca00, rc 0) 00000100:00100000:0.0:1762167012.312298:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:56224:x1847765452016640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 247us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.312305:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17493 00000100:00100000:2.0:1762167012.313721:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.313757:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.313811:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452016768 00000100:00100000:0.0:1762167012.313819:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452016768 00000100:00100000:3.0:1762167012.313827:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452016896 00000100:00100000:3.0:1762167012.313833:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452016896 00002000:00010000:0.0:1762167012.313854:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (152547->18446744073709551615) 00002000:00010000:3.0:1762167012.313855:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:3.0:1762167012.313863:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98a80 with x1847765452016896 ext(0->18446744073709551615) 00002000:00100000:0.0:1762167012.313863:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa99880 with x1847765452016768 ext(152547->18446744073709551615) 00002000:00010000:3.0:1762167012.313877:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa98a80. 00002000:00010000:0.0:1762167012.313878:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa99880. 00000100:00100000:3.0:1762167012.313916:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3240 00000100:00100000:3.0:1762167012.313926:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765452016896:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167012.313930:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3241 00000100:00100000:0.0:1762167012.313943:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765452016768:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167012.314214:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167012.314218:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.314221:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:3.0:1762167012.314225:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167012.314225:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 262144 -> 152547 00002000:00010000:0.0:1762167012.314233:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.314234:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167012.314241:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167012.314244:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.314246:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167012.314308:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765452016896:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 381us (547us total) trans 17179876115 rc 0/0 00000100:00100000:3.0:1762167012.314318:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3240 00000100:00100000:0.0:1762167012.314319:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2360:x1847765452016768:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 365us (591us total) trans 21474843690 rc 0/0 00002000:00010000:3.0:1762167012.314322:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2077 (0->18446744073709551615) 00002000:00100000:3.0:1762167012.314327:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98a80 with x1847765452016896 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167012.314333:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa98a80. 00000100:00100000:0.0:1762167012.314337:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3241 00002000:00010000:0.0:1762167012.314355:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2074 (152547->18446744073709551615) 00002000:00100000:0.0:1762167012.314359:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa99880 with x1847765452016768 ext(152547->18446744073709551615) 00002000:00010000:0.0:1762167012.314364:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa99880. 00000100:00100000:2.0:1762167012.316329:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.316443:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452017024 00000100:00100000:1.0:1762167012.316452:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452017024 00000100:00100000:1.0:1762167012.316509:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20079 00000100:00100000:1.0:1762167012.316520:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:56224:x1847765452017024:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.316542:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.316560:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c125 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41b8 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.316656:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c12c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.316670:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c12c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.316689:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c12c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167012.316719:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000004:00200000:1.0:1762167012.316724:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167012.316740:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c12c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.316806:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c125 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b8 expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.316824:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c12c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b8 expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.316833:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.316836:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167012.316839:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37105c200, rc 0) 00000100:00100000:1.0:1762167012.316891:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56224:x1847765452017024:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 374us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.316896:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20079 00000100:00100000:1.0:1762167012.319047:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.319109:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452017280 00000100:00100000:2.0:1762167012.319117:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452017280 00000100:00100000:2.0:1762167012.319176:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20080 00000100:00100000:2.0:1762167012.319185:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:56224:x1847765452017280:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167012.319232:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.319256:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37105c200/0xf915a5bdf3d0c12c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b8 expref: 902 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.319273:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:2.0:1762167012.319277:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167012.319509:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167012.319522:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167012.319532:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167012.319583:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953170 00000004:00010000:2.0:1762167012.319611:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eaf241c4 reply state 000000001f1654a6 transno 8589953171 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167012.319620:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167012.319726:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56224:x1847765452017280:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 540us (685us total) trans 8589953171 rc 0/0 00000100:00100000:2.0:1762167012.319734:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20080 00000020:00080000:2.0:1762167012.319739:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167012.320534:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.320546:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.320552:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.320558:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167012.320562:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.320569:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.320585:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.320587:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167012.320591:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.320597:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c133 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.321003:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.321048:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452017408 00000100:00100000:0.0:1762167012.321055:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452017408 00000100:00100000:0.0:1762167012.321102:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17494 00000100:00100000:0.0:1762167012.321112:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:56224:x1847765452017408:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167012.321125:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.321146:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0c13a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41bf expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167012.321174:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 262144, mtime: 0x690888e4, atime: 0x690888de, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:0.0:1762167012.321192:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.321194:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.321202:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0c13a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41bf expref: 24 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.321216:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0c13a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41bf expref: 24 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.321226:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30c600, rc 0) 00000100:00100000:0.0:1762167012.321270:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:56224:x1847765452017408:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 159us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.321277:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17494 00000100:00100000:2.0:1762167012.322615:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.322656:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.322811:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452017536 00000100:00100000:0.0:1762167012.322819:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452017536 00002000:00010000:0.0:1762167012.322859:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (152547->18446744073709551615) 00002000:00100000:0.0:1762167012.322865:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732fb80 with x1847765452017536 ext(152547->18446744073709551615) 00002000:00010000:0.0:1762167012.322876:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732fb80. 00000100:00100000:3.0:1762167012.322907:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452017664 00000100:00100000:3.0:1762167012.322914:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452017664 00000100:00100000:0.0:1762167012.322917:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3242 00000100:00100000:0.0:1762167012.322929:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+24:2360:x1847765452017536:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167012.322934:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00100000:3.0:1762167012.322939:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732d880 with x1847765452017664 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167012.322946:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732d880. 00000100:00100000:3.0:1762167012.322971:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3243 00000100:00100000:3.0:1762167012.322979:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452017664:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:0.0:1762167012.323282:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 262144 -> 152547 00002000:00010000:0.0:1762167012.323286:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.323287:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167012.323290:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167012.323293:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167012.323295:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.323298:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167012.323300:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:3.0:1762167012.323303:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.323307:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.323456:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452017664:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 477us (799us total) trans 17179876116 rc 0/0 00000100:00100000:3.0:1762167012.323462:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3243 00002000:00010000:3.0:1762167012.323465:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2079 (0->18446744073709551615) 00002000:00100000:3.0:1762167012.323467:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732d880 with x1847765452017664 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167012.323471:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732d880. 00000100:00100000:0.0:1762167012.324162:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765452017536:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 1232us (1550us total) trans 21474843691 rc 0/0 00000100:00100000:0.0:1762167012.324173:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3242 00002000:00010000:0.0:1762167012.324178:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2076 (152547->18446744073709551615) 00002000:00100000:0.0:1762167012.324181:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732fb80 with x1847765452017536 ext(152547->18446744073709551615) 00002000:00010000:0.0:1762167012.324187:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732fb80. 00000100:00100000:2.0:1762167012.325754:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.325882:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452017792 00000100:00100000:1.0:1762167012.325897:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452017792 00000100:00100000:1.0:1762167012.325969:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20081 00000100:00100000:1.0:1762167012.325979:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:56224:x1847765452017792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.326009:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.326030:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c141 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41c6 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.326126:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3d0c148 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.326145:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3d0c148 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.326156:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3d0c148 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167012.326183:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000004:00200000:1.0:1762167012.326187:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167012.326202:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3d0c148 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.326228:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c141 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41c6 expref: 905 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.326244:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3d0c148 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41c6 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.326253:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.326256:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167012.326259:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36dc15c00, rc 0) 00000100:00100000:1.0:1762167012.326324:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56224:x1847765452017792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 346us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.326331:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20081 00000100:00100000:1.0:1762167012.328398:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.328477:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452018048 00000100:00100000:2.0:1762167012.328485:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452018048 00000100:00100000:2.0:1762167012.328537:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20082 00000100:00100000:2.0:1762167012.328558:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:56224:x1847765452018048:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167012.328610:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.328635:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36dc15c00/0xf915a5bdf3d0c148 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41c6 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.328667:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:2.0:1762167012.328674:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167012.328929:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167012.328943:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167012.328952:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167012.329004:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953172 00000004:00010000:2.0:1762167012.329029:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008168f323 reply state 000000007a5aa392 transno 8589953173 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167012.329038:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167012.329112:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56224:x1847765452018048:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 556us (720us total) trans 8589953173 rc 0/0 00000100:00100000:2.0:1762167012.329120:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20082 00000020:00080000:2.0:1762167012.329125:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167012.330153:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.330166:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.330176:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.330183:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1da00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167012.330187:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.330194:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.330206:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:0.0:1762167012.330209:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167012.330213:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.330219:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1da00/0xf915a5bdf3d0c14f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.330459:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.330517:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452018176 00000100:00100000:0.0:1762167012.330522:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452018176 00000100:00100000:0.0:1762167012.330574:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17495 00000100:00100000:0.0:1762167012.330583:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:56224:x1847765452018176:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167012.330598:0:12400:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.330615:0:12400:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0c156 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41cd expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167012.330638:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 262144, mtime: 0x690888e4, atime: 0x690888de, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:0.0:1762167012.330657:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.330660:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.330667:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0c156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41cd expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.330682:0:12400:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0c156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41cd expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.330699:0:12400:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30ce00, rc 0) 00000100:00100000:0.0:1762167012.330757:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:56224:x1847765452018176:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 174us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.330790:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17495 00000100:00100000:2.0:1762167012.332165:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.332207:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.332251:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452018304 00000100:00100000:3.0:1762167012.332260:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452018304 00000100:00100000:0.0:1762167012.332269:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452018432 00000100:00100000:0.0:1762167012.332276:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452018432 00002000:00010000:3.0:1762167012.332295:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (152547->18446744073709551615) 00002000:00010000:0.0:1762167012.332296:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00100000:3.0:1762167012.332304:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732f800 with x1847765452018304 ext(152547->18446744073709551615) 00002000:00100000:0.0:1762167012.332304:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732e300 with x1847765452018432 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167012.332319:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732f800. 00002000:00010000:0.0:1762167012.332329:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732e300. 00000100:00100000:3.0:1762167012.332359:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3244 00000100:00100000:3.0:1762167012.332379:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452018304:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:0.0:1762167012.332492:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3245 00000100:00100000:0.0:1762167012.332503:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2360:x1847765452018432:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167012.332702:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 262144 -> 152547 00002000:00010000:3.0:1762167012.332707:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.332707:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167012.332715:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167012.332715:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:0.0:1762167012.332721:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167012.332723:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.332727:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.332728:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1762167012.332733:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.332811:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452018304:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 433us (650us total) trans 17179876117 rc 0/0 00000100:00100000:0.0:1762167012.332812:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2360:x1847765452018432:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 309us (602us total) trans 21474843692 rc 0/0 00000100:00100000:3.0:1762167012.332824:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3244 00002000:00010000:3.0:1762167012.332828:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2080 (152547->18446744073709551615) 00002000:00100000:3.0:1762167012.332831:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732f800 with x1847765452018304 ext(152547->18446744073709551615) 00002000:00010000:3.0:1762167012.332836:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732f800. 00000100:00100000:0.0:1762167012.333391:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3245 00002000:00010000:0.0:1762167012.333394:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2077 (0->18446744073709551615) 00002000:00100000:0.0:1762167012.333396:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732e300 with x1847765452018432 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167012.333401:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732e300. 00000100:00100000:2.0:1762167012.335969:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.336019:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452018560 00000100:00100000:1.0:1762167012.336028:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452018560 00000100:00100000:1.0:1762167012.336085:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20083 00000100:00100000:1.0:1762167012.336101:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:56224:x1847765452018560:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.336124:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.336143:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c15d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41d4 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.336233:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c164 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.336247:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.336267:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167012.336294:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000004:00200000:1.0:1762167012.336298:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167012.336314:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.336339:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c15d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41d4 expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.336369:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c164 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41d4 expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.336379:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.336382:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167012.336385:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee349126a00, rc 0) 00000100:00100000:1.0:1762167012.336445:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56224:x1847765452018560:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 350us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.336452:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20083 00000100:00100000:1.0:1762167012.338452:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.338570:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452018816 00000100:00100000:2.0:1762167012.338578:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452018816 00000100:00100000:2.0:1762167012.338630:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20084 00000100:00100000:2.0:1762167012.338641:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:56224:x1847765452018816:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:2.0:1762167012.338688:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.338710:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c164 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41d4 expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.338724:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:2.0:1762167012.338727:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167012.338972:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167012.338986:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167012.338993:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000001:00080000:2.0:1762167012.339045:0:30817:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953174 00000004:00010000:2.0:1762167012.339069:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000688cf81e reply state 00000000a88f58c2 transno 8589953175 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167012.339077:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762167012.339196:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56224:x1847765452018816:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 556us (749us total) trans 8589953175 rc 0/0 00000100:00100000:2.0:1762167012.339203:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20084 00000020:00080000:2.0:1762167012.339208:0:30817:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762167012.340132:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.340143:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.340150:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.340155:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167012.340160:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.340167:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.340179:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.340181:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167012.340185:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.340191:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c16b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.340452:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.340649:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452018944 00000100:00100000:0.0:1762167012.340656:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452018944 00000100:00100000:0.0:1762167012.340807:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17496 00000100:00100000:0.0:1762167012.340816:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56224:x1847765452018944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167012.340830:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.340848:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c172 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41db expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167012.340871:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 262144, mtime: 0x690888e4, atime: 0x690888e0, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:0.0:1762167012.340889:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.340891:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.340898:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c172 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41db expref: 27 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.340914:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c172 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41db expref: 27 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.340924:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30cc00, rc 0) 00000100:00100000:0.0:1762167012.340981:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56224:x1847765452018944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 165us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.340988:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17496 00000100:00100000:2.0:1762167012.343800:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.343851:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.343917:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019072 00000100:00100000:3.0:1762167012.343927:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019072 00002000:00010000:3.0:1762167012.343965:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (152547->18446744073709551615) 00002000:00100000:3.0:1762167012.343970:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732dc00 with x1847765452019072 ext(152547->18446744073709551615) 00002000:00010000:3.0:1762167012.343981:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732dc00. 00000100:00100000:3.0:1762167012.344011:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019200 00000100:00100000:3.0:1762167012.344015:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019200 00002000:00010000:3.0:1762167012.344030:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00100000:3.0:1762167012.344035:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732e680 with x1847765452019200 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167012.344041:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732e680. 00000100:00100000:0.0:1762167012.344046:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3246 00000100:00100000:0.0:1762167012.344060:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765452019072:12345-192.168.203.35@tcp:10:lfs.0 00000100:00100000:3.0:1762167012.344151:0:21530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3247 00000100:00100000:3.0:1762167012.344161:0:21530:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452019200:12345-192.168.203.35@tcp:10:lfs.0 00002000:00010000:3.0:1762167012.344436:0:21530:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167012.344440:0:21530:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.344443:0:21530:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167012.344446:0:21530:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167011 -> 1762167012 00002000:00010000:3.0:1762167012.344448:0:21530:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167012.344457:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 262144 -> 152547 00002000:00010000:0.0:1762167012.344462:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.344464:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:0.0:1762167012.344466:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.344469:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167012.344554:0:21530:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765452019200:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 394us (701us total) trans 17179876118 rc 0/0 00000100:00100000:3.0:1762167012.344562:0:21530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3247 00002000:00010000:3.0:1762167012.344566:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2081 (0->18446744073709551615) 00002000:00100000:3.0:1762167012.344569:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732e680 with x1847765452019200 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167012.344574:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee24732e680. 00000100:00100000:0.0:1762167012.344632:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452019072:12345-192.168.203.35@tcp:10:lfs.0 Request processed in 573us (873us total) trans 21474843693 rc 0/0 00000100:00100000:0.0:1762167012.344640:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3246 00002000:00010000:0.0:1762167012.344644:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2078 (152547->18446744073709551615) 00002000:00100000:0.0:1762167012.344646:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732dc00 with x1847765452019072 ext(152547->18446744073709551615) 00002000:00010000:0.0:1762167012.344652:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732dc00. 00000100:00100000:2.0:1762167012.346358:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.346410:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019456 00000100:00100000:1.0:1762167012.346418:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019456 00000100:00100000:1.0:1762167012.346469:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20085 00000100:00100000:1.0:1762167012.346480:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:56224:x1847765452019456:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167012.346577:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.346594:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167012.346606:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:1.0:1762167012.346715:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000270f0a8e reply state 0000000017fb2bda transno 8589953176 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167012.346721:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167012.346822:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:56224:x1847765452019456:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 346us (481us total) trans 8589953176 rc 0/0 00000100:00100000:1.0:1762167012.346828:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20085 00010000:00010000:0.0:1762167012.347842:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.347855:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.347862:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.347869:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee349126a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167012.347873:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.347881:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.347896:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:0.0:1762167012.347899:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167012.347903:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167012.347908:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c179 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:2.0:1762167012.348152:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.348218:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019584 00000100:00100000:0.0:1762167012.348226:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019584 00000100:00100000:0.0:1762167012.348277:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17497 00000100:00100000:0.0:1762167012.348287:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56224:x1847765452019584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167012.348302:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.348330:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41e2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.348368:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c053 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4164 expref: 29 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167012.348378:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.348380:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.348384:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.348418:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4164 expref: 29 pid: 33894 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167012.348431:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c053 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4164 expref: 29 pid: 33894 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1762167012.348445:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454544640:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167012.348530:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167012.349893:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454544640:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167012.349921:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.349938:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30da00, rc 0) 00000100:00100000:0.0:1762167012.349988:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:56224:x1847765452019584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1702us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.349997:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17497 00000100:00100000:2.0:1762167012.350528:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.350662:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019712 00000100:00100000:1.0:1762167012.350669:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019712 00010000:00010000:1.0:1762167012.350693:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c053 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4164 expref: 29 pid: 33894 timeout: 733 lvb_type: 1 00000100:00100000:1.0:1762167012.350720:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7661 00000100:00100000:1.0:1762167012.350728:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452019712:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167012.350742:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167012.350789:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c053 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4164 expref: 29 pid: 33894 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1762167012.350803:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4164 expref: 29 pid: 33894 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1762167012.350826:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c053 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4164 expref: 29 pid: 33894 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1762167012.350840:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.350842:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167012.350849:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.350860:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.350893:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.350908:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24518ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454544768:192.168.203.35@tcp:105: 00000100:00100000:1.0:1762167012.350975:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37fc1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1762167012.352664:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24518ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454544768:192.168.203.35@tcp:105: 00000100:00100000:2.0:1762167012.352672:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167012.352687:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167012.352739:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452019712:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2010us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.352739:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019840 00000100:00100000:0.0:1762167012.352745:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019840 00000100:00100000:1.0:1762167012.352749:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7661 00000100:00100000:0.0:1762167012.352814:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17498 00000100:00100000:0.0:1762167012.352822:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:56224:x1847765452019840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167012.352852:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.352869:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41e9 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.352897:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0c061 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb416b expref: 35 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167012.352906:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.352908:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.352912:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 35 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.352942:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0c061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb416b expref: 35 pid: 12400 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167012.352955:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0c061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb416b expref: 35 pid: 12400 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1762167012.352970:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6535:1847765454544896:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167012.353030:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167012.354162:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6535:1847765454544896:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167012.354186:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 35 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.354200:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d800, rc 0) 00000100:00100000:0.0:1762167012.354249:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:56224:x1847765452019840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1427us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.354258:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17498 00000100:00100000:1.0:1762167012.354917:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.354978:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452019968 00000100:00100000:3.0:1762167012.354984:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452019968 00010000:00010000:3.0:1762167012.355012:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0c061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb416b expref: 35 pid: 12400 timeout: 733 lvb_type: 1 00000100:00100000:3.0:1762167012.355049:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7662 00000100:00100000:3.0:1762167012.355057:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765452019968:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167012.355070:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167012.355091:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0c061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb416b expref: 35 pid: 12400 timeout: 733 lvb_type: 1 00010000:00010000:3.0:1762167012.355109:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0c061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb416b expref: 35 pid: 12400 timeout: 733 lvb_type: 1 00010000:00010000:3.0:1762167012.355131:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c400/0xf915a5bdf3d0c061 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb416b expref: 35 pid: 12400 timeout: 733 lvb_type: 1 00010000:00010000:3.0:1762167012.355149:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.355151:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.355158:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 34 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.355169:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 34 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.355198:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 34 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.355216:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765454545024:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167012.355271:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:2.0:1762167012.356920:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.356971:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7415:1847765454545024:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167012.356998:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167012.357024:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020096 00000100:00100000:0.0:1762167012.357033:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020096 00000100:00100000:3.0:1762167012.357052:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765452019968:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 1995us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167012.357064:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7662 00000100:00100000:0.0:1762167012.357092:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17499 00000100:00100000:0.0:1762167012.357101:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:56224:x1847765452020096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167012.357114:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.357128:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41f0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.357150:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c05a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4172 expref: 29 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167012.357155:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.357157:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.357159:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.357180:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4172 expref: 29 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167012.357192:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c05a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4172 expref: 29 pid: 26444 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1762167012.357201:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454545152:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167012.357246:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:2.0:1762167012.358886:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.358982:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454545152:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167012.359004:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.359007:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020224 00000100:00100000:3.0:1762167012.359015:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020224 00010000:00010000:0.0:1762167012.359021:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e30d200, rc 0) 00010000:00010000:3.0:1762167012.359044:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c05a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4172 expref: 30 pid: 26444 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1762167012.359065:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:56224:x1847765452020096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1964us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.359073:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17499 00000100:00100000:3.0:1762167012.359136:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7663 00000100:00100000:3.0:1762167012.359148:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452020224:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167012.359160:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167012.359180:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c05a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4172 expref: 29 pid: 26444 timeout: 733 lvb_type: 1 00010000:00010000:3.0:1762167012.359192:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4172 expref: 29 pid: 26444 timeout: 733 lvb_type: 1 00010000:00010000:3.0:1762167012.359213:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c05a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4172 expref: 29 pid: 26444 timeout: 733 lvb_type: 1 00010000:00010000:3.0:1762167012.359226:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.359228:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167012.359284:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.359297:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.359326:0:7415:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.359357:0:7415:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454545280:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167012.359416:0:7415:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720600 going to sleep for 11 seconds 00000100:00100000:3.0:1762167012.361644:0:7415:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348255c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7415:1847765454545280:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167012.361667:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167012.361720:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452020224:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 2573us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.361731:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.361734:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7663 00000100:00100000:2.0:1762167012.361858:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020480 00000100:00100000:2.0:1762167012.361865:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020480 00000100:00100000:0.0:1762167012.361885:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.361921:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020352 00000100:00100000:2.0:1762167012.361935:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020352 00000100:00100000:0.0:1762167012.361935:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.361966:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020608 00000100:00100000:2.0:1762167012.361970:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020608 00000100:00100000:1.0:1762167012.361977:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17500 00000100:00100000:0.0:1762167012.361985:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17501 00000100:00100000:1.0:1762167012.361991:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765452020480:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167012.361998:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17502 00000100:00100000:0.0:1762167012.362000:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452020352:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:3.0:1762167012.362006:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452020608:12345-192.168.203.35@tcp:2:lfs.0 00002000:00010000:2.0:1762167012.362222:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167012.362226:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.362226:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167012.362226:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 152547 -> 152547 00002000:00010000:2.0:1762167012.362233:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167012.362233:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.362235:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.362240:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.362240:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.362241:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167012.362248:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167012.362248:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.362248:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.362255:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 309 -> 243 00002000:00010000:1.0:1762167012.362256:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167012.362287:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452020608:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 281us (362us total) trans 21474843694 rc 0/0 00000100:00100000:0.0:1762167012.362290:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452020352:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 292us (404us total) trans 21474843695 rc 0/0 00000100:00100000:1.0:1762167012.362294:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765452020480:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 305us (562us total) trans 17179876119 rc 0/0 00000100:00100000:2.0:1762167012.362301:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17502 00000100:00100000:0.0:1762167012.362311:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17501 00000100:00100000:1.0:1762167012.362321:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17500 00000100:00100000:1.0:1762167012.363650:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.363737:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020864 00000100:00100000:2.0:1762167012.363745:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020864 00000100:00100000:2.0:1762167012.363823:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7392 00000100:00100000:2.0:1762167012.363832:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:56224:x1847765452020864:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167012.363887:0:33886:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x619:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c014 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb414f expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.363930:0:33886:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167012.363943:0:33886:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c03e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4156 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.363952:0:33886:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:2.0:1762167012.363986:0:33886:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c03e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4156 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.364000:0:33886:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c03e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4156 expref: 908 pid: 30817 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.364014:0:33886:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454545408:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167012.364084:0:33886:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762167012.365313:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.365314:0:33886:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:33886:1847765454545408:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167012.365340:0:33886:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000100:00100000:1.0:1762167012.365418:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452020992 00000100:00100000:1.0:1762167012.365425:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452020992 00010000:00010000:1.0:1762167012.365455:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c03e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4156 expref: 909 pid: 30817 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1762167012.365494:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7664 00000100:00100000:1.0:1762167012.365503:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:2360:x1847765452020992:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167012.365516:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167012.365522:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c03e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4156 expref: 909 pid: 30817 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1762167012.365534:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c03e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4156 expref: 909 pid: 30817 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1762167012.365552:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c03e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4156 expref: 909 pid: 30817 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1762167012.365567:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.365572:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167012.365580:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167012.365587:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167012.365620:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167012.365669:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2360:x1847765452020992:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 166us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.365678:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7664 00010000:00010000:0.0:1762167012.365691:0:33886:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00010000:00010000:0.0:1762167012.365700:0:33886:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000040:00080000:0.0:1762167012.366231:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5656, 88 off457952 00000004:00080000:0.0:1762167012.366245:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633158481984ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.366300:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5665, 88 off459104 00000004:00080000:0.0:1762167012.366305:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633158542260ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.366339:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5666, 88 off459192 00000004:00080000:0.0:1762167012.366344:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633158580792ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.366371:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5657, 88 off458040 00000004:00080000:0.0:1762167012.366375:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633158612620ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.366431:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5667, 88 off459280 00000004:00080000:0.0:1762167012.366435:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633158672508ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.366465:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5658, 88 off458128 00000004:00080000:0.0:1762167012.366469:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633158706024ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.366495:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5659, 88 off458216 00000004:00080000:0.0:1762167012.366498:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633158735419ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.366516:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5668, 88 off459368 00000004:00080000:0.0:1762167012.366521:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633158758429ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.366545:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5669, 88 off459456 00000004:00080000:0.0:1762167012.366549:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633158785878ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.366568:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5660, 88 off458304 00000004:00080000:0.0:1762167012.366571:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633158808707ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.366599:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5670, 88 off459544 00000004:00080000:0.0:1762167012.366602:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633158839868ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.366615:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5661, 88 off458392 00000004:00080000:0.0:1762167012.366618:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633158855777ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.366631:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5662, 88 off458480 00000004:00080000:0.0:1762167012.366634:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633158871138ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.366646:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5671, 88 off459632 00000004:00080000:0.0:1762167012.366649:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633158886302ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.366661:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5663, 88 off458568 00000004:00080000:0.0:1762167012.366664:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633158901879ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.366679:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5672, 88 off459720 00000004:00080000:0.0:1762167012.366682:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633158919213ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.366702:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5673, 88 off459808 00000004:00080000:0.0:1762167012.366706:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633158943138ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.366725:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5664, 88 off458656 00000004:00080000:0.0:1762167012.366729:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633158966022ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.366801:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5666, 88 off458840 00000004:00080000:0.0:1762167012.366807:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633159043703ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.366828:0:33886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5674, 88 off459896 00000004:00080000:0.0:1762167012.366831:0:33886:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633159068265ns, next at 630703976179ns, rc = 0 00000001:00080000:2.0:1762167012.382252:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953177 is committed 00000004:00080000:2.0:1762167012.382267:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3784 committed 00000004:00010000:3.0:1762167012.382276:0:33886:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000091d4c5fe reply state 00000000a06dc5a3 transno 8589953177 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33886 initiator: MDT0 00000004:00080000:2.0:1762167012.382286:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3771 committed 00000100:00100000:3.0:1762167012.382292:0:33886:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:2.0:1762167012.382299:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3770 committed 00010000:00010000:3.0:1762167012.382304:0:33886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00000004:00080000:2.0:1762167012.382304:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3783 committed 00000004:00080000:2.0:1762167012.382310:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3782 committed 00010000:00010000:3.0:1762167012.382311:0:33886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:2.0:1762167012.382315:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3769 committed 00000004:00080000:2.0:1762167012.382318:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3781 committed 00000004:00080000:2.0:1762167012.382323:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3768 committed 00010000:00010000:3.0:1762167012.382324:0:33886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c014 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb414f expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762167012.382328:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3767 committed 00000004:00080000:2.0:1762167012.382334:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3780 committed 00000004:00080000:2.0:1762167012.382355:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3766 committed 00000004:00080000:2.0:1762167012.382359:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3779 committed 00000004:00080000:2.0:1762167012.382361:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3778 committed 00000004:00080000:2.0:1762167012.382363:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3765 committed 00000004:00080000:2.0:1762167012.382365:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3764 committed 00000004:00080000:2.0:1762167012.382373:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3777 committed 00000004:00080000:2.0:1762167012.382376:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3763 committed 00000004:00080000:2.0:1762167012.382379:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3776 committed 00000004:00080000:2.0:1762167012.382383:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3775 committed 00000004:00080000:2.0:1762167012.382387:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3762 committed 00010000:00080000:3.0:1762167012.382474:0:33886:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762167012.382480:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454545536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167012.382494:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56224:x1847765452020864:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 18660us (18848us total) trans 8589953177 rc 0/0 00000100:00100000:3.0:1762167012.382507:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7392 00000100:00100000:1.0:1762167012.382551:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.382599:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454546048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.382605:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454545920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.382634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.382653:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454545664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.382692:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454546560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.382698:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454545536 00000100:00100000:0.0:1762167012.382700:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.382707:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454545536 00000100:00100000:1.0:1762167012.382738:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.382789:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454546048 00000100:00100000:1.0:1762167012.382793:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454547072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.382795:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454546048 00000100:00100000:3.0:1762167012.382813:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762167012.382837:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33886 initiator: MDT0 00010000:00010000:1.0:1762167012.382846:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167012.382850:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454545664 00000100:00100000:0.0:1762167012.382851:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454546176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.382857:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454545664 00010000:00010000:1.0:1762167012.382858:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167012.382859:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454546432:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1762167012.382874:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167012.382880:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167012.382885:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454546560 00010000:00010000:1.0:1762167012.382889:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167012.382891:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454546560 00000100:00100000:0.0:1762167012.382904:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762167012.382909:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23b00) 00010000:00010000:1.0:1762167012.382913:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167012.382917:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00000100:00100000:2.0:1762167012.382920:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454545920 00010000:00010000:1.0:1762167012.382925:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c195 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33886 initiator: MDT0 00000100:00100000:3.0:1762167012.382929:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454546176 00000100:00100000:2.0:1762167012.382929:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454545920 00000100:00100000:3.0:1762167012.382940:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454546176 00000100:00100000:0.0:1762167012.382940:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454546688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.382956:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17503 00000100:00100000:1.0:1762167012.382971:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17504 00000100:00100000:2.0:1762167012.382972:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454545536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.382977:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167012.382985:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17505 00000100:00100000:1.0:1762167012.382987:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3296:x1847765454546048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.382996:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454547200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.382998:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454545664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.383023:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.383039:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1762167012.383047:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454545792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167012.383070:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.383079:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454546304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.383105:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.383116:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee243305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454546816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.383137:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.383148:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454547328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167012.383168:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167012.383227:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.383231:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.383234:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167012.383237:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.383240:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167012.383243:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167012.383248:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167012.383252:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167012.383255:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:3.0:1762167012.383258:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167012.383258:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167012.383265:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.383269:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167012.383272:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.383275:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167012.383278:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454546048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 294us (642us total) trans 17179876120 rc 0/0 00000100:00100000:1.0:1762167012.383288:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17504 00000100:00100000:1.0:1762167012.383305:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454546688 00000100:00100000:1.0:1762167012.383309:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454546688 00000100:00100000:1.0:1762167012.383324:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454547200 00000100:00100000:1.0:1762167012.383327:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454547200 00000100:00100000:1.0:1762167012.383340:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454545792 00000100:00100000:1.0:1762167012.383354:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454545792 00000100:00100000:2.0:1762167012.383357:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454545536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 378us (793us total) trans 17179876121 rc 0/0 00000100:00100000:0.0:1762167012.383360:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454546304 00000100:00100000:0.0:1762167012.383367:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454546304 00000100:00100000:2.0:1762167012.383371:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17503 00000100:00100000:3.0:1762167012.383372:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454545664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 375us (673us total) trans 17179876122 rc 0/0 00000100:00100000:1.0:1762167012.383385:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454546816 00000100:00100000:3.0:1762167012.383387:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17505 00000100:00100000:2.0:1762167012.383391:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454547328 00000100:00100000:1.0:1762167012.383391:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454546816 00000100:00100000:2.0:1762167012.383397:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454547328 00000100:00100000:0.0:1762167012.383407:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17506 00000100:00100000:3.0:1762167012.383416:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17507 00000100:00100000:0.0:1762167012.383421:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2443ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3296:x1847765454546560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.383427:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17508 00000100:00100000:3.0:1762167012.383431:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1847765454545920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.383438:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17509 00000100:00100000:1.0:1762167012.383442:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454546176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.383450:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3293:x1847765454546688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167012.383585:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb size from disk: 152547 -> 152547 00002000:00010000:0.0:1762167012.383589:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.383592:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167012.383595:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.383597:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:3.0:1762167012.383601:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb size from disk: 152547 -> 152547 00002000:00010000:3.0:1762167012.383605:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.383608:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167012.383611:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.383614:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1762167012.383620:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb size from disk: 152547 -> 152547 00002000:00010000:2.0:1762167012.383625:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.383628:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167012.383631:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.383634:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x814:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167012.383637:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2443ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454546560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (897us total) trans 17179876123 rc 0/0 00000100:00100000:0.0:1762167012.383646:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17506 00002000:00010000:1.0:1762167012.383648:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.383652:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.383655:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.383658:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.383660:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167012.383665:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17510 00000100:00100000:0.0:1762167012.383674:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454547200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.383709:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454545920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 282us (896us total) trans 17179876124 rc 0/0 00000100:00100000:3.0:1762167012.383718:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17507 00000100:00100000:2.0:1762167012.383730:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454546688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 281us (756us total) trans 21474843696 rc 0/0 00000100:00100000:1.0:1762167012.383738:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454546176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 299us (834us total) trans 21474843697 rc 0/0 00000100:00100000:3.0:1762167012.383739:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17511 00000100:00100000:2.0:1762167012.383749:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17509 00000100:00100000:3.0:1762167012.383754:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3293:x1847765454545792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.383759:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17508 00000100:00100000:2.0:1762167012.383797:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17512 00002000:00010000:0.0:1762167012.383802:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167012.383807:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00000100:00100000:1.0:1762167012.383808:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17513 00000100:00100000:2.0:1762167012.383810:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454546304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167012.383813:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167012.383819:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.383824:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167012.383825:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454546816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.383859:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454547200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (834us total) trans 21474843698 rc 0/0 00000100:00100000:0.0:1762167012.383867:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17510 00002000:00010000:3.0:1762167012.383918:0:6533:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 152547 -> 152547 00002000:00010000:3.0:1762167012.383923:0:6533:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.383925:0:6533:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167012.383928:0:6533:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.383930:0:6533:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 243 -> 243 00002000:00010000:2.0:1762167012.383961:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb size from disk: 152547 -> 152547 00002000:00010000:2.0:1762167012.383966:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00000100:00100000:3.0:1762167012.383968:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454545792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (895us total) trans 21474843699 rc 0/0 00002000:00010000:2.0:1762167012.383971:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00000100:00100000:0.0:1762167012.383974:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17514 00002000:00010000:1.0:1762167012.383978:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167012.383979:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00000100:00100000:3.0:1762167012.383985:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17511 00002000:00010000:1.0:1762167012.383986:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.383987:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167012.383988:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454547328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167012.383994:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167012.383998:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.384000:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167012.384030:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454546304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (925us total) trans 17179876125 rc 0/0 00000100:00100000:2.0:1762167012.384038:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17512 00000100:00100000:1.0:1762167012.384043:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3293:x1847765454546816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (902us total) trans 17179876126 rc 0/0 00000100:00100000:1.0:1762167012.384052:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17513 00002000:00010000:0.0:1762167012.384092:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb size from disk: 152547 -> 152547 00000100:00100000:1.0:1762167012.384097:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762167012.384098:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.384103:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:0.0:1762167012.384105:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.384107:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1762167012.384130:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454547072 00000100:00100000:2.0:1762167012.384135:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454547072 00000100:00100000:1.0:1762167012.384149:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876106 gen 2 00000100:00100000:0.0:1762167012.384152:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454547328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (982us total) trans 21474843700 rc 0/0 00000004:00080000:1.0:1762167012.384157:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccdf80, transno 17179876076 00000100:00100000:0.0:1762167012.384163:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17514 00000100:00100000:2.0:1762167012.384169:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17515 00000004:00080000:1.0:1762167012.384173:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03b80, transno 17179876077 00000004:00080000:1.0:1762167012.384180:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccca80, transno 17179876078 00000100:00100000:2.0:1762167012.384181:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3296:x1847765454547072:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167012.384186:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccfb80, transno 17179876079 00000004:00080000:1.0:1762167012.384192:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fccd180, transno 17179876080 00000004:00080000:1.0:1762167012.384196:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb10380, transno 17179876081 00000004:00080000:1.0:1762167012.384199:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03100, transno 17179876082 00000004:00080000:1.0:1762167012.384203:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243181180, transno 17179876083 00000004:00080000:1.0:1762167012.384207:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fc28380, transno 17179876084 00000004:00080000:1.0:1762167012.384210:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36de03480, transno 17179876085 00000100:00100000:0.0:1762167012.384213:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167012.384215:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c0700, transno 17179876086 00000004:00080000:1.0:1762167012.384222:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c1500, transno 17179876087 00000004:00080000:1.0:1762167012.384227:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c0a80, transno 17179876088 00000004:00080000:1.0:1762167012.384231:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee359065500, transno 17179876089 00000004:00080000:1.0:1762167012.384235:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c3480, transno 17179876090 00000004:00080000:1.0:1762167012.384239:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c0e00, transno 17179876091 00000004:00080000:1.0:1762167012.384242:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c2680, transno 17179876092 00000004:00080000:1.0:1762167012.384245:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee359065f80, transno 17179876093 00000004:00080000:1.0:1762167012.384248:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c1c00, transno 17179876094 00000004:00080000:1.0:1762167012.384252:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f8c2300, transno 17179876095 00000004:00080000:1.0:1762167012.384255:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f794000, transno 17179876097 00000004:00080000:1.0:1762167012.384259:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f796a00, transno 17179876098 00000004:00080000:1.0:1762167012.384263:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb10700, transno 17179876099 00000004:00080000:1.0:1762167012.384268:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f795880, transno 17179876100 00000004:00080000:1.0:1762167012.384272:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f796300, transno 17179876101 00000004:00080000:1.0:1762167012.384276:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f795500, transno 17179876102 00000100:00100000:3.0:1762167012.384277:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454546432 00000004:00080000:1.0:1762167012.384279:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e471880, transno 17179876103 00002000:00010000:2.0:1762167012.384280:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167012.384283:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454546432 00002000:00010000:2.0:1762167012.384286:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00000004:00080000:1.0:1762167012.384286:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37fb11180, transno 17179876104 00002000:00010000:2.0:1762167012.384292:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000004:00080000:1.0:1762167012.384294:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee245188700, transno 17179876105 00002000:00010000:2.0:1762167012.384295:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.384300:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:1.0:1762167012.384301:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24518a680, transno 17179876106 00000100:00100000:3.0:1762167012.384312:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17516 00000100:00100000:1.0:1762167012.384313:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee2435ab480 x1847765454545536/t17179876121(17179876121) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167028 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1762167012.384324:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee243304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454546432:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167012.384331:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435ab480/2, rc 0, transno 17179876121 00000100:00100000:2.0:1762167012.384335:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454547072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (238us total) trans 17179876127 rc 0/0 00000100:00100000:1.0:1762167012.384341:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454545536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.384360:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17515 00000004:00080000:1.0:1762167012.384380:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243306680/2, rc 0, transno 17179876120 00000100:00100000:1.0:1762167012.384387:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454546048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.384391:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454546944:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167012.384399:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243307800/2, rc 0, transno 17179876123 00000100:00100000:1.0:1762167012.384406:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454546560:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167012.384418:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243305500/2, rc 0, transno 17179876127 00000100:00100000:1.0:1762167012.384423:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454547072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.384430:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1762167012.384431:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.384441:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454547456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.384475:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167012.384484:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243304380/2, rc 0, transno 17179876124 00000100:00100000:0.0:1762167012.384493:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454545920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.384511:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454546944 00000100:00100000:1.0:1762167012.384516:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454546944 00000100:00100000:2.0:1762167012.384533:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454547456 00000100:00100000:2.0:1762167012.384538:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454547456 00000100:00100000:1.0:1762167012.384551:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17517 00000100:00100000:1.0:1762167012.384562:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454546944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.384574:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17518 00000100:00100000:2.0:1762167012.384584:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454547456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167012.384623:0:12400:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167012.384628:0:12400:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.384630:0:12400:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:3.0:1762167012.384632:0:12400:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.384634:0:12400:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.384673:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee243304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454546432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 353us (461us total) trans 21474843701 rc 0/0 00000100:00100000:3.0:1762167012.384681:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17516 00002000:00010000:1.0:1762167012.384714:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.384718:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.384721:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:2.0:1762167012.384723:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 152547 -> 152547 00002000:00010000:1.0:1762167012.384723:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.384731:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.384731:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167012.384738:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:2.0:1762167012.384741:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.384744:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1762167012.384803:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454546944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 243us (371us total) trans 21474843702 rc 0/0 00000100:00100000:1.0:1762167012.384812:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17517 00000100:00100000:2.0:1762167012.384816:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454547456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 233us (341us total) trans 21474843703 rc 0/0 00000100:00100000:2.0:1762167012.384824:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17518 00000100:00100000:1.0:1762167012.384856:0:3296:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843681 gen 2 00000004:00080000:0.0:1762167012.384860:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 8 in progress, 3 in flight, 30 done 00000004:00080000:1.0:1762167012.384861:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f795180, transno 21474843649 00000004:00080000:1.0:1762167012.384886:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37f797b80, transno 21474843650 00000004:00080000:1.0:1762167012.384891:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc31880, transno 21474843651 00000004:00080000:1.0:1762167012.384895:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc32300, transno 21474843652 00000004:00080000:1.0:1762167012.384899:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc31f80, transno 21474843653 00000004:00080000:1.0:1762167012.384905:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc31180, transno 21474843654 00000004:00080000:1.0:1762167012.384910:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc32d80, transno 21474843655 00000004:00080000:1.0:1762167012.384913:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc33800, transno 21474843656 00000004:00080000:1.0:1762167012.384915:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc31500, transno 21474843657 00000004:00080000:1.0:1762167012.384919:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36dc32680, transno 21474843658 00000004:00080000:1.0:1762167012.384922:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aa8a80, transno 21474843659 00000004:00080000:1.0:1762167012.384925:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aaaa00, transno 21474843660 00000004:00080000:1.0:1762167012.384929:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37ff83800, transno 21474843661 00000004:00080000:1.0:1762167012.384932:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aab480, transno 21474843662 00000004:00080000:1.0:1762167012.384935:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aa9180, transno 21474843663 00000004:00080000:1.0:1762167012.384939:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37ff81f80, transno 21474843664 00000004:00080000:1.0:1762167012.384942:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aa9880, transno 21474843665 00000100:00100000:3.0:1762167012.384946:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1762167012.384946:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee346aaa300, transno 21474843666 00000004:00080000:1.0:1762167012.384953:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37ff82300, transno 21474843667 00000004:00080000:1.0:1762167012.384956:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee37ff82a00, transno 21474843668 00000004:00080000:1.0:1762167012.384960:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24786aa00, transno 21474843672 00000004:00080000:1.0:1762167012.384963:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24786bb80, transno 21474843673 00000100:00100000:3.0:1762167012.384964:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454547712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167012.384967:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24786a680, transno 21474843674 00000004:00080000:1.0:1762167012.384972:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24786ad80, transno 21474843675 00000004:00080000:1.0:1762167012.384974:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247868a80, transno 21474843676 00000004:00080000:1.0:1762167012.384978:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee247869c00, transno 21474843677 00000004:00080000:1.0:1762167012.384981:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9c00, transno 21474843678 00000004:00080000:1.0:1762167012.384984:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a8000, transno 21474843679 00000004:00080000:1.0:1762167012.384988:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240d500, transno 21474843680 00000004:00080000:1.0:1762167012.384991:0:3296:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24240ce00, transno 21474843681 00000100:00100000:1.0:1762167012.384999:0:3296:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee24550e680 x1847765454547456/t21474843703(21474843703) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762167028 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1762167012.385005:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762167012.385015:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550e680/2, rc 0, transno 21474843703 00000100:00100000:1.0:1762167012.385021:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454547456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.385035:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454547584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167012.385040:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550f480/2, rc 0, transno 21474843701 00000100:00100000:0.0:1762167012.385047:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454546432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167012.385063:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550f800/2, rc 0, transno 21474843702 00000100:00100000:0.0:1762167012.385068:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454546944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.385074:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167012.385096:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24732ed80/2, rc 0, transno 21474843699 00000100:00100000:0.0:1762167012.385103:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454545792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.385125:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454547712 00000100:00100000:1.0:1762167012.385131:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454547712 00000004:00080000:0.0:1762167012.385133:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243304a80/2, rc 0, transno 17179876125 00000100:00100000:3.0:1762167012.385137:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454547584 00000100:00100000:0.0:1762167012.385141:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454546304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167012.385144:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454547584 00000004:00080000:2.0:1762167012.385157:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 32 in progress, 4 in flight, 6 done 00000004:00080000:0.0:1762167012.385159:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243305c00/2, rc 0, transno 17179876126 00000100:00100000:1.0:1762167012.385166:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17519 00000100:00100000:0.0:1762167012.385167:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454546816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.385183:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454547712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167012.385184:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17520 00000004:00080000:0.0:1762167012.385187:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550d880/2, rc 0, transno 21474843700 00000100:00100000:0.0:1762167012.385197:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454547328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167012.385214:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee243306d80/2, rc 0, transno 17179876122 00000100:00100000:0.0:1762167012.385219:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee243306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454545664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167012.385234:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24732f100/2, rc 0, transno 21474843697 00000100:00100000:0.0:1762167012.385240:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454546176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.385254:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454547584:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167012.385255:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550c000/2, rc 0, transno 21474843696 00000100:00100000:0.0:1762167012.385264:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454546688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167012.385278:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550ea00/2, rc 0, transno 21474843698 00000100:00100000:0.0:1762167012.385282:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454547200:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167012.385325:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.385330:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.385333:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:1.0:1762167012.385336:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.385338:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:2.0:1762167012.385382:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 8 in progress, 0 in flight, 24 done 00000100:00100000:1.0:1762167012.385399:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f447850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454547712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 222us (396us total) trans 17179876128 rc 0/0 00000100:00100000:1.0:1762167012.385408:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17519 00002000:00010000:3.0:1762167012.385413:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb size from disk: 152547 -> 152547 00002000:00010000:3.0:1762167012.385418:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.385420:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:3.0:1762167012.385423:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.385426:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x820:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1762167012.385469:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454547584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 275us (395us total) trans 17179876129 rc 0/0 00000100:00100000:3.0:1762167012.385477:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17520 00000004:00080000:1.0:1762167012.385565:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345730700/2, rc 0, transno 17179876129 00000100:00100000:3.0:1762167012.385569:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.385574:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454547584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.385581:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762167012.385587:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454547968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.385611:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.385630:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452021120 00000100:00100000:2.0:1762167012.385636:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452021120 00000100:00100000:3.0:1762167012.385674:0:33892:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454547968 00000100:00100000:3.0:1762167012.385679:0:33892:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454547968 00000100:00100000:2.0:1762167012.385684:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20086 00000100:00100000:2.0:1762167012.385697:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+889:56224:x1847765452021120:12345-192.168.203.35@tcp:101:lfs.0 00000100:00100000:0.0:1762167012.385703:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454547840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.385711:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17521 00010000:00010000:2.0:1762167012.385714:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167012.385721:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454547968:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762167012.385738:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c19c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41f7 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.385739:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762167012.385802:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345732d80/2, rc 0, transno 17179876128 00000100:00100000:0.0:1762167012.385807:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454547712:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762167012.385823:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c19c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f7 expref: 890 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.385827:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454547840 00000100:00100000:0.0:1762167012.385832:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454547840 00010000:00010000:2.0:1762167012.385841:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c19c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f7 expref: 890 pid: 30817 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167012.385849:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb size from disk: 152547 -> 152547 00002000:00010000:3.0:1762167012.385854:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.385857:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167012.385859:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00010000:00010000:2.0:1762167012.385862:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00002000:00010000:3.0:1762167012.385864:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81e:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167012.385865:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17522 00010000:00010000:2.0:1762167012.385867:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167012.385873:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:0.0:1762167012.385878:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454547840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.385918:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454547968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (306us total) trans 21474843704 rc 0/0 00000100:00100000:2.0:1762167012.385920:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56224:x1847765452021120:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 226us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167012.385931:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17521 00000004:00080000:1.0:1762167012.385958:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550dc00/2, rc 0, transno 21474843704 00000100:00100000:2.0:1762167012.385959:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20086 00000100:00100000:1.0:1762167012.385967:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454547968:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762167012.386084:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167012.386087:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.386090:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:0.0:1762167012.386091:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.386094:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167012.386132:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454547840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 257us (393us total) trans 21474843705 rc 0/0 00000100:00100000:0.0:1762167012.386139:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17522 00000004:00080000:3.0:1762167012.386169:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550fb80/2, rc 0, transno 21474843705 00000100:00100000:3.0:1762167012.386175:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454547840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.388111:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.388186:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452021376 00000100:00100000:0.0:1762167012.388194:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452021376 00000100:00100000:0.0:1762167012.388248:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7393 00000100:00100000:0.0:1762167012.388257:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56224:x1847765452021376:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:0.0:1762167012.388516:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56224:x1847765452021376:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 259us (408us total) trans 8589953178 rc 0/0 00000100:00100000:0.0:1762167012.388524:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7393 00000100:00100000:0.0:1762167012.398699:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.398792:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452021504 00000100:00100000:1.0:1762167012.398808:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452021504 00000100:00100000:1.0:1762167012.398874:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20087 00000100:00100000:1.0:1762167012.398887:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56225:x1847765452021504:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167012.398939:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.398963:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c1a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb41fe expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.399030:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c1aa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399044:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c1aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399056:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c1aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399076:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c1b1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399083:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399090:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399196:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399204:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399211:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:1.0:1762167012.399244:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000004:00200000:1.0:1762167012.399248:0:30819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167012.399264:0:30819:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399276:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399284:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c1aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399291:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c1aa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399297:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c1aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399308:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee2425f5c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167012.399312:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c1aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399320:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c1aa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399331:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:1.0:1762167012.399334:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167012.399356:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c1aa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399363:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee2425f5c00/0xf915a5bdf3d0c1aa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399378:0:30819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399384:0:30819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399390:0:30819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399395:0:30819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480efc00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167012.399398:0:30819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399404:0:30819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399412:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167012.399415:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167012.399418:0:30819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c1b1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399424:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480efc00/0xf915a5bdf3d0c1b1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167012.399454:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee349126a00/0xf915a5bdf3d0c1a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41fe expref: 893 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.399468:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41fe expref: 892 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.399475:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:1.0:1762167012.399478:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167012.399481:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee342ede600, rc 0) 00000100:00100000:1.0:1762167012.399554:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56225:x1847765452021504:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 671us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.399562:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20087 00000100:00100000:1.0:1762167012.402072:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.402169:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452021760 00000100:00100000:3.0:1762167012.402179:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452021760 00000100:00100000:3.0:1762167012.402238:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20088 00000100:00100000:3.0:1762167012.402247:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606eac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56225:x1847765452021760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167012.402265:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167012.402283:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c1bf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4205 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.402402:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c1c6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167012.402415:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167012.402424:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c1c6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167012.402436:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00010000:00010000:3.0:1762167012.402556:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c1bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4205 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.402573:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c1c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4205 expref: 894 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.402581:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167012.402584:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167012.402587:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923800, rc 0) 00000100:00100000:3.0:1762167012.402643:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606eac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56225:x1847765452021760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 397us (580us total) trans 8589953179 rc 0/0 00000100:00100000:3.0:1762167012.402650:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20088 00000100:00100000:0.0:1762167012.404752:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.404826:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022016 00000100:00100000:3.0:1762167012.404836:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022016 00000100:00100000:3.0:1762167012.404887:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20089 00000100:00100000:3.0:1762167012.404896:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56225:x1847765452022016:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167012.404917:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167012.404932:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c1d4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb420c expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.405009:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c1db lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167012.405022:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c1db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167012.405032:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c1db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:00200000:3.0:1762167012.405043:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00010000:00010000:3.0:1762167012.405162:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c1d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb420c expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.405179:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c1db lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb420c expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.405192:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167012.405195:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762167012.405198:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167012.405253:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56225:x1847765452022016:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 356us (506us total) trans 8589953180 rc 0/0 00000100:00100000:3.0:1762167012.405260:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20089 00000100:00100000:0.0:1762167012.431306:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.431528:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022144 00000100:00100000:2.0:1762167012.431548:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022144 00000100:00100000:2.0:1762167012.431621:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3248 00000100:00100000:2.0:1762167012.431633:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452022144:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167012.431669:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.431688:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 30 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.431696:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167012.431698:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167012.431702:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.431736:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 30 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.431749:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 30 pid: 6535 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.431801:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454548096:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167012.431882:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2000 going to sleep for 11 seconds 00000100:00100000:2.0:1762167012.433733:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454548096:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167012.433760:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.435047:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.435150:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022272 00000100:00100000:2.0:1762167012.435158:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022272 00010000:00010000:2.0:1762167012.435196:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 31 pid: 6535 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.435244:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7665 00000100:00100000:2.0:1762167012.435255:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452022272:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.435272:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.435295:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 31 pid: 6535 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.435308:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 31 pid: 6535 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.435330:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30da00/0xf915a5bdf3d0c180 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e2 expref: 31 pid: 6535 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.435357:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.435359:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.435364:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.435374:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.435407:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167012.435462:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452022272:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 208us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.435473:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7665 00010000:00010000:0.0:1762167012.435539:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.435548:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.437806:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.437827:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.437843:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.437850:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167012.437855:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.437863:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.437880:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.437887:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c1e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167012.437978:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452022144:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6343us (6677us total) trans 0 rc 152547/152547 00000100:00100000:2.0:1762167012.437989:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3248 00000100:00100000:3.0:1762167012.440693:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.440741:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022400 00000100:00100000:2.0:1762167012.440751:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022400 00000100:00100000:2.0:1762167012.440843:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3249 00000100:00100000:2.0:1762167012.440851:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2359:x1847765452022400:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:2.0:1762167012.440880:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.440897:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c0ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4179 expref: 35 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.440905:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167012.440907:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167012.440911:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.440945:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4179 expref: 35 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.440960:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c0ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4179 expref: 35 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.440976:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454548224:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167012.441055:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3503e2000 going to sleep for 11 seconds 00000100:00100000:1.0:1762167012.443187:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.443233:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454548224:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167012.443261:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022528 00010000:00010000:2.0:1762167012.443261:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167012.443270:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022528 00010000:00010000:3.0:1762167012.443309:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c0ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4179 expref: 36 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.443374:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7666 00000100:00100000:2.0:1762167012.443386:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+36:2361:x1847765452022528:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.443406:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.443428:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c0ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4179 expref: 36 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.443440:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4179 expref: 36 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.443465:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c0ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4179 expref: 36 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.443479:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.443482:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.443486:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.443494:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.443528:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167012.443585:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167012.443587:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2361:x1847765452022528:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 203us (407us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167012.443594:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167012.443595:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7666 00010000:00010000:0.0:1762167012.444997:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.445013:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.445020:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.445027:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167012.445032:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.445040:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.445058:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.445068:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c1f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.445138:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765452022400:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4286us (4452us total) trans 0 rc 152547/152547 00000100:00100000:0.0:1762167012.445148:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3249 00000100:00100000:1.0:1762167012.448588:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.448638:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022656 00000100:00100000:0.0:1762167012.448652:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022656 00000100:00100000:0.0:1762167012.448731:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3250 00000100:00100000:0.0:1762167012.448742:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452022656:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167012.448808:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.448828:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c0ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4187 expref: 29 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.448837:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.448839:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.448842:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.448877:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c0ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4187 expref: 29 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.448890:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c0ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4187 expref: 29 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1762167012.448912:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454548352:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167012.448986:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167012.450488:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454548352:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167012.450505:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167012.450514:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167012.450555:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022784 00000100:00100000:2.0:1762167012.450562:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022784 00010000:00010000:2.0:1762167012.450592:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c0ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4187 expref: 30 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.450626:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7667 00000100:00100000:2.0:1762167012.450634:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452022784:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.450646:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.450667:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c0ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4187 expref: 30 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.450686:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c0ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4187 expref: 30 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.450707:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c000/0xf915a5bdf3d0c0ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4187 expref: 30 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.450726:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.450728:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.450736:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.450748:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.450791:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167012.450812:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.450822:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167012.450844:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452022784:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 208us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.450852:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7667 00010000:00010000:0.0:1762167012.452527:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.452544:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.452552:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.452559:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372975000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167012.452563:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.452572:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.452588:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.452594:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c1f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.452674:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452022656:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3931us (4088us total) trans 0 rc 152547/152547 00000100:00100000:0.0:1762167012.452684:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3250 00000100:00100000:1.0:1762167012.456525:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.456592:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452022912 00000100:00100000:0.0:1762167012.456601:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452022912 00000100:00100000:0.0:1762167012.456686:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3251 00000100:00100000:0.0:1762167012.456698:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2361:x1847765452022912:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167012.456743:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.456793:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4195 expref: 34 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.456802:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.456805:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.456808:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.456844:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4195 expref: 34 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.456877:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4195 expref: 34 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1762167012.456893:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454548480:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167012.456978:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167012.458364:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454548480:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167012.458389:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.458537:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.458621:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023040 00000100:00100000:2.0:1762167012.458627:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023040 00010000:00010000:2.0:1762167012.458669:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4195 expref: 35 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.458696:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7668 00000100:00100000:2.0:1762167012.458703:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765452023040:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.458714:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.458731:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4195 expref: 35 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.458740:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4195 expref: 35 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.458756:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37299e400/0xf915a5bdf3d0c0e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4195 expref: 35 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.458795:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.458797:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.458801:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.458811:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.458845:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167012.458893:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765452023040:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 190us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.458901:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7668 00010000:00010000:0.0:1762167012.458939:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.458946:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.460320:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.460334:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.460341:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.460359:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167012.460363:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.460371:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.460386:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.460402:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c1fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.460473:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765452022912:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3776us (3953us total) trans 0 rc 152547/152547 00000100:00100000:0.0:1762167012.460482:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3251 00000100:00100000:1.0:1762167012.463240:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.463297:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023168 00000100:00100000:0.0:1762167012.463308:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023168 00000100:00100000:0.0:1762167012.463392:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3252 00000100:00100000:0.0:1762167012.463404:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452023168:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167012.463442:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.463460:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0c102 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41a3 expref: 33 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.463469:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.463471:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.463475:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.463514:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0c102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41a3 expref: 33 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.463527:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0c102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41a3 expref: 33 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1762167012.463542:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454548608:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167012.463624:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167012.465166:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454548608:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167012.465193:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.465268:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.465422:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023296 00000100:00100000:2.0:1762167012.465430:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023296 00010000:00010000:2.0:1762167012.465464:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0c102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41a3 expref: 34 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.465496:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7669 00000100:00100000:2.0:1762167012.465506:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765452023296:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.465523:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.465547:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0c102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41a3 expref: 34 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.465560:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0c102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41a3 expref: 34 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.465585:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30c200/0xf915a5bdf3d0c102 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41a3 expref: 34 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.465601:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.465603:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.465607:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.465617:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.465652:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167012.465700:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452023296:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 195us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.465708:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7669 00010000:00010000:0.0:1762167012.465850:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.465859:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.469026:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.469042:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.469050:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.469063:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372975000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167012.469067:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.469075:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.469093:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.469101:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c205 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.469196:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452023168:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5791us (5961us total) trans 0 rc 152547/152547 00000100:00100000:0.0:1762167012.469207:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3252 00000100:00100000:3.0:1762167012.472279:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.472381:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023424 00000100:00100000:0.0:1762167012.472391:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023424 00000100:00100000:0.0:1762167012.472458:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3253 00000100:00100000:0.0:1762167012.472468:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2359:x1847765452023424:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167012.472505:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.472523:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0c11e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b1 expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.472536:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.472538:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.472541:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.472574:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0c11e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b1 expref: 28 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.472586:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0c11e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b1 expref: 28 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1762167012.472600:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454548736:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167012.472681:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167012.474853:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454548736:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167012.474880:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.474894:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.475093:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023552 00000100:00100000:2.0:1762167012.475101:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023552 00010000:00010000:2.0:1762167012.475132:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0c11e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b1 expref: 29 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.475201:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7670 00000100:00100000:2.0:1762167012.475212:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452023552:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.475228:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.475247:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0c11e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b1 expref: 29 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.475259:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0c11e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b1 expref: 29 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.475277:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30ca00/0xf915a5bdf3d0c11e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41b1 expref: 29 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.475289:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.475291:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.475295:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.475303:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.475326:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167012.475380:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2360:x1847765452023552:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 169us (489us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167012.475386:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167012.475390:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7670 00010000:00010000:0.0:1762167012.475401:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.477608:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.477633:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.477642:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.477649:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167012.477653:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.477662:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.477678:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.477685:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c20c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.478135:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2359:x1847765452023424:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 5663us (5863us total) trans 0 rc 152547/152547 00000100:00100000:0.0:1762167012.478145:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3253 00000100:00100000:1.0:1762167012.480997:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.481252:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023680 00000100:00100000:0.0:1762167012.481263:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023680 00000100:00100000:0.0:1762167012.481336:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3254 00000100:00100000:0.0:1762167012.481361:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765452023680:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167012.481397:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.481416:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0c13a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41bf expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.481424:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.481426:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.481429:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.481462:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0c13a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41bf expref: 27 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.481475:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0c13a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41bf expref: 27 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1762167012.481489:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454548864:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167012.481572:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:3.0:1762167012.483401:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.483462:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023808 00000100:00100000:2.0:1762167012.483470:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023808 00010000:00010000:2.0:1762167012.483505:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0c13a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41bf expref: 28 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.483547:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7671 00000100:00100000:2.0:1762167012.483556:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765452023808:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.483569:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.483600:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0c13a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41bf expref: 28 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.483615:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0c13a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41bf expref: 28 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.483638:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.483640:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.483645:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.483654:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.483673:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167012.483723:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765452023808:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 168us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.483731:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7671 00010000:00010000:0.0:1762167012.485133:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30c600/0xf915a5bdf3d0c13a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41bf expref: 27 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1762167012.485149:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454548864:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167012.485165:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.485171:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.485180:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.487854:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.487871:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.487880:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.487887:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee372975000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167012.487892:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.487901:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.487920:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.487928:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c213 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.488027:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765452023680:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 6677us (7035us total) trans 0 rc 152547/152547 00000100:00100000:0.0:1762167012.488039:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3254 00000100:00100000:1.0:1762167012.490627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.490707:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452023936 00000100:00100000:0.0:1762167012.490718:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452023936 00000100:00100000:0.0:1762167012.490823:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3255 00000100:00100000:0.0:1762167012.490833:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452023936:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167012.490875:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.490893:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0c156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41cd expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.490902:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.490904:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.490908:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.490957:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0c156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41cd expref: 32 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.490971:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0c156 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41cd expref: 32 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1762167012.490992:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454548992:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167012.491065:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167012.492188:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14118:1847765454548992:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167012.492213:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.492410:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.492511:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452024064 00000100:00100000:2.0:1762167012.492518:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452024064 00010000:00010000:2.0:1762167012.492549:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0c156 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41cd expref: 33 pid: 12400 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.492587:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7672 00000100:00100000:2.0:1762167012.492597:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2361:x1847765452024064:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.492611:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.492634:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0c156 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41cd expref: 33 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.492652:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0c156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41cd expref: 33 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.492674:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30ce00/0xf915a5bdf3d0c156 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41cd expref: 33 pid: 12400 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.492689:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.492691:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.492695:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.492704:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.492742:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167012.492818:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765452024064:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 221us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.492828:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7672 00010000:00010000:0.0:1762167012.492832:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.492843:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.494263:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.494279:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.494287:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.494294:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef3200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167012.494298:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.494306:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.494321:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.494329:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c21a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.494494:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452023936:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 3660us (3874us total) trans 0 rc 152547/152547 00000100:00100000:0.0:1762167012.494505:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3255 00000100:00100000:1.0:1762167012.497857:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.498013:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452024192 00000100:00100000:0.0:1762167012.498024:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452024192 00000100:00100000:0.0:1762167012.498095:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3256 00000100:00100000:0.0:1762167012.498107:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2359:x1847765452024192:12345-192.168.203.35@tcp:3:lfs.0 00010000:00010000:0.0:1762167012.498141:0:14118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.498161:0:14118:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c172 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41db expref: 26 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.498170:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.498172:0:14118:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167012.498176:0:14118:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.498210:0:14118:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c172 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41db expref: 26 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.498225:0:14118:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c172 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41db expref: 26 pid: 6535 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1762167012.498240:0:14118:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454549120:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167012.498327:0:14118:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:0.0:1762167012.500400:0:14118:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14118:1847765454549120:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167012.500430:0:14118:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.500742:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.500815:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452024320 00000100:00100000:2.0:1762167012.500823:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452024320 00010000:00010000:2.0:1762167012.500860:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c172 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41db expref: 27 pid: 6535 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.500897:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7673 00000100:00100000:2.0:1762167012.500908:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765452024320:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.500923:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.500946:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c172 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41db expref: 27 pid: 6535 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.500957:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c172 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41db expref: 27 pid: 6535 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.500980:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30cc00/0xf915a5bdf3d0c172 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41db expref: 27 pid: 6535 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.500996:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.500998:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167012.501002:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.501011:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 3 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.501038:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167012.501059:0:14118:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.501070:0:14118:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167012.501093:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2361:x1847765452024320:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.501101:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7673 00010000:00010000:0.0:1762167012.502618:0:14118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.502633:0:14118:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.502641:0:14118:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.502647:0:14118:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef2800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167012.502651:0:14118:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.502658:0:14118:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.502673:0:14118:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.502685:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c221 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->155647] (req 0->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167012.502758:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2359:x1847765452024192:12345-192.168.203.35@tcp:3:lfs.0 Request processed in 4651us (4907us total) trans 0 rc 152547/152547 00000100:00100000:0.0:1762167012.502794:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3256 00000100:00100000:3.0:1762167012.511138:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.511243:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452024448 00000100:00100000:2.0:1762167012.511255:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452024448 00000100:00100000:2.0:1762167012.511325:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 664 00000100:00100000:2.0:1762167012.511338:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56225:x1847765452024448:12345-192.168.203.35@tcp:103:lfs.0 00010000:00010000:2.0:1762167012.511368:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.511397:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c1db lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb420c expref: 896 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167012.511414:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167012.511419:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167012.511483:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56225:x1847765452024448:12345-192.168.203.35@tcp:103:lfs.0 Request processed in 148us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.511492:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 664 00000100:00100000:1.0:1762167012.513001:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.513065:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452024704 00000100:00100000:3.0:1762167012.513073:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452024704 00000100:00100000:3.0:1762167012.513120:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7394 00000100:00100000:3.0:1762167012.513129:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56225:x1847765452024704:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167012.513361:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56225:x1847765452024704:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 233us (365us total) trans 8589953181 rc 0/0 00000100:00100000:3.0:1762167012.513367:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7394 00000100:00100000:1.0:1762167012.516452:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.516511:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452024960 00000100:00100000:3.0:1762167012.516523:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452024960 00000100:00100000:3.0:1762167012.516580:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20090 00000100:00100000:3.0:1762167012.516591:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765452024960:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:3.0:1762167012.516617:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167012.516638:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c228 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4213 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.516745:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167012.516791:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41fe expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.516800:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167012.516834:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41fe expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.516848:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41fe expref: 897 pid: 30819 timeout: 733 lvb_type: 0 00000100:00100000:3.0:1762167012.516861:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454549248:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167012.516942:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242720a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167012.518225:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454549248:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167012.518302:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167012.518379:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.518443:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452025088 00000100:00100000:2.0:1762167012.518449:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452025088 00010000:00010000:2.0:1762167012.518480:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41fe expref: 898 pid: 30819 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.518513:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7674 00000100:00100000:2.0:1762167012.518523:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2361:x1847765452025088:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.518538:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.518545:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41fe expref: 898 pid: 30819 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.518557:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41fe expref: 898 pid: 30819 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.518577:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee342ede600/0xf915a5bdf3d0c1b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41fe expref: 898 pid: 30819 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.518598:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167012.518602:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167012.518610:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167012.518617:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167012.518641:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167012.518667:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167012.518676:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167012.518688:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:2361:x1847765452025088:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (316us total) trans 0 rc 0/0 00000004:00200000:3.0:1762167012.518692:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000100:00100000:2.0:1762167012.518698:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7674 00010000:00010000:3.0:1762167012.518873:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c228 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4213 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.518888:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4213 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167012.518893:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:3.0:1762167012.518895:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762167012.518897:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923600, rc 0) 00000100:00100000:3.0:1762167012.518933:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765452024960:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 2342us (2489us total) trans 8589953182 rc 0/0 00000100:00100000:3.0:1762167012.518941:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20090 00000100:00100000:1.0:1762167012.519931:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee348254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454549376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762167012.519987:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.520097:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762167012.520108:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454549504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762167012.520136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.520248:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454549376 00000100:00100000:0.0:1762167012.520256:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454549376 00000100:00100000:0.0:1762167012.520287:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454549504 00000100:00100000:0.0:1762167012.520290:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454549504 00000100:00100000:0.0:1762167012.520322:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1762167012.520332:0:6537:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454549376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762167012.520340:0:34176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1762167012.520360:0:34176:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454549504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1762167012.520375:0:34176:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 346226688 pending 0 free 3855613952 avail 3841982464 00002000:00000024:0.0:1762167012.520375:0:6537:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 225116160 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1762167012.520427:0:34176:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454549504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167012.520435:0:34176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1762167012.520442:0:6537:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454549376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.520450:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1762167012.520641:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee348254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454549376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762167012.520731:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454549504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762167012.520835:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.521038:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765454549632:0@lo:400:kworker.0 00000100:00100000:1.0:1762167012.521075:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.521093:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765454549760:0@lo:400:kworker.0 00000100:00100000:1.0:1762167012.521111:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762167012.521120:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765454550016:0@lo:400:kworker.0 00000100:00100000:0.0:1762167012.521126:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.521152:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.521155:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762167012.521163:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765454549888:0@lo:400:kworker.0 00000100:00100000:2.0:1762167012.521212:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454549632 00000100:00100000:2.0:1762167012.521217:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454549632 00000100:00100000:2.0:1762167012.521246:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1762167012.521252:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765454549632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762167012.521281:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3294:x1847765454549632:12345-0@lo:400:kworker.0 Request processed in 29us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.521286:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1762167012.521712:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452025216 00000100:00100000:3.0:1762167012.521718:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452025216 00000100:00100000:0.0:1762167012.521720:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454549760 00000100:00100000:0.0:1762167012.521727:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454549760 00000100:00100000:2.0:1762167012.521735:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454550016 00000100:00100000:2.0:1762167012.521742:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454550016 00000100:00100000:1.0:1762167012.521750:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f1807908-b95d-4027-b65a-753b7d69e554:3294:1847765454549632:0@lo:400:kworker.0 00000100:00100000:3.0:1762167012.521784:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1762167012.521796:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765454550016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762167012.521804:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20091 00000100:00100000:1.0:1762167012.521810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167012.521818:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765452025216:12345-192.168.203.35@tcp:101:fsx.0 00000100:00100000:2.0:1762167012.521830:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454549888 00000100:00100000:2.0:1762167012.521835:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454549888 00010000:00010000:0.0:1762167012.521835:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167012.521848:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1847765454550016:12345-0@lo:400:kworker.0 Request processed in 55us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167012.521855:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00010000:0.0:1762167012.521857:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c23d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb421a expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.521867:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1847765454550016:0@lo:400:kworker.0 00000100:00100000:2.0:1762167012.521874:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1762167012.521883:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765454549888:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1762167012.521914:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762167012.521924:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1847765454549888:12345-0@lo:400:kworker.0 Request processed in 43us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167012.521930:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00010000:0.0:1762167012.521940:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167012.521944:0:33893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1762167012.521948:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1847765454549888:0@lo:400:kworker.0 00000100:00100000:1.0:1762167012.521960:0:33893:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765454549760:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1762167012.521967:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4213 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.521978:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.522006:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4213 expref: 898 pid: 30819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167012.522015:0:33893:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765454549760:12345-0@lo:400:kworker.0 Request processed in 59us (888us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167012.522025:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4213 expref: 898 pid: 30819 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1762167012.522030:0:33893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1762167012.522043:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454550144:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167012.522067:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765454549760:0@lo:400:kworker.0 00000100:00100000:0.0:1762167012.522114:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee242a72540 going to sleep for 11 seconds 00000100:00100000:2.0:1762167012.523751:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454550144:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167012.523812:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167012.524220:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.524398:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452025344 00000100:00100000:2.0:1762167012.524406:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452025344 00010000:00010000:2.0:1762167012.524438:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4213 expref: 899 pid: 30819 timeout: 733 lvb_type: 0 00000100:00100000:2.0:1762167012.524474:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7675 00000100:00100000:2.0:1762167012.524483:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765452025344:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167012.524498:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167012.524505:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4213 expref: 899 pid: 30819 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.524516:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4213 expref: 899 pid: 30819 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.524535:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c22f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x619:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4213 expref: 899 pid: 30819 timeout: 733 lvb_type: 0 00010000:00010000:2.0:1762167012.524551:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:2.0:1762167012.524556:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167012.524568:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167012.524575:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167012.524606:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167012.524659:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765452025344:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 175us (439us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167012.524664:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:2.0:1762167012.524668:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7675 00010000:00010000:0.0:1762167012.524679:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167012.524726:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000004:00200000:0.0:1762167012.524737:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167012.524782:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.524820:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c23d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb421a expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.524839:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb421a expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.524847:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167012.524850:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167012.524853:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ef3200, rc 0) 00000100:00100000:0.0:1762167012.524890:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765452025216:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 3078us (4057us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.524898:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20091 00000100:00100000:1.0:1762167012.526571:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.526654:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452025472 00000100:00100000:0.0:1762167012.526662:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452025472 00000100:00100000:0.0:1762167012.526715:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17523 00000100:00100000:0.0:1762167012.526728:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+25:2358:x1847765452025472:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167012.526744:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.526787:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c24b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4221 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167012.526812:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81c:0x0] initial LVB size: 152547, mtime: 0x690888e4, atime: 0x690888de, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:0.0:1762167012.526830:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.526832:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.526840:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c24b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4221 expref: 26 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167012.526855:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c24b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4221 expref: 26 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167012.526873:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ef2800, rc 0) 00000100:00100000:0.0:1762167012.526922:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:2358:x1847765452025472:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 196us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.526929:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17523 00000100:00100000:3.0:1762167012.529474:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.529570:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452025728 00000100:00100000:0.0:1762167012.529580:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452025728 00000100:00100000:0.0:1762167012.529639:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7395 00000100:00100000:0.0:1762167012.529649:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+897:56065:x1847765452025728:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167012.529944:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765452025728:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 295us (477us total) trans 8589953183 rc 0/0 00000100:00100000:0.0:1762167012.529953:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7395 00000100:00100000:1.0:1762167012.531394:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.531452:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452025984 00000100:00100000:0.0:1762167012.531459:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452025984 00000100:00100000:0.0:1762167012.531496:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20092 00000100:00100000:0.0:1762167012.531502:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765452025984:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167012.531518:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.531520:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762167012.531542:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c244 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb421a expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.531559:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c1c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4205 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.531569:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c19c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f7 expref: 896 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.531580:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee342c23700) 00010000:00010000:0.0:1762167012.531588:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167012.531599:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c252 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4228 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.531636:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c259 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.531645:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c259 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.531651:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c259 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000040:00080000:0.0:1762167012.532268:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5667, 88 off458928 00000004:00080000:0.0:1762167012.532277:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633324513898ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.532329:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5675, 88 off459984 00000004:00080000:0.0:1762167012.532336:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633324573301ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.532383:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5676, 88 off460072 00000004:00080000:0.0:1762167012.532387:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633324624462ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.532405:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5668, 88 off459016 00000004:00080000:0.0:1762167012.532409:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633324646072ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.532460:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5677, 88 off460160 00000004:00080000:0.0:1762167012.532466:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633324702927ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.532496:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5669, 88 off459104 00000004:00080000:0.0:1762167012.532501:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633324737949ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.532527:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5670, 88 off459192 00000004:00080000:0.0:1762167012.532531:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633324768324ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.532546:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5678, 88 off460248 00000004:00080000:0.0:1762167012.532550:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633324787084ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.532564:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5679, 88 off460336 00000004:00080000:0.0:1762167012.532569:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633324805744ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.532585:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5671, 88 off459280 00000004:00080000:0.0:1762167012.532589:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633324826469ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.532617:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5680, 88 off460424 00000004:00080000:0.0:1762167012.532622:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633324859074ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.532638:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5672, 88 off459368 00000004:00080000:0.0:1762167012.532642:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633324879417ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.532669:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5673, 88 off459456 00000004:00080000:0.0:1762167012.532673:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633324910699ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.532689:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5681, 88 off460512 00000004:00080000:0.0:1762167012.532692:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633324929269ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.532707:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5674, 88 off459544 00000004:00080000:0.0:1762167012.532711:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633324948384ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.532726:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5682, 88 off460600 00000004:00080000:0.0:1762167012.532730:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633324967201ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.532751:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5683, 88 off460688 00000004:00080000:0.0:1762167012.532755:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633324992697ns, next at 630703976179ns, rc = 0 00000040:00080000:0.0:1762167012.532806:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5675, 88 off459632 00000004:00080000:0.0:1762167012.532811:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633325048491ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.532834:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5676, 88 off459720 00000004:00080000:0.0:1762167012.532838:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633325075539ns, next at 630704042948ns, rc = 0 00000040:00080000:0.0:1762167012.532862:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5684, 88 off460776 00000004:00080000:0.0:1762167012.532867:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633325103964ns, next at 630703976179ns, rc = 0 00010000:00010000:1.0:1762167012.548083:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c259 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4228 expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.548100:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:1.0:1762167012.548103:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762167012.548122:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee372975000/0xf915a5bdf3d0c252 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4228 expref: 898 pid: 32138 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1762167012.548142:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c259 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4228 expref: 897 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.548179:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:1.0:1762167012.548182:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762167012.548185:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee37f4d9c00, rc 0) 00000001:00080000:3.0:1762167012.548213:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953184 is committed 00000004:00080000:3.0:1762167012.548221:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3794 committed 00000004:00080000:3.0:1762167012.548243:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3781 committed 00000004:00080000:3.0:1762167012.548251:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3780 committed 00000004:00080000:3.0:1762167012.548254:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3793 committed 00000004:00080000:3.0:1762167012.548256:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3792 committed 00000004:00080000:3.0:1762167012.548261:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3779 committed 00000100:00100000:1.0:1762167012.548263:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765452025984:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 16757us (16869us total) trans 8589953184 rc 0/0 00000004:00080000:3.0:1762167012.548264:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3791 committed 00000004:00080000:3.0:1762167012.548270:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3778 committed 00000004:00080000:3.0:1762167012.548276:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3777 committed 00000100:00100000:1.0:1762167012.548280:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20092 00000004:00080000:3.0:1762167012.548281:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3790 committed 00000004:00080000:3.0:1762167012.548287:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3776 committed 00000004:00080000:3.0:1762167012.548290:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3789 committed 00000004:00080000:3.0:1762167012.548295:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3788 committed 00000004:00080000:3.0:1762167012.548300:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3775 committed 00000004:00080000:3.0:1762167012.548303:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3774 committed 00000004:00080000:3.0:1762167012.548307:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3787 committed 00000004:00080000:3.0:1762167012.548309:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3773 committed 00000004:00080000:3.0:1762167012.548313:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3786 committed 00000004:00080000:3.0:1762167012.548317:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3785 committed 00000004:00080000:3.0:1762167012.548322:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3772 committed 00000100:00100000:1.0:1762167012.548338:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454550272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.548389:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454550400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.548413:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167012.548459:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454550656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.548498:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454550784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.548501:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167012.548534:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454551168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.548541:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.548548:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454550528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.548569:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454551296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.548580:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.548612:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454550272 00000100:00100000:1.0:1762167012.548620:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454550272 00000100:00100000:3.0:1762167012.548627:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454551680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167012.548652:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.548662:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454550656 00000100:00100000:1.0:1762167012.548667:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454550656 00000100:00100000:3.0:1762167012.548676:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454552192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.548690:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454550784 00000100:00100000:1.0:1762167012.548694:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454550784 00000100:00100000:3.0:1762167012.548699:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167012.548715:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762167012.548720:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454551808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.548738:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454551168 00000100:00100000:3.0:1762167012.548742:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.548743:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454551168 00000100:00100000:3.0:1762167012.548789:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454551680 00000100:00100000:3.0:1762167012.548794:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454551680 00000100:00100000:1.0:1762167012.548799:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454552192 00000100:00100000:1.0:1762167012.548805:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454552192 00000100:00100000:3.0:1762167012.548816:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454551808 00000100:00100000:3.0:1762167012.548821:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454551808 00000100:00100000:1.0:1762167012.548830:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17524 00000100:00100000:1.0:1762167012.548841:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454550272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.548847:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17525 00000100:00100000:2.0:1762167012.548860:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17526 00000100:00100000:3.0:1762167012.548861:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454550656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.548876:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454550784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167012.548899:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17527 00000100:00100000:0.0:1762167012.548909:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3293:x1847765454551168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167012.549041:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167012.549044:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.549047:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167012.549050:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.549052:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1762167012.549058:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167012.549061:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.549064:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:0.0:1762167012.549066:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.549068:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167012.549078:0:6532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167012.549083:0:6532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.549086:0:6532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb atime from disk: 1762166997 -> 1762166997 00002000:00010000:2.0:1762167012.549089:0:6532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.549093:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x811:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.549094:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3293:x1847765454550656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 237us (595us total) trans 21474843706 rc 0/0 00000100:00100000:1.0:1762167012.549103:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3294:x1847765454550272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 264us (691us total) trans 21474843707 rc 0/0 00000100:00100000:3.0:1762167012.549105:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17525 00000100:00100000:0.0:1762167012.549117:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454551168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (537us total) trans 17179876130 rc 0/0 00000100:00100000:1.0:1762167012.549125:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17524 00000100:00100000:0.0:1762167012.549133:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17527 00000100:00100000:3.0:1762167012.549140:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17528 00000100:00100000:2.0:1762167012.549145:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454550784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 270us (602us total) trans 21474843708 rc 0/0 00000100:00100000:1.0:1762167012.549153:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17529 00000100:00100000:3.0:1762167012.549154:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3293:x1847765454551680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.549159:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17530 00000100:00100000:2.0:1762167012.549166:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17526 00000100:00100000:1.0:1762167012.549166:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3293:x1847765454552192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167012.549171:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3293:x1847765454551808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.549201:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.549229:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454550912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.549263:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.549284:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454551552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.549291:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3293:x1847765454551680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 140us (635us total) trans 17179876131 rc 0/0 00000100:00100000:3.0:1762167012.549300:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17528 00000100:00100000:3.0:1762167012.549319:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454550528 00000100:00100000:3.0:1762167012.549323:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454550528 00000100:00100000:0.0:1762167012.549327:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3293:x1847765454551808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (582us total) trans 21474843709 rc 0/0 00002000:00010000:1.0:1762167012.549329:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167012.549330:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762167012.549337:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00000100:00100000:3.0:1762167012.549341:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454550912 00002000:00010000:1.0:1762167012.549341:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:3.0:1762167012.549355:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454550912 00002000:00010000:1.0:1762167012.549358:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00000100:00100000:2.0:1762167012.549361:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454552064:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1762167012.549364:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81f:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1762167012.549375:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17530 00000100:00100000:3.0:1762167012.549384:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454551552 00000100:00100000:3.0:1762167012.549387:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454551552 00000100:00100000:0.0:1762167012.549391:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17531 00000100:00100000:2.0:1762167012.549403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167012.549407:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17532 00000100:00100000:0.0:1762167012.549407:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454550528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.549411:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3293:x1847765454552192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 248us (710us total) trans 17179876132 rc 0/0 00000100:00100000:3.0:1762167012.549419:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454550912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.549424:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17529 00000100:00100000:2.0:1762167012.549425:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1762167012.549435:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454551040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.549446:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454552064 00000100:00100000:1.0:1762167012.549451:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454552064 00000100:00100000:1.0:1762167012.549472:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17533 00000100:00100000:1.0:1762167012.549480:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1847765454551552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.549488:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.549507:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454551424:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1762167012.549513:0:33892:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167012.549518:0:33892:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.549520:0:33892:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167012.549523:0:33892:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.549525:0:33892:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.549548:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454550912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (282us total) trans 17179876134 rc 0/0 00000100:00100000:2.0:1762167012.549548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167012.549558:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17532 00000100:00100000:3.0:1762167012.549572:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454551040 00000100:00100000:3.0:1762167012.549576:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454551040 00000100:00100000:3.0:1762167012.549592:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454551424 00002000:00010000:1.0:1762167012.549594:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762167012.549596:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454551424 00002000:00010000:1.0:1762167012.549600:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.549604:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167012.549606:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.549609:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x819:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.549613:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17534 00000100:00100000:3.0:1762167012.549620:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454552064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1762167012.549699:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb size from disk: 152547 -> 152547 00000100:00100000:2.0:1762167012.549700:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454551936:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167012.549706:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.549710:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00000100:00100000:0.0:1762167012.549710:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454550528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 312us (510us total) trans 17179876133 rc 0/0 00002000:00010000:3.0:1762167012.549713:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.549716:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1762167012.549718:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17531 00000100:00100000:1.0:1762167012.549725:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454551552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (399us total) trans 21474843710 rc 0/0 00000100:00100000:2.0:1762167012.549738:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.549738:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17533 00000100:00100000:3.0:1762167012.549748:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454552064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (346us total) trans 21474843711 rc 0/0 00000100:00100000:0.0:1762167012.549748:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17535 00000100:00100000:3.0:1762167012.549755:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17534 00000100:00100000:0.0:1762167012.549758:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454551040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.549783:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454551936 00000100:00100000:1.0:1762167012.549788:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454551936 00000100:00100000:3.0:1762167012.549794:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17536 00000004:00080000:2.0:1762167012.549800:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345730e00/2, rc 0, transno 17179876133 00000100:00100000:3.0:1762167012.549806:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454551424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.549812:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17537 00000100:00100000:2.0:1762167012.549817:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454550528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.549824:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1847765454551936:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167012.549832:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345733800/2, rc 0, transno 17179876134 00000100:00100000:2.0:1762167012.549838:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454550912:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762167012.549848:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550d180/2, rc 0, transno 21474843710 00000100:00100000:2.0:1762167012.549857:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454551552:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167012.549867:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9500/2, rc 0, transno 21474843711 00000100:00100000:2.0:1762167012.549872:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454552064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.549949:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3296:x1847765454551424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (403us total) trans 17179876135 rc 0/0 00002000:00010000:1.0:1762167012.549950:0:33894:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.549957:0:33894:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00000100:00100000:3.0:1762167012.549963:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17536 00002000:00010000:1.0:1762167012.549963:0:33894:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb atime from disk: 1762167005 -> 1762167005 00002000:00010000:1.0:1762167012.549968:0:33894:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.549970:0:33894:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:3.0:1762167012.550004:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550d500/2, rc 0, transno 21474843709 00000100:00100000:1.0:1762167012.550006:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3296:x1847765454551936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (271us total) trans 17179876136 rc 0/0 00000100:00100000:3.0:1762167012.550014:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454551808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.550017:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17537 00000004:00080000:3.0:1762167012.550036:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345731180/2, rc 0, transno 17179876132 00000100:00100000:2.0:1762167012.550043:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167012.550046:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454552192:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167012.550062:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345732300/2, rc 0, transno 17179876130 00000100:00100000:1.0:1762167012.550067:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454551296 00000100:00100000:3.0:1762167012.550068:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454551168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.550073:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454551296 00000004:00080000:2.0:1762167012.550082:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550ce00/2, rc 0, transno 21474843707 00000004:00080000:3.0:1762167012.550088:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345732a00/2, rc 0, transno 17179876131 00000100:00100000:2.0:1762167012.550089:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454550272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.550098:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454551680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.550099:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17538 00000100:00100000:2.0:1762167012.550104:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454552320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.550111:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454551296:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1762167012.550115:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550e300/2, rc 0, transno 21474843706 00000100:00100000:3.0:1762167012.550122:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454550656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762167012.550135:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454552704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.550136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762167012.550172:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550c700/2, rc 0, transno 21474843708 00000100:00100000:3.0:1762167012.550176:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.550180:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454550784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.550206:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454552320 00000100:00100000:2.0:1762167012.550210:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454552320 00000100:00100000:3.0:1762167012.550219:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454552704 00000100:00100000:3.0:1762167012.550225:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454552704 00002000:00010000:1.0:1762167012.550233:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762167012.550240:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17539 00002000:00010000:1.0:1762167012.550240:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.550246:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb atime from disk: 1762167003 -> 1762167003 00002000:00010000:1.0:1762167012.550249:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.550252:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x817:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167012.550254:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3294:x1847765454552320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167012.550262:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17540 00000100:00100000:0.0:1762167012.550269:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3296:x1847765454551040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 514us (786us total) trans 21474843713 rc 0/0 00000100:00100000:3.0:1762167012.550270:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454552704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167012.550276:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17535 00000100:00100000:1.0:1762167012.550295:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3294:x1847765454551296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (253us total) trans 21474843712 rc 0/0 00000100:00100000:1.0:1762167012.550303:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17538 00000004:00080000:1.0:1762167012.550336:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550f100/2, rc 0, transno 21474843712 00000100:00100000:1.0:1762167012.550341:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454551296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.550377:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.550422:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee2435a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454552448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762167012.550428:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3294:x1847765454552320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (291us total) trans 17179876137 rc 0/0 00000100:00100000:3.0:1762167012.550438:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3293:x1847765454552704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (262us total) trans 21474843714 rc 0/0 00000100:00100000:2.0:1762167012.550438:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17539 00000100:00100000:3.0:1762167012.550449:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17540 00000100:00100000:1.0:1762167012.550454:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167012.550457:0:12402:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454550400 00000100:00100000:2.0:1762167012.550461:0:12402:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454550400 00000100:00100000:3.0:1762167012.550473:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454552448 00000100:00100000:3.0:1762167012.550478:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454552448 00000100:00100000:1.0:1762167012.550480:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762167012.550490:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454552576:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167012.550495:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17541 00000100:00100000:3.0:1762167012.550501:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17542 00000100:00100000:2.0:1762167012.550506:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454550400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167012.550513:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454552448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.550519:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167012.550539:0:7858:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454552576 00000100:00100000:1.0:1762167012.550543:0:7858:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454552576 00000100:00100000:1.0:1762167012.550568:0:7858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17543 00000100:00100000:1.0:1762167012.550576:0:7858:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3295:x1847765454552576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1762167012.550632:0:12402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762167012.550637:0:12402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb mtime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167012.550639:0:12402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762167012.550641:0:12402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb ctime from disk: 1762166986 -> 1762166986 00002000:00010000:2.0:1762167012.550644:0:12402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x802:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1762167012.550654:0:6535:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167012.550658:0:6535:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.550661:0:6535:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb atime from disk: 1762167008 -> 1762167008 00002000:00010000:3.0:1762167012.550664:0:6535:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.550667:0:6535:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x821:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1762167012.550681:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee374ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3295:x1847765454550400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (302us total) trans 17179876138 rc 0/0 00000100:00100000:2.0:1762167012.550689:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17541 00002000:00010000:1.0:1762167012.550694:0:7858:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.550699:0:7858:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.550701:0:7858:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb atime from disk: 1762167006 -> 1762167006 00002000:00010000:1.0:1762167012.550705:0:7858:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00000100:00100000:3.0:1762167012.550706:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454552448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (250us total) trans 17179876139 rc 0/0 00002000:00010000:1.0:1762167012.550710:0:7858:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81d:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.550723:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17542 00000004:00080000:2.0:1762167012.550725:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550df80/2, rc 0, transno 21474843713 00000100:00100000:2.0:1762167012.550732:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454551040:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762167012.550748:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345730a80/2, rc 0, transno 17179876135 00000100:00100000:1.0:1762167012.550751:0:7858:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454552576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (232us total) trans 21474843715 rc 0/0 00000100:00100000:2.0:1762167012.550755:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454551424:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762167012.550785:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e628a80/2, rc 0, transno 21474843714 00000004:00080000:2.0:1762167012.550794:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345731c00/2, rc 0, transno 17179876136 00000100:00100000:3.0:1762167012.550796:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454552704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167012.550798:0:7858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17543 00000100:00100000:2.0:1762167012.550803:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454551936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167012.550834:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a9c00/2, rc 0, transno 17179876137 00000100:00100000:1.0:1762167012.550840:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454552320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167012.550862:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e628380/2, rc 0, transno 21474843715 00000100:00100000:1.0:1762167012.550866:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454552576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1762167012.550873:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee2435a8000/2, rc 0, transno 17179876139 00000100:00100000:1.0:1762167012.550876:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee2435a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454552448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1762167012.550883:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345731880/2, rc 0, transno 17179876138 00000100:00100000:1.0:1762167012.550886:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454550400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762167012.553247:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.553305:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452026112 00000100:00100000:0.0:1762167012.553313:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452026112 00000100:00100000:0.0:1762167012.553362:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17544 00000100:00100000:0.0:1762167012.553369:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+26:56065:x1847765452026112:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167012.553382:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.553398:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c260 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb422f expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167012.553417:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x7ff:0x0] initial LVB size: 152547, mtime: 0x690888e4, atime: 0x690888e3, ctime: 0x690888e4, blocks: 0xf3 00010000:00010000:0.0:1762167012.553433:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.553434:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167012.553441:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c260 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 110592->135167) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb422f expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.553452:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c260 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 110592->135167) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb422f expref: 27 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.553461:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ef3200, rc 0) 00000100:00100000:0.0:1762167012.553508:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:56065:x1847765452026112:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 140us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.553513:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17544 00000100:00100000:3.0:1762167012.554989:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.555091:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452026240 00000100:00100000:0.0:1762167012.555098:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452026240 00002000:00100000:0.0:1762167012.555148:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->114687) req@ffff9ee348254a80 x1847765452026240/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/0 e 0 to 0 dl 1762167023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167012.555159:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348254a80 with x1847765452026240 ext(110592->114687) 00002000:00010000:0.0:1762167012.555165:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348254a80 00000100:00100000:0.0:1762167012.555195:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3257 00000100:00100000:0.0:1762167012.555205:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765452026240:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167012.555404:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2361:x1847765452026240:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 201us (421us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167012.555412:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3257 00002000:00100000:0.0:1762167012.555419:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->114687) req@ffff9ee348254a80 x1847765452026240/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/4536 e 0 to 0 dl 1762167023 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167012.555426:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348254a80 with x1847765452026240 ext(110592->114687) 00002000:00010000:0.0:1762167012.555430:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348254a80 00000100:00100000:1.0:1762167012.557221:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.557338:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452026368 00000100:00100000:0.0:1762167012.557358:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452026368 00002000:00100000:0.0:1762167012.557401:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (131072->135167) req@ffff9ee37fa9a680 x1847765452026368/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/0 e 0 to 0 dl 1762167023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167012.557412:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9a680 with x1847765452026368 ext(131072->135167) 00002000:00010000:0.0:1762167012.557418:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa9a680 00000100:00100000:0.0:1762167012.557450:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3258 00000100:00100000:0.0:1762167012.557459:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765452026368:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:0.0:1762167012.557686:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+27:2360:x1847765452026368:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 227us (472us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762167012.557694:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3258 00002000:00100000:0.0:1762167012.557702:0:14118:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x7ff:0x0] (131072->135167) req@ffff9ee37fa9a680 x1847765452026368/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/4536 e 0 to 0 dl 1762167023 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167012.557710:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9a680 with x1847765452026368 ext(131072->135167) 00002000:00010000:0.0:1762167012.557714:0:14118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa9a680 00000100:00100000:1.0:1762167012.559003:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.559052:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452026496 00000100:00100000:0.0:1762167012.559059:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452026496 00000100:00100000:0.0:1762167012.559101:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20093 00000100:00100000:0.0:1762167012.559108:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+890:56065:x1847765452026496:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167012.559124:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.559138:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c267 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4236 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.559204:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c26e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.559214:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c26e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.559222:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c26e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167012.559240:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 152547 00000004:00200000:0.0:1762167012.559243:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167012.559257:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c26e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.559278:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c267 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4236 expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.559290:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c26e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4236 expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.559296:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167012.559298:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167012.559300:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3480ed600, rc 0) 00000100:00100000:0.0:1762167012.559354:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765452026496:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 235us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.559362:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20093 00000100:00100000:3.0:1762167012.562724:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.562858:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452026752 00000100:00100000:0.0:1762167012.562869:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452026752 00000100:00100000:0.0:1762167012.562918:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20094 00000100:00100000:0.0:1762167012.562929:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765452026752:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:0.0:1762167012.562984:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167012.563013:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c26e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4236 expref: 891 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.563036:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c259 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4228 expref: 890 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.563048:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:0.0:1762167012.563056:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167012.563279:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.563289:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.563296:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:0.0:1762167012.563363:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953185 00000004:00010000:0.0:1762167012.563390:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003ec13fcc reply state 000000000bafd874 transno 8589953186 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167012.563399:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167012.563493:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765452026752:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 565us (778us total) trans 8589953186 rc 0/0 00000100:00100000:0.0:1762167012.563500:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20094 00000020:00080000:0.0:1762167012.563509:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762167012.564577:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167012.564587:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167012.564592:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167012.564597:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ee8000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167012.564600:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167012.564606:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167012.564616:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee3481b9700) 00010000:00010000:2.0:1762167012.564619:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167012.564622:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167012.564627:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8000/0xf915a5bdf3d0c275 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167012.564654:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.564718:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452026880 00000100:00100000:0.0:1762167012.564725:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452026880 00000100:00100000:0.0:1762167012.564806:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20095 00000100:00100000:0.0:1762167012.564813:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:56065:x1847765452026880:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167012.564827:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.564840:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0c27c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb423d expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.564887:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0c27c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb423d expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.564901:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0c27c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb423d expref: 892 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.564919:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167012.564922:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167012.564925:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ee8c00, rc 0) 00000100:00100000:0.0:1762167012.564983:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765452026880:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 169us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.564992:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20095 00000100:00100000:1.0:1762167012.566519:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.566543:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.566565:0:14118:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027136 00000100:00100000:0.0:1762167012.566574:0:14118:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027136 00000100:00100000:1.0:1762167012.566580:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00010000:0.0:1762167012.566607:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:0.0:1762167012.566617:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98380 with x1847765452027136 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167012.566626:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027008 00002000:00010000:0.0:1762167012.566629:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa98380. 00000100:00100000:2.0:1762167012.566634:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027008 00002000:00010000:2.0:1762167012.566656:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (133135->18446744073709551615) 00000100:00100000:3.0:1762167012.566666:0:21530:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027264 00002000:00100000:2.0:1762167012.566666:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9aa00 with x1847765452027008 ext(133135->18446744073709551615) 00000100:00100000:3.0:1762167012.566673:0:21530:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027264 00000100:00100000:0.0:1762167012.566673:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3259 00002000:00010000:2.0:1762167012.566678:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa9aa00. 00000100:00100000:0.0:1762167012.566689:0:14118:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2361:x1847765452027136:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167012.566699:0:21530:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00000100:00100000:2.0:1762167012.566701:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3260 00002000:00100000:3.0:1762167012.566707:0:21530:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9b100 with x1847765452027264 ext(0->18446744073709551615) 00000100:00100000:2.0:1762167012.566715:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765452027008:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:3.0:1762167012.566716:0:21530:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa9b100. 00000100:00100000:1.0:1762167012.566745:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3261 00000100:00100000:1.0:1762167012.566783:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+28:2361:x1847765452027264:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:0.0:1762167012.566986:0:14118:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762167012.566989:0:14118:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.566992:0:14118:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:0.0:1762167012.566995:0:14118:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:0.0:1762167012.566997:0:14118:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1762167012.566999:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.567004:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.567007:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.567009:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.567012:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1762167012.567023:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 152547 -> 133135 00002000:00010000:2.0:1762167012.567028:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.567032:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167012.567035:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.567037:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 243 -> 243 00000100:00100000:0.0:1762167012.567051:0:14118:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2361:x1847765452027136:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 366us (535us total) trans 17179876140 rc 0/0 00000100:00100000:0.0:1762167012.567061:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3259 00000100:00100000:1.0:1762167012.567062:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765452027264:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 304us (477us total) trans 21474843716 rc 0/0 00002000:00010000:0.0:1762167012.567066:0:14118:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00000100:00100000:2.0:1762167012.567069:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fa9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2361:x1847765452027008:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 355us (521us total) trans 21474843717 rc 0/0 00002000:00100000:0.0:1762167012.567070:0:14118:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa98380 with x1847765452027136 ext(0->18446744073709551615) 00002000:00010000:0.0:1762167012.567079:0:14118:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee37fa98380. 00000100:00100000:2.0:1762167012.567087:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3260 00002000:00010000:2.0:1762167012.567092:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (133135->18446744073709551615) 00000100:00100000:1.0:1762167012.567097:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3261 00002000:00100000:2.0:1762167012.567098:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9aa00 with x1847765452027008 ext(133135->18446744073709551615) 00002000:00010000:1.0:1762167012.567102:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:2.0:1762167012.567107:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa9aa00. 00002000:00100000:1.0:1762167012.567107:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37fa9b100 with x1847765452027264 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167012.567116:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37fa9b100. 00000100:00100000:1.0:1762167012.568697:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.568797:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027392 00000100:00100000:0.0:1762167012.568806:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027392 00000100:00100000:0.0:1762167012.568858:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20096 00000100:00100000:0.0:1762167012.568879:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:56065:x1847765452027392:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:0.0:1762167012.568897:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167012.568918:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c283 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4244 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.568998:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c28a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.569011:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c28a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.569021:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c28a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167012.569047:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 133135 00000004:00200000:0.0:1762167012.569052:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167012.569070:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c28a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.569094:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c283 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4244 expref: 894 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.569118:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c28a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4244 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167012.569125:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167012.569128:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167012.569132:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2800, rc 0) 00000100:00100000:0.0:1762167012.569181:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765452027392:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 305us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167012.569188:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20096 00000100:00100000:3.0:1762167012.572145:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.572328:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027520 00000100:00100000:1.0:1762167012.572359:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027520 00002000:00100000:1.0:1762167012.572418:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->69631) req@ffff9ee348257100 x1847765452027520/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/0 e 0 to 0 dl 1762167023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167012.572431:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348257100 with x1847765452027520 ext(4096->69631) 00002000:00010000:1.0:1762167012.572437:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348257100 00000100:00100000:1.0:1762167012.572474:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3262 00000100:00100000:1.0:1762167012.572485:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452027520:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167012.575591:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452027520:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 3098us (3446us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1762167012.575605:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3262 00002000:00100000:2.0:1762167012.575619:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (4096->69631) req@ffff9ee348257100 x1847765452027520/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/440 e 0 to 0 dl 1762167023 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167012.575629:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee348257100 with x1847765452027520 ext(4096->69631) 00002000:00010000:2.0:1762167012.575636:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee348257100 00000100:00100000:0.0:1762167012.577747:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.578022:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027648 00000100:00100000:2.0:1762167012.578033:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027648 00002000:00100000:2.0:1762167012.578081:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->106495) req@ffff9ee345732680 x1847765452027648/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/0 e 0 to 0 dl 1762167023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167012.578091:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee345732680 with x1847765452027648 ext(69632->106495) 00002000:00010000:2.0:1762167012.578097:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee345732680 00000100:00100000:2.0:1762167012.578133:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3263 00000100:00100000:2.0:1762167012.578143:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765452027648:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167012.579698:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2361:x1847765452027648:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 1551us (1954us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1762167012.579711:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3263 00002000:00100000:2.0:1762167012.579721:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (69632->106495) req@ffff9ee345732680 x1847765452027648/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/440 e 0 to 0 dl 1762167023 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167012.579730:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee345732680 with x1847765452027648 ext(69632->106495) 00002000:00010000:2.0:1762167012.579736:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee345732680 00000100:00100000:1.0:1762167012.583074:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.583146:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452027776 00000100:00100000:2.0:1762167012.583157:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452027776 00002000:00100000:2.0:1762167012.583204:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (106496->110591) req@ffff9ee24732c700 x1847765452027776/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/0 e 0 to 0 dl 1762167023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167012.583215:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732c700 with x1847765452027776 ext(106496->110591) 00002000:00010000:2.0:1762167012.583221:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732c700 00000100:00100000:2.0:1762167012.583251:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3264 00000100:00100000:2.0:1762167012.583261:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452027776:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167012.583474:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+29:2360:x1847765452027776:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 215us (409us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167012.583482:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3264 00002000:00100000:2.0:1762167012.583489:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x7ff:0x0] (106496->110591) req@ffff9ee24732c700 x1847765452027776/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/4536 e 0 to 0 dl 1762167023 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167012.583497:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee24732c700 with x1847765452027776 ext(106496->110591) 00002000:00010000:2.0:1762167012.583501:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee24732c700 00000100:00100000:0.0:1762167012.588390:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.588506:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028032 00000100:00100000:1.0:1762167012.588516:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028032 00000100:00100000:1.0:1762167012.588579:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20097 00000100:00100000:1.0:1762167012.588589:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:56065:x1847765452028032:12345-192.168.203.35@tcp:36:fsx.0 00010000:00010000:1.0:1762167012.588642:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167012.588681:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c28a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4244 expref: 893 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.588709:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:1.0:1762167012.588714:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167012.588976:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167012.588987:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167012.588993:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000001:00080000:1.0:1762167012.589042:0:32138:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953187 00000004:00010000:1.0:1762167012.589067:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000af4ba89a reply state 00000000146b014f transno 8589953188 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167012.589076:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167012.589164:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765452028032:12345-192.168.203.35@tcp:36:fsx.0 Request processed in 576us (783us total) trans 8589953188 rc 0/0 00000100:00100000:1.0:1762167012.589172:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20097 00000020:00080000:1.0:1762167012.589177:0:32138:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762167012.590931:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.590945:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.590950:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.590955:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167012.590958:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.590963:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.590975:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167012.590977:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167012.590988:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167012.590993:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c291 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167012.591519:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.591554:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.591581:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.591995:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028160 00000100:00100000:1.0:1762167012.591996:0:14122:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028416 00000100:00100000:2.0:1762167012.592006:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028160 00000100:00100000:1.0:1762167012.592006:0:14122:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028416 00002000:00010000:1.0:1762167012.592044:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00010000:2.0:1762167012.592045:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (175433->18446744073709551615) 00002000:00100000:2.0:1762167012.592053:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de00a80 with x1847765452028160 ext(175433->18446744073709551615) 00002000:00100000:1.0:1762167012.592053:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01180 with x1847765452028416 ext(0->18446744073709551615) 00000100:00100000:3.0:1762167012.592068:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028288 00002000:00010000:2.0:1762167012.592069:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de00a80. 00002000:00010000:1.0:1762167012.592069:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de01180. 00000100:00100000:3.0:1762167012.592078:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028288 00002000:00010000:3.0:1762167012.592098:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167012.592103:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de02300 with x1847765452028288 ext(0->18446744073709551615) 00000100:00100000:1.0:1762167012.592111:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3265 00002000:00010000:3.0:1762167012.592112:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36de02300. 00000100:00100000:2.0:1762167012.592121:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3266 00000100:00100000:2.0:1762167012.592134:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452028160:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:1.0:1762167012.592246:0:14122:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+30:2360:x1847765452028416:12345-192.168.203.35@tcp:10:fsx.0 00002000:00010000:2.0:1762167012.592376:0:26246:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb size from disk: 133135 -> 175433 00002000:00010000:2.0:1762167012.592380:0:26246:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.592382:0:26246:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:2.0:1762167012.592384:0:26246:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:2.0:1762167012.592387:0:26246:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x7ff:0x0] updating lvb blocks from disk: 243 -> 243 00002000:00010000:1.0:1762167012.592404:0:14122:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762167012.592409:0:14122:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.592412:0:14122:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:1.0:1762167012.592414:0:14122:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:1.0:1762167012.592416:0:14122:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x801:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1762167012.592469:0:14122:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452028416:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 347us (913us total) trans 21474843719 rc 0/0 00000100:00100000:2.0:1762167012.592500:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452028160:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 367us (983us total) trans 21474843718 rc 0/0 00000100:00100000:1.0:1762167012.592519:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3265 00002000:00010000:1.0:1762167012.592523:0:14122:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2049 (0->18446744073709551615) 00002000:00100000:1.0:1762167012.592527:0:14122:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01180 with x1847765452028416 ext(0->18446744073709551615) 00002000:00010000:1.0:1762167012.592533:0:14122:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de01180. 00000100:00100000:3.0:1762167012.592538:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3267 00000100:00100000:3.0:1762167012.592550:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+32:2360:x1847765452028288:12345-192.168.203.35@tcp:10:fsx.0 00000100:00100000:2.0:1762167012.592632:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3266 00002000:00010000:2.0:1762167012.592636:0:26246:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2047 (175433->18446744073709551615) 00002000:00100000:2.0:1762167012.592640:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de00a80 with x1847765452028160 ext(175433->18446744073709551615) 00002000:00010000:2.0:1762167012.592646:0:26246:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de00a80. 00002000:00010000:3.0:1762167012.592689:0:14117:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167012.592693:0:14117:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb mtime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.592696:0:14117:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb atime from disk: 1762167011 -> 1762167011 00002000:00010000:3.0:1762167012.592698:0:14117:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb ctime from disk: 1762167012 -> 1762167012 00002000:00010000:3.0:1762167012.592700:0:14117:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x804:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1762167012.592742:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452028288:12345-192.168.203.35@tcp:10:fsx.0 Request processed in 195us (1160us total) trans 17179876141 rc 0/0 00000100:00100000:3.0:1762167012.592750:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3267 00002000:00010000:3.0:1762167012.592754:0:14117:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/2052 (0->18446744073709551615) 00002000:00100000:3.0:1762167012.592756:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de02300 with x1847765452028288 ext(0->18446744073709551615) 00002000:00010000:3.0:1762167012.592866:0:14117:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ee36de02300. 00000100:00100000:0.0:1762167012.595522:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.595626:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028544 00000100:00100000:3.0:1762167012.595634:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028544 00002000:00100000:3.0:1762167012.595671:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (135168->172031) req@ffff9ee36de02680 x1847765452028544/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/0 e 0 to 0 dl 1762167023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762167012.595678:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de02680 with x1847765452028544 ext(135168->172031) 00002000:00010000:3.0:1762167012.595682:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de02680 00000100:00100000:3.0:1762167012.595708:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3268 00000100:00100000:3.0:1762167012.595716:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452028544:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167012.599246:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2360:x1847765452028544:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 3519us (3718us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1762167012.599261:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3268 00002000:00100000:2.0:1762167012.599276:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (135168->172031) req@ffff9ee36de02680 x1847765452028544/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/440 e 0 to 0 dl 1762167023 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167012.599287:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de02680 with x1847765452028544 ext(135168->172031) 00002000:00010000:2.0:1762167012.599293:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de02680 00000100:00100000:0.0:1762167012.604434:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.606410:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028672 00000100:00100000:2.0:1762167012.606429:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028672 00002000:00100000:2.0:1762167012.606504:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (172032->176127) req@ffff9ee36de01500 x1847765452028672/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/0 e 0 to 0 dl 1762167023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167012.606516:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01500 with x1847765452028672 ext(172032->176127) 00002000:00010000:2.0:1762167012.606521:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de01500 00000100:00100000:2.0:1762167012.606560:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3269 00000100:00100000:2.0:1762167012.606570:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765452028672:12345-192.168.203.35@tcp:3:fsx.0 00000100:00100000:2.0:1762167012.607141:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2359:x1847765452028672:12345-192.168.203.35@tcp:3:fsx.0 Request processed in 569us (2714us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762167012.607150:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3269 00002000:00100000:2.0:1762167012.607157:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (172032->176127) req@ffff9ee36de01500 x1847765452028672/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/4536 e 0 to 0 dl 1762167023 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167012.607166:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de01500 with x1847765452028672 ext(172032->176127) 00002000:00010000:2.0:1762167012.607170:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de01500 00000100:00100000:0.0:1762167012.611020:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167012.611127:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028800 00000100:00100000:2.0:1762167012.611138:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028800 00002000:00100000:2.0:1762167012.611299:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->175432) req@ffff9ee36de03b80 x1847765452028800/t0(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/0 e 0 to 0 dl 1762167023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167012.611312:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de03b80 with x1847765452028800 ext(110592->175432) 00002000:00010000:2.0:1762167012.611322:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de03b80 00000100:00100000:2.0:1762167012.611368:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3270 00000100:00100000:2.0:1762167012.611379:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+31:2358:x1847765452028800:12345-192.168.203.35@tcp:4:fsx.0 00000100:00100000:2.0:1762167012.613502:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2358:x1847765452028800:12345-192.168.203.35@tcp:4:fsx.0 Request processed in 2112us (2479us total) trans 21474843720 rc 0/0 00000100:00100000:2.0:1762167012.613519:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3270 00002000:00100000:2.0:1762167012.613531:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x7ff:0x0] (110592->175432) req@ffff9ee36de03b80 x1847765452028800/t21474843720(0) o4->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:43/0 lens 488/448 e 0 to 0 dl 1762167023 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762167012.613541:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee36de03b80 with x1847765452028800 ext(110592->175432) 00002000:00010000:2.0:1762167012.613546:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee36de03b80 00000100:00100000:0.0:1762167012.615458:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.615533:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452028928 00000100:00100000:1.0:1762167012.615542:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452028928 00000100:00100000:1.0:1762167012.615600:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17545 00000100:00100000:1.0:1762167012.615609:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765452028928:12345-192.168.203.35@tcp:16:fsx.0 00000001:00080000:0.0:1762167012.637791:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843713 is committed 00000001:00080000:0.0:1762167012.637821:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843695 is committed 00000001:00080000:0.0:1762167012.637841:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843719 is committed 00000001:00080000:0.0:1762167012.637849:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843715 is committed 00000100:00100000:1.0:1762167012.637867:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2359:x1847765452028928:12345-192.168.203.35@tcp:16:fsx.0 Request processed in 22252us (22410us total) trans 0 rc 0/0 00000001:00080000:0.0:1762167012.637868:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843720 is committed 00000100:00100000:1.0:1762167012.637883:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17545 00000100:00100000:0.0:1762167012.639688:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167012.639796:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452029056 00000100:00100000:1.0:1762167012.639805:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452029056 00000100:00100000:1.0:1762167012.639857:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20098 00000100:00100000:1.0:1762167012.639867:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:56065:x1847765452029056:12345-192.168.203.35@tcp:101:fsx.0 00010000:00010000:1.0:1762167012.639887:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167012.639905:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c298 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb424b expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.639998:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c29f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167012.640013:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c29f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167012.640024:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c29f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167012.640054:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 175433 00000004:00200000:1.0:1762167012.640058:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167012.640073:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c29f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167012.640096:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c298 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb424b expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.640109:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c29f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb424b expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167012.640115:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:1.0:1762167012.640118:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167012.640120:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9e00, rc 0) 00000100:00100000:1.0:1762167012.640169:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36de03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765452029056:12345-192.168.203.35@tcp:101:fsx.0 Request processed in 301us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167012.640176:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20098 00000100:00100000:3.0:1762167012.643260:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167012.643328:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452029312 00000100:00100000:0.0:1762167012.643340:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452029312 00000100:00100000:0.0:1762167012.643411:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7396 00000100:00100000:0.0:1762167012.643421:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:56065:x1847765452029312:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:0.0:1762167012.643803:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765452029312:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 378us (546us total) trans 8589953189 rc 0/0 00000100:00100000:0.0:1762167012.643812:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7396 00000100:00100000:0.0:1762167012.648069:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.648122:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452029568 00000100:00100000:3.0:1762167012.648133:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452029568 00000100:00100000:3.0:1762167012.648194:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7397 00000100:00100000:3.0:1762167012.648205:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:56065:x1847765452029568:12345-192.168.203.35@tcp:35:fsx.0 00000001:00080000:3.0:1762167012.648514:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953190 00000100:00100000:3.0:1762167012.648626:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765452029568:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 423us (562us total) trans 8589953191 rc 0/0 00000100:00100000:3.0:1762167012.648635:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7397 00000020:00080000:3.0:1762167012.648641:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762167012.651138:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167012.651220:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452029824 00000100:00100000:3.0:1762167012.651232:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452029824 00000100:00100000:3.0:1762167012.651291:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7398 00000100:00100000:3.0:1762167012.651302:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee3606e8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:56065:x1847765452029824:12345-192.168.203.35@tcp:35:fsx.0 00000100:00100000:3.0:1762167012.651676:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee3606e8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56065:x1847765452029824:12345-192.168.203.35@tcp:35:fsx.0 Request processed in 375us (548us total) trans 8589953192 rc 0/0 00000100:00100000:3.0:1762167012.651684:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7398 00010000:00010000:1.0:1762167012.775992:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167013.800005:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167014.692963:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167014.693023:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452029952 00000100:00100000:2.0:1762167014.693036:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452029952 00000100:00080000:0.0:1762167014.693114:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762167014.693132:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20099 00000100:00100000:2.0:1762167014.693147:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56642:x1847765452029952:12345-192.168.203.35@tcp:101:rm.0 00010000:00010000:2.0:1762167014.693175:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167014.693200:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c2a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4252 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167014.693281:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c2ad lrc: 3/1,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693298:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c2ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693314:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c2ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693344:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c2b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693353:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693364:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693519:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c2bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693530:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693537:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167014.693575:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x619:0x0]: returning size 175433 00000004:00200000:2.0:1762167014.693580:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167014.693602:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693616:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693625:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c2ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693631:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c2ad lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693639:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c2ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693646:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167014.693650:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c2ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693658:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c2ad lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693672:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:2.0:1762167014.693675:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167014.693680:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c2ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693686:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c2ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693701:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693707:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c2b4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693713:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693718:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167014.693721:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693727:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c2b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693736:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee342c23300) 00010000:00010000:2.0:1762167014.693740:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167014.693743:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c2b4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693749:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c2b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.693821:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c2a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4252 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167014.693840:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c2bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4252 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167014.693848:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167014.693850:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762167014.693853:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d600, rc 0) 00000100:00100000:2.0:1762167014.693932:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:56642:x1847765452029952:12345-192.168.203.35@tcp:101:rm.0 Request processed in 788us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167014.693940:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20099 00000100:00100000:3.0:1762167014.695701:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167014.695747:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452030080 00000100:00100000:3.0:1762167014.695756:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452030080 00000100:00100000:3.0:1762167014.695854:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 665 00000100:00100000:3.0:1762167014.695866:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2360:x1847765452030080:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167014.695883:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167014.695908:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c2bb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4252 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167014.695924:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:3.0:1762167014.695929:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167014.695987:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:2360:x1847765452030080:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 123us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167014.695996:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 665 00000100:00100000:3.0:1762167014.696863:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167014.696891:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452030336 00000100:00100000:3.0:1762167014.696896:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452030336 00000100:00100000:3.0:1762167014.696987:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20100 00000100:00100000:3.0:1762167014.696997:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56642:x1847765452030336:12345-192.168.203.35@tcp:36:rm.0 00010000:00010000:3.0:1762167014.697048:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762167014.697068:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c29f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb424b expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167014.697093:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ee8c00/0xf915a5bdf3d0c27c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb423d expref: 898 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167014.697103:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:3.0:1762167014.697111:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167014.697134:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c2c2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.697146:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c2c2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.697156:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c2c2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.697169:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.697175:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.697182:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.697295:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c2d0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.697303:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c2d0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.697309:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c2d0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000040:00080000:3.0:1762167014.698105:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5677, 64 off459784 00000004:00080000:3.0:1762167014.698117:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635490353523ns, next at 636490351159ns, rc = 0 00000040:00080000:3.0:1762167014.698174:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5685, 64 off460840 00000004:00080000:3.0:1762167014.698181:0:32138:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635490418288ns, next at 636490416934ns, rc = 0 00000040:00080000:3.0:1762167014.698201:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5686, 64 off460904 00000040:00080000:3.0:1762167014.698218:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5678, 64 off459848 00000040:00080000:3.0:1762167014.698234:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5687, 64 off460968 00000040:00080000:3.0:1762167014.698251:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5679, 64 off459912 00000040:00080000:3.0:1762167014.698266:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5680, 64 off459976 00000040:00080000:3.0:1762167014.698280:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5688, 64 off461032 00000040:00080000:3.0:1762167014.698293:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5689, 64 off461096 00000040:00080000:3.0:1762167014.698307:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5681, 64 off460040 00000040:00080000:3.0:1762167014.698320:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5690, 64 off461160 00000040:00080000:3.0:1762167014.698347:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5682, 64 off460104 00000040:00080000:3.0:1762167014.698363:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5683, 64 off460168 00000040:00080000:3.0:1762167014.698378:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5691, 64 off461224 00000040:00080000:3.0:1762167014.698394:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5684, 64 off460232 00000040:00080000:3.0:1762167014.698411:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5692, 64 off461288 00000040:00080000:3.0:1762167014.698427:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5693, 64 off461352 00000040:00080000:3.0:1762167014.698442:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5685, 64 off460296 00000040:00080000:3.0:1762167014.698458:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5686, 64 off460360 00000040:00080000:3.0:1762167014.698474:0:32138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5694, 64 off461416 00010000:00010000:3.0:1762167014.698564:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698574:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698583:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698590:0:32138:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698600:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698606:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698633:0:32138:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762167014.698650:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c2d0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698655:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c2d0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698661:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c2d0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698666:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167014.698671:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c2d0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698678:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c2d0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x619:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698688:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:3.0:1762167014.698691:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1762167014.698694:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c2d0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698700:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c2d0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x619:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698826:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c2c2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698837:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c2c2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698843:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c2c2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698849:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167014.698852:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c2c2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698858:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c2c2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698866:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0x0 (ffff9ee3485bce00) 00010000:00010000:3.0:1762167014.698868:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167014.698871:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c2c2 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:3.0:1762167014.698876:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922600/0xf915a5bdf3d0c2c2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x618:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000004:00010000:3.0:1762167014.698884:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c8bbc0f5 reply state 00000000a7f3d0ac transno 8589953193 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167014.698892:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762167014.698972:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:56642:x1847765452030336:12345-192.168.203.35@tcp:36:rm.0 Request processed in 1974us (2111us total) trans 8589953193 rc 0/0 00000100:00100000:3.0:1762167014.698980:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20100 00010000:00010000:2.0:1762167014.699107:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167014.699114:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.699120:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167014.699124:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.699131:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.699141:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x619:0x0].0x0 (ffff9ee345a77800) 00010000:00010000:2.0:1762167014.699144:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762167014.699147:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.699152:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c2d7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.699167:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167014.699169:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167014.699171:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167014.700126:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.700138:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.700144:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.700150:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167014.700153:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.700161:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.700171:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x618:0x0].0xdd396665 (ffff9ee345a77000) 00010000:00010000:2.0:1762167014.700174:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167014.700177:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.700183:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c2c9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x618:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167014.823937:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1762167015.375915:0:34374:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 71: check mirror extend parent fid ==== 05:50:15 (1762167015) 00010000:00010000:1.0:1762167015.848162:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1762167016.076072:0:34422:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-flr test_71 ldiskfs only test 00000100:00100000:2.0:1762167016.547938:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.547981:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.548006:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.548026:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.548052:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452030720 00000100:00100000:2.0:1762167016.548061:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452030720 00000100:00100000:2.0:1762167016.548107:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452030848 00000100:00100000:2.0:1762167016.548109:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452030848 00000100:00100000:2.0:1762167016.548130:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 244 00000100:00100000:3.0:1762167016.548134:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452030464 00000100:00100000:3.0:1762167016.548141:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452030464 00000100:00100000:2.0:1762167016.548142:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765452030720:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762167016.548180:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 123 00000100:00100000:3.0:1762167016.548190:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765452030464:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762167016.548218:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765452030720:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167016.548227:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 245 00000100:00100000:3.0:1762167016.548233:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:2361:x1847765452030464:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 42us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167016.548239:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 244 00000100:00100000:0.0:1762167016.548242:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452030848:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:3.0:1762167016.548249:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 123 00000100:00100000:0.0:1762167016.548283:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2360:x1847765452030848:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167016.548284:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452030592 00000100:00100000:2.0:1762167016.548288:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452030592 00000100:00100000:0.0:1762167016.548290:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 245 00000100:00100000:2.0:1762167016.548334:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 115 00000100:00100000:2.0:1762167016.548343:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765452030592:12345-192.168.203.35@tcp:400:kworker.0 00000100:00100000:2.0:1762167016.548387:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:2360:x1847765452030592:12345-192.168.203.35@tcp:400:kworker.0 Request processed in 46us (380us total) trans 0 rc 0/0 00000100:00080000:1.0:1762167016.548392:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762167016.548396:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 115 00000100:00080000:1.0:1762167016.548400:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762167016.548405:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1762167016.754080:0:34470:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 200a: stress test ===================== 05:50:16 (1762167016) 00000100:00100000:0.0:1762167016.798966:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.799027:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452030976 00000100:00100000:1.0:1762167016.799039:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452030976 00000100:00100000:1.0:1762167016.799105:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20101 00000100:00100000:1.0:1762167016.799117:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:57113:x1847765452030976:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.799139:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.799161:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c2de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4259 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.799224:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c2e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799240:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799252:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799267:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c2ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799274:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c2ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799280:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c2ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799532:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799540:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c2e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799546:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c2e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799552:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.799556:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c2e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799563:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c2e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799575:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343213000) 00010000:00010000:1.0:1762167016.799578:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.799583:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c2e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799589:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c2e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799600:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c2ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799605:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c2ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799610:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c2ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799616:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.799619:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c2ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799624:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c2ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799631:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167016.799633:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.799636:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c2ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799641:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c2ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.799670:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c2de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4259 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.799681:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343213000) 00010000:00010000:1.0:1762167016.799683:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.799686:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c2de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4259 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.799695:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9000, rc 0) 00000100:00100000:1.0:1762167016.799758:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:57113:x1847765452030976:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 644us (802us total) trans 0 rc 301/301 00000100:00100000:1.0:1762167016.799784:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20101 00000100:00100000:3.0:1762167016.803025:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.803106:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452031232 00000100:00100000:1.0:1762167016.803117:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452031232 00000100:00100000:1.0:1762167016.803327:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20102 00000100:00100000:1.0:1762167016.803338:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+898:57113:x1847765452031232:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.803358:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.803361:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762167016.803389:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d02be7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb0995 expref: 898 pid: 33893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.803412:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee343213000) 00010000:00010000:1.0:1762167016.803422:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167016.803439:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c2f3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4260 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.803579:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c2fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.803594:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c2fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.803604:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c2fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.803616:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.803623:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.803629:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.804207:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.804217:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.804225:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167016.804235:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:1.0:1762167016.804261:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c2fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.804267:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c2fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.804274:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c2fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.804279:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.804284:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c2fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.804292:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c2fa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.804302:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0a00) 00010000:00010000:1.0:1762167016.804304:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.804308:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c2fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.804324:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c2fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000004:00010000:1.0:1762167016.804334:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008251fc78 reply state 000000007cafb1aa transno 8589953194 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167016.804342:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762167016.804366:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c2f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4260 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.804381:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4260 expref: 899 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.804388:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0400) 00010000:00010000:1.0:1762167016.804391:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167016.804393:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8e00, rc 0) 00000100:00100000:1.0:1762167016.804471:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:57113:x1847765452031232:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1135us (1454us total) trans 8589953194 rc 0/0 00000100:00100000:1.0:1762167016.804480:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20102 00010000:00010000:0.0:1762167016.805790:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167016.805805:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167016.805811:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167016.805816:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167016.805825:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167016.805832:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167016.805844:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee2429d0300) 00010000:00010000:0.0:1762167016.805850:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167016.805856:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167016.805862:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c301 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:3.0:1762167016.807271:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.807328:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452031488 00000100:00100000:1.0:1762167016.807338:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452031488 00000100:00100000:1.0:1762167016.807393:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20103 00000100:00100000:1.0:1762167016.807403:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:57113:x1847765452031488:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.807426:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.807446:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c316 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4267 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.807531:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.807544:0:32138:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4260 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.807553:0:32138:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.807585:0:32138:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4260 expref: 900 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.807598:0:32138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4260 expref: 900 pid: 32138 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1762167016.807612:0:32138:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454552832:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167016.807695:0:32138:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485d80 going to sleep for 11 seconds 00000100:00100000:2.0:1762167016.810003:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.810019:0:32138:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32138:1847765454552832:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167016.810048:0:32138:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167016.810551:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452031616 00000100:00100000:0.0:1762167016.810559:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452031616 00010000:00010000:0.0:1762167016.810602:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4260 expref: 901 pid: 32138 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1762167016.810645:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7676 00000100:00100000:0.0:1762167016.810660:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:2361:x1847765452031616:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167016.810674:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167016.810681:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4260 expref: 901 pid: 32138 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1762167016.810693:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4260 expref: 901 pid: 32138 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1762167016.810715:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c308 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4260 expref: 901 pid: 32138 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1762167016.810733:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0400) 00010000:00010000:0.0:1762167016.810738:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167016.810746:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167016.810752:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167016.810810:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167016.810837:0:32138:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167016.810847:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167016.810864:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00000004:00080000:2.0:1762167016.811200:0:32138:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81f:0x0], index 0: 0 00010000:00010000:2.0:1762167016.811376:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167016.811385:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167016.811392:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167016.811398:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167016.811402:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167016.811409:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167016.811419:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0400) 00010000:00010000:2.0:1762167016.811422:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762167016.811426:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167016.811432:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c31d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167016.811481:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c316 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4267 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167016.811491:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0000) 00010000:00010000:2.0:1762167016.811493:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762167016.811497:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c316 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4267 expref: 901 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167016.811510:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9c00, rc 0) 00000100:00100000:0.0:1762167016.811570:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:2361:x1847765452031616:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 914us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167016.811585:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7676 00000100:00100000:2.0:1762167016.811681:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:57113:x1847765452031488:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 4278us (4414us total) trans 8589953195 rc 301/301 00000100:00100000:2.0:1762167016.811690:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20103 00000100:00100000:2.0:1762167016.813688:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167016.813846:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452031872 00000100:00100000:3.0:1762167016.813855:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452031872 00000100:00100000:2.0:1762167016.814152:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7399 00000100:00100000:2.0:1762167016.814163:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+899:57113:x1847765452031872:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167016.814732:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:57113:x1847765452031872:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 568us (1049us total) trans 8589953196 rc 0/0 00000100:00100000:2.0:1762167016.814740:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7399 00000100:00100000:3.0:1762167016.818061:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.818137:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452032128 00000100:00100000:2.0:1762167016.818148:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452032128 00000100:00100000:2.0:1762167016.818200:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7400 00000100:00100000:2.0:1762167016.818210:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+900:57113:x1847765452032128:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167016.818445:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:57113:x1847765452032128:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 234us (391us total) trans 8589953197 rc 0/0 00000100:00100000:2.0:1762167016.818453:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7400 00000100:00100000:0.0:1762167016.828165:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.828205:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452032256 00000100:00100000:1.0:1762167016.828215:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452032256 00000100:00100000:1.0:1762167016.828277:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20104 00000100:00100000:1.0:1762167016.828289:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+901:57117:x1847765452032256:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.828313:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.828351:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c32b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb426e expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.828410:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c332 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.828424:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.828436:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167016.828496:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1762167016.828500:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167016.828523:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.828546:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c32b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb426e expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.828560:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c332 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb426e expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.828569:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0a00) 00010000:00010000:1.0:1762167016.828573:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762167016.828577:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8200, rc 0) 00000100:00100000:1.0:1762167016.828637:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:57117:x1847765452032256:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 351us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167016.828646:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20104 00000100:00100000:0.0:1762167016.830334:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.830418:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452032384 00000100:00100000:1.0:1762167016.830427:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452032384 00000100:00100000:1.0:1762167016.830471:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20105 00000100:00100000:1.0:1762167016.830480:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:57117:x1847765452032384:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.830494:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.830509:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c339 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4275 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.830559:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c340 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830571:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830581:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830594:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c347 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830600:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830606:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830671:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830678:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c340 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830684:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c340 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830691:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.830695:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c340 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830703:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c340 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830713:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0a00) 00010000:00010000:1.0:1762167016.830716:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.830720:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830726:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830736:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830741:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c347 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830747:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830753:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.830755:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830793:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c347 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830802:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167016.830804:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.830808:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c347 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830814:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c347 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.830857:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c339 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4275 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.830867:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0a00) 00010000:00010000:1.0:1762167016.830870:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.830873:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c339 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4275 expref: 903 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.830883:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8c00, rc 0) 00000100:00100000:1.0:1762167016.830949:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:57117:x1847765452032384:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 469us (632us total) trans 0 rc 301/301 00000100:00100000:1.0:1762167016.830956:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20105 00000100:00100000:3.0:1762167016.834052:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.834113:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452032640 00000100:00100000:0.0:1762167016.834123:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452032640 00000100:00100000:0.0:1762167016.834183:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20106 00000100:00100000:0.0:1762167016.834195:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+902:57117:x1847765452032640:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167016.834216:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167016.834220:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762167016.834246:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c332 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb426e expref: 902 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.834263:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0a00) 00010000:00010000:0.0:1762167016.834274:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167016.834290:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c34e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb427c expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.834426:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c355 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.834439:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c355 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.834449:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c355 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.834463:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.834470:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.834476:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.834966:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x650:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.834975:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.834983:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167016.834993:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x650:0x0]: returning size 0 00010000:00010000:0.0:1762167016.835018:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c355 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.835025:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c355 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.835035:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c355 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.835041:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167016.835045:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c355 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.835052:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c355 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.835062:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167016.835065:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167016.835069:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c355 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.835074:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c355 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762167016.835087:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000090c29df6 reply state 00000000ea76c4e8 transno 8589953198 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167016.835095:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762167016.835120:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c34e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb427c expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.835136:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb427c expref: 903 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.835143:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x650:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167016.835146:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167016.835149:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3c00, rc 0) 00000100:00100000:0.0:1762167016.835228:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:57117:x1847765452032640:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 1035us (1185us total) trans 8589953198 rc 0/0 00000100:00100000:0.0:1762167016.835237:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20106 00010000:00010000:1.0:1762167016.836609:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.836620:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.836626:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.836633:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.836636:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.836644:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.836656:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff9ee381d9b900) 00010000:00010000:1.0:1762167016.836659:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.836663:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.836669:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c35c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167016.837367:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.837574:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452032896 00000100:00100000:0.0:1762167016.837582:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452032896 00000100:00100000:0.0:1762167016.837636:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20107 00000100:00100000:0.0:1762167016.837645:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:57117:x1847765452032896:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167016.837667:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167016.837685:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4283 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.837785:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.837797:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb427c expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.837805:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.837837:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb427c expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.837850:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb427c expref: 904 pid: 30817 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1762167016.837863:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359065500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454552960:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167016.837942:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee363992900 going to sleep for 11 seconds 00000100:00100000:0.0:1762167016.840060:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167016.840153:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452033024 00000100:00100000:1.0:1762167016.840154:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359065500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454552960:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167016.840163:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452033024 00010000:00010000:1.0:1762167016.840184:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167016.840196:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb427c expref: 905 pid: 30817 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1762167016.840248:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7677 00000100:00100000:3.0:1762167016.840258:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:2361:x1847765452033024:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167016.840271:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167016.840278:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb427c expref: 905 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1762167016.840290:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb427c expref: 905 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1762167016.840310:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c363 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb427c expref: 905 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1762167016.840341:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x650:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:3.0:1762167016.840346:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167016.840355:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167016.840362:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:3.0:1762167016.840436:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167016.840500:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:2361:x1847765452033024:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 243us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167016.840508:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7677 00010000:00010000:1.0:1762167016.840539:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.840558:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167016.840578:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x650:0x0]: returning size 0 00000004:00080000:1.0:1762167016.840803:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x822:0x0], index 1: 0 00010000:00010000:1.0:1762167016.840977:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.840985:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.841004:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.841010:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.841013:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.841020:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.841030:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x650:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:1.0:1762167016.841033:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167016.841036:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.841041:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c378 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.841095:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c371 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4283 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.841107:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2446b8f00) 00010000:00010000:1.0:1762167016.841109:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762167016.841114:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4283 expref: 904 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.841134:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3e00, rc 0) 00000100:00100000:1.0:1762167016.841181:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:57117:x1847765452032896:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 3537us (3817us total) trans 8589953199 rc 301/301 00000100:00100000:1.0:1762167016.841189:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20107 00000100:00100000:0.0:1762167016.842476:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167016.842536:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452033280 00000100:00100000:3.0:1762167016.842544:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452033280 00000100:00100000:3.0:1762167016.842591:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7401 00000100:00100000:3.0:1762167016.842600:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+903:57117:x1847765452033280:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167016.842918:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:57117:x1847765452033280:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 318us (451us total) trans 8589953200 rc 0/0 00000100:00100000:3.0:1762167016.842927:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7401 00000100:00100000:3.0:1762167016.845087:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.845189:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452033536 00000100:00100000:0.0:1762167016.845197:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452033536 00000100:00100000:2.0:1762167016.845269:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7402 00000100:00100000:2.0:1762167016.845282:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+904:57117:x1847765452033536:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167016.845528:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:57117:x1847765452033536:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 248us (446us total) trans 8589953201 rc 0/0 00000100:00100000:2.0:1762167016.845542:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7402 00000100:00100000:0.0:1762167016.852747:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.852878:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452033664 00000100:00100000:1.0:1762167016.852888:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452033664 00000100:00100000:1.0:1762167016.852942:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20108 00000100:00100000:1.0:1762167016.852950:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee359065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+905:57118:x1847765452033664:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.852970:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.852990:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb428a expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.853046:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c38d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.853057:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c38d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.853066:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c38d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167016.853117:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1762167016.853119:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 33 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167016.853135:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c38d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.853151:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb428a expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.853164:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c38d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb428a expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.853170:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167016.853172:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762167016.853174:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:1.0:1762167016.853219:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee359065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:57118:x1847765452033664:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 271us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167016.853224:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20108 00000100:00100000:0.0:1762167016.855017:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.855076:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452033792 00000100:00100000:1.0:1762167016.855085:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452033792 00000100:00100000:1.0:1762167016.855137:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20109 00000100:00100000:1.0:1762167016.855146:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:57118:x1847765452033792:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.855163:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.855180:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4291 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.855232:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c39b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855244:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c39b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855253:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c39b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855266:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c3a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855273:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855277:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855342:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c39b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855347:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c39b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855351:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c39b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855354:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.855357:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c39b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855363:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c39b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855371:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167016.855380:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.855383:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c39b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855387:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c39b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855395:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855398:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c3a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855401:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855404:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.855406:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855409:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c3a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855412:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff9ee2429d0500) 00010000:00010000:1.0:1762167016.855413:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.855415:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c3a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855418:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c3a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.855440:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c394 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4291 expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.855446:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167016.855448:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.855450:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4291 expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.855455:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:1.0:1762167016.855496:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:57118:x1847765452033792:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 352us (487us total) trans 0 rc 301/301 00000100:00100000:1.0:1762167016.855502:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20109 00000100:00100000:3.0:1762167016.857475:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.857531:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452034048 00000100:00100000:1.0:1762167016.857541:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452034048 00000100:00100000:1.0:1762167016.857600:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20110 00000100:00100000:1.0:1762167016.857610:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+906:57118:x1847765452034048:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.857627:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.857630:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762167016.857651:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c38d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb428a expref: 906 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.857663:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167016.857671:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167016.857682:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c3a9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4298 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.857810:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.857823:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.857832:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.857844:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.857850:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.857855:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.858322:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 3/1,0 mode: --/PR res: [0x200000404:0x651:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.858331:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.858339:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167016.858348:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x651:0x0]: returning size 0 00010000:00010000:1.0:1762167016.858375:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.858382:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.858388:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.858394:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.858398:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.858405:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.858419:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:1.0:1762167016.858430:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.858435:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.858441:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000004:00010000:1.0:1762167016.858452:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c9fdea5c reply state 0000000006aa516e transno 8589953202 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167016.858459:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762167016.858484:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c3a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4298 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.858500:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4298 expref: 907 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.858507:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x651:0x0].0x0 (ffff9ee2429d0700) 00010000:00010000:1.0:1762167016.858509:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167016.858511:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9e00, rc 0) 00000100:00100000:1.0:1762167016.858584:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:57118:x1847765452034048:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 976us (1115us total) trans 8589953202 rc 0/0 00000100:00100000:1.0:1762167016.858593:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20110 00010000:00010000:2.0:1762167016.859902:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.859916:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.859923:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.859932:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167016.859937:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.859951:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.859967:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff9ee2429d0800) 00010000:00010000:2.0:1762167016.859970:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167016.859975:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.859981:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c3b7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167016.860464:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.860592:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452034304 00000100:00100000:1.0:1762167016.860600:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452034304 00000100:00100000:1.0:1762167016.860666:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20111 00000100:00100000:1.0:1762167016.860680:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:57118:x1847765452034304:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.860703:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.860719:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c3cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb429f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.860828:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.860842:0:30817:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4298 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.860851:0:30817:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.860884:0:30817:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4298 expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.860898:0:30817:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4298 expref: 908 pid: 30817 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1762167016.860913:0:30817:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454553088:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167016.860983:0:30817:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167016.862340:0:30817:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30817:1847765454553088:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167016.862365:0:30817:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167016.862693:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.862852:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452034432 00000100:00100000:0.0:1762167016.862860:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452034432 00010000:00010000:0.0:1762167016.862895:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4298 expref: 909 pid: 30817 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1762167016.862936:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7678 00000100:00100000:0.0:1762167016.862946:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:2360:x1847765452034432:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167016.862960:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167016.862966:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4298 expref: 909 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1762167016.862978:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4298 expref: 909 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1762167016.862998:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c3be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4298 expref: 909 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1762167016.863014:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x651:0x0].0x0 (ffff9ee2429d0700) 00010000:00010000:0.0:1762167016.863019:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.863030:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.863037:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.863074:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167016.863096:0:30817:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.863111:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167016.863122:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:2360:x1847765452034432:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 177us (430us total) trans 0 rc 0/0 00000004:00200000:1.0:1762167016.863129:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x651:0x0]: returning size 0 00000100:00100000:0.0:1762167016.863134:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7678 00000004:00080000:1.0:1762167016.863301:0:30817:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x820:0x0], index 0: 0 00010000:00010000:1.0:1762167016.863484:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.863492:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.863499:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.863504:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.863508:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.863515:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.863531:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x651:0x0].0x0 (ffff9ee2429d0700) 00010000:00010000:1.0:1762167016.863534:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167016.863538:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.863543:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3d3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.863595:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c3cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb429f expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.863610:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0e00) 00010000:00010000:1.0:1762167016.863613:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762167016.863617:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c3cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb429f expref: 908 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.863630:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8c00, rc 0) 00000100:00100000:1.0:1762167016.863673:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:57118:x1847765452034304:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 2995us (3212us total) trans 8589953203 rc 301/301 00000100:00100000:1.0:1762167016.863681:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20111 00000100:00100000:3.0:1762167016.865206:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.865284:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452034688 00000100:00100000:2.0:1762167016.865292:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452034688 00000100:00100000:2.0:1762167016.865353:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7403 00000100:00100000:2.0:1762167016.865363:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+907:57118:x1847765452034688:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167016.865661:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:57118:x1847765452034688:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 295us (455us total) trans 8589953204 rc 0/0 00000100:00100000:2.0:1762167016.865670:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7403 00000100:00100000:0.0:1762167016.867199:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.867245:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452034944 00000100:00100000:2.0:1762167016.867253:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452034944 00000100:00100000:2.0:1762167016.867304:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7404 00000100:00100000:2.0:1762167016.867325:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+908:57118:x1847765452034944:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167016.867513:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:57118:x1847765452034944:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 200us (318us total) trans 8589953205 rc 0/0 00000100:00100000:2.0:1762167016.867525:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7404 00010000:00010000:2.0:1762167016.871902:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762167016.876057:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.876128:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452035072 00000100:00100000:1.0:1762167016.876138:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452035072 00000100:00100000:1.0:1762167016.876197:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20112 00000100:00100000:1.0:1762167016.876209:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+909:57119:x1847765452035072:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.876231:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.876251:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c3e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42a6 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.876309:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.876335:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.876345:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167016.876400:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1762167016.876403:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 34 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167016.876423:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.876444:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c3e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42a6 expref: 911 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.876460:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42a6 expref: 910 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.876468:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0e00) 00010000:00010000:1.0:1762167016.876471:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762167016.876474:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8e00, rc 0) 00000100:00100000:1.0:1762167016.876534:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:57119:x1847765452035072:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 329us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167016.876542:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20112 00000100:00100000:3.0:1762167016.878404:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.878501:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452035328 00000100:00100000:1.0:1762167016.878510:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452035328 00000100:00100000:1.0:1762167016.878565:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20113 00000100:00100000:1.0:1762167016.878574:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+910:57119:x1847765452035328:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.878594:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.878611:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c3ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42ad expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.878676:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.878688:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.878699:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.878715:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c3fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.878722:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.878729:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.878879:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c404 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.878888:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c404 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.878896:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c404 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167016.878907:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:1.0:1762167016.878999:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879008:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879015:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879022:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.879026:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879034:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879044:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0e00) 00010000:00010000:1.0:1762167016.879047:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.879051:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879056:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c3f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879067:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879073:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c3fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879077:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c3fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879082:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.879085:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c3fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879091:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c3fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879097:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee2429d0700) 00010000:00010000:1.0:1762167016.879100:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.879102:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c3fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879107:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c3fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.879145:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c3ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42ad expref: 913 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.879160:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c404 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42ad expref: 912 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.879167:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:1.0:1762167016.879170:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167016.879172:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9200, rc 0) 00000100:00100000:1.0:1762167016.879229:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:57119:x1847765452035328:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 656us (832us total) trans 8589953206 rc 0/0 00000100:00100000:1.0:1762167016.879237:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20113 00000100:00100000:0.0:1762167016.881537:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.881593:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452035584 00000100:00100000:1.0:1762167016.881602:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452035584 00000100:00100000:1.0:1762167016.881660:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20114 00000100:00100000:1.0:1762167016.881670:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+912:57119:x1847765452035584:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.881690:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.881708:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42b4 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.881811:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c419 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.881825:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.881835:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.881849:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c420 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.881860:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.881866:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.881984:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x650:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.881992:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.881999:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167016.882009:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x650:0x0]: returning size 0 00010000:00010000:1.0:1762167016.882094:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882101:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c419 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882107:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c419 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882112:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.882116:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c419 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882123:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c419 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882133:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0e00) 00010000:00010000:1.0:1762167016.882136:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.882140:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882146:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882155:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882160:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c420 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882166:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c420 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882171:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.882174:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c420 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882180:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c420 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882186:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167016.882188:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.882190:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c420 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882196:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c420 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167016.882231:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42b4 expref: 915 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.882249:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42b4 expref: 914 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.882255:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x650:0x0].0x0 (ffff9ee2429d0500) 00010000:00010000:1.0:1762167016.882258:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167016.882260:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9000, rc 0) 00000100:00100000:1.0:1762167016.882313:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:57119:x1847765452035584:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 644us (784us total) trans 8589953207 rc 0/0 00000100:00100000:1.0:1762167016.882330:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20114 00000100:00100000:3.0:1762167016.884067:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.884151:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452035712 00000100:00100000:0.0:1762167016.884160:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452035712 00000100:00100000:0.0:1762167016.884207:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17546 00000100:00100000:0.0:1762167016.884215:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765452035712:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167016.884232:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167016.884253:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c435 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42bb expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762167016.884278:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762167016.884294:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167016.884296:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167016.884305:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c435 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42bb expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167016.884335:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c435 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42bb expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167016.884347:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2800, rc 0) 00000100:00100000:0.0:1762167016.884402:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452035712:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 187us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167016.884409:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17546 00000100:00100000:0.0:1762167016.886201:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.886252:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452035840 00000100:00100000:1.0:1762167016.886260:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452035840 00000100:00100000:1.0:1762167016.886304:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17547 00000100:00100000:1.0:1762167016.886312:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2359:x1847765452035840:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.886337:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.886356:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c43c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42c2 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167016.886378:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x822:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167016.886393:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167016.886395:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167016.886403:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c43c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c2 expref: 34 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167016.886417:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c43c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c2 expref: 34 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167016.886434:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8400, rc 0) 00000100:00100000:1.0:1762167016.886482:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2359:x1847765452035840:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 170us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167016.886488:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17547 00000100:00100000:3.0:1762167016.888188:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.888257:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452036096 00000100:00100000:1.0:1762167016.888265:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452036096 00000100:00100000:1.0:1762167016.888334:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20115 00000100:00100000:1.0:1762167016.888347:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+914:57119:x1847765452036096:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.888370:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.888389:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c443 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42c9 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.888501:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c44a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.888516:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c44a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.888527:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c44a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167016.888543:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:1.0:1762167016.888668:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c443 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c9 expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.888685:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c44a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c9 expref: 916 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.888698:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:1.0:1762167016.888701:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762167016.888704:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9e00, rc 0) 00000100:00100000:1.0:1762167016.888756:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:57119:x1847765452036096:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 413us (572us total) trans 8589953208 rc 0/0 00000100:00100000:1.0:1762167016.888797:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20115 00000100:00100000:3.0:1762167016.944455:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.944533:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452036224 00000100:00100000:1.0:1762167016.944543:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452036224 00000100:00100000:1.0:1762167016.944599:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17548 00000100:00100000:1.0:1762167016.944611:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452036224:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167016.944658:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.944676:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c435 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42bb expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167016.944685:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167016.944687:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167016.944690:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.944722:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c435 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42bb expref: 18 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167016.944756:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c435 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42bb expref: 18 pid: 26444 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1762167016.944821:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454553216:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167016.944907:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485540 going to sleep for 11 seconds 00000100:00100000:1.0:1762167016.946440:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454553216:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167016.946459:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167016.946535:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.946620:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452036352 00000100:00100000:0.0:1762167016.946626:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452036352 00010000:00010000:0.0:1762167016.946656:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c435 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42bb expref: 19 pid: 26444 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1762167016.946700:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7679 00000100:00100000:0.0:1762167016.946709:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765452036352:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167016.946723:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167016.946744:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c435 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42bb expref: 19 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1762167016.946757:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c435 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42bb expref: 19 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1762167016.946838:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c435 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42bb expref: 19 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1762167016.946855:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167016.946857:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167016.946861:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.946870:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.946891:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167016.946935:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452036352:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 226us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167016.946942:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7679 00010000:00010000:1.0:1762167016.947048:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.947057:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.947075:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.947080:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.947085:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.947089:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167016.947092:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.947101:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.947109:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.947113:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c458 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167016.947157:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2361:x1847765452036224:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2549us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167016.947166:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17548 00000100:00100000:3.0:1762167016.948293:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.948373:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452036480 00000100:00100000:1.0:1762167016.948379:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452036480 00000100:00100000:1.0:1762167016.948417:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17549 00000100:00100000:1.0:1762167016.948426:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2358:x1847765452036480:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167016.948461:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.948475:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c43c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c2 expref: 34 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167016.948483:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167016.948485:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167016.948488:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.948518:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c43c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c2 expref: 34 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167016.948530:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c43c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c2 expref: 34 pid: 26444 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1762167016.948543:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454553344:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167016.948604:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485540 going to sleep for 11 seconds 00000100:00100000:1.0:1762167016.949815:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454553344:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167016.949818:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:1.0:1762167016.949838:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167016.949895:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452036608 00000100:00100000:3.0:1762167016.949941:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452036608 00010000:00010000:3.0:1762167016.949970:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c43c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c2 expref: 35 pid: 26444 timeout: 737 lvb_type: 1 00000100:00100000:3.0:1762167016.950000:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7680 00000100:00100000:3.0:1762167016.950009:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+35:2360:x1847765452036608:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167016.950021:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167016.950041:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c43c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c2 expref: 35 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:3.0:1762167016.950052:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c43c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c2 expref: 35 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:3.0:1762167016.950072:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c43c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c2 expref: 35 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:3.0:1762167016.950085:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167016.950087:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167016.950091:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167016.950104:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167016.950128:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167016.950149:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.950160:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167016.950175:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+34:2360:x1847765452036608:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 166us (359us total) trans 0 rc 0/0 00010000:00010000:1.0:1762167016.950182:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167016.950186:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7680 00010000:00010000:1.0:1762167016.950194:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.950200:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.950206:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167016.950211:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.950220:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.950234:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.950253:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c45f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167016.950327:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+33:2358:x1847765452036480:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 1901us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167016.950335:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17549 00000100:00100000:0.0:1762167016.951490:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.951536:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452036864 00000100:00100000:1.0:1762167016.951543:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452036864 00000100:00100000:1.0:1762167016.951585:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20116 00000100:00100000:1.0:1762167016.951594:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:57119:x1847765452036864:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167016.951646:0:32138:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167016.951666:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c404 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42ad expref: 916 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.951682:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:1.0:1762167016.951686:0:32138:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167016.951737:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.951749:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.951758:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00010000:1.0:1762167016.951900:0:32138:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000004b3a258 reply state 00000000ca9efe98 transno 8589953209 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000100:00100000:1.0:1762167016.951909:0:32138:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167016.951981:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:57119:x1847765452036864:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 388us (494us total) trans 8589953209 rc 0/0 00000100:00100000:1.0:1762167016.951989:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20116 00010000:00010000:1.0:1762167016.952681:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.952690:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.952696:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.952701:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167016.952705:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.952712:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.952723:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:1.0:1762167016.952726:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167016.952729:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167016.952734:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c466 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00000100:00100000:0.0:1762167016.953327:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.953507:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452036992 00000100:00100000:1.0:1762167016.953515:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452036992 00000100:00100000:1.0:1762167016.953570:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20117 00000100:00100000:1.0:1762167016.953584:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:57119:x1847765452036992:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.953602:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.953615:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c46d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42d0 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.953659:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c46d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d0 expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.953672:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c46d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d0 expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167016.953690:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:1.0:1762167016.953693:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167016.953695:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9c00, rc 0) 00000100:00100000:1.0:1762167016.953743:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:57119:x1847765452036992:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 160us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167016.953750:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20117 00000100:00100000:0.0:1762167016.954929:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.954965:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452037120 00000100:00100000:1.0:1762167016.954972:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452037120 00000100:00100000:1.0:1762167016.955009:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17550 00000100:00100000:1.0:1762167016.955018:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765452037120:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167016.955284:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765452037120:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 267us (357us total) trans 21474843721 rc 0/0 00000100:00100000:1.0:1762167016.955288:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17550 00000100:00100000:3.0:1762167016.956192:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.956249:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452037376 00000100:00100000:2.0:1762167016.956255:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452037376 00000100:00100000:2.0:1762167016.956294:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7405 00000100:00100000:2.0:1762167016.956304:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:57119:x1847765452037376:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167016.956369:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x64f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c44a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c9 expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167016.956403:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.956415:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c46d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d0 expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167016.956424:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.956459:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c46d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d0 expref: 917 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167016.956472:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c46d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d0 expref: 917 pid: 32138 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1762167016.956485:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454553472:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167016.956550:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246e2ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1762167016.957544:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454553472:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167016.957567:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167016.957801:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.957873:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452037504 00000100:00100000:0.0:1762167016.957879:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452037504 00010000:00010000:0.0:1762167016.957909:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c46d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d0 expref: 918 pid: 32138 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1762167016.957943:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7681 00000100:00100000:0.0:1762167016.957951:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:2361:x1847765452037504:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167016.957964:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167016.957970:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c46d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d0 expref: 918 pid: 32138 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1762167016.957980:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c46d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d0 expref: 918 pid: 32138 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1762167016.957998:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c46d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d0 expref: 918 pid: 32138 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1762167016.958012:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:0.0:1762167016.958016:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167016.958024:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167016.958035:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:0.0:1762167016.958062:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167016.958108:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:2361:x1847765452037504:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 158us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167016.958116:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7681 00010000:00010000:3.0:1762167016.958247:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167016.958254:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167016.958270:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167016.958280:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42b4 expref: 916 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167016.958348:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167016.958376:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42b4 expref: 916 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167016.958388:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42b4 expref: 916 pid: 30817 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1762167016.958405:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454553600:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167016.958459:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9480 going to sleep for 11 seconds 00000100:00100000:2.0:1762167016.959374:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454553600:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167016.959388:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167016.959618:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.959815:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452037632 00000100:00100000:2.0:1762167016.959821:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452037632 00010000:00010000:2.0:1762167016.959846:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42b4 expref: 917 pid: 30817 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1762167016.959869:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7682 00000100:00100000:2.0:1762167016.959877:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:2360:x1847765452037632:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167016.959889:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167016.959894:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42b4 expref: 917 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1762167016.959905:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42b4 expref: 917 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1762167016.959923:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c427 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42b4 expref: 917 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1762167016.959936:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x650:0x0].0x0 (ffff9ee2429d0500) 00010000:00010000:2.0:1762167016.959940:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.959948:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.959954:0:7415:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.959983:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167016.960029:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+916:2360:x1847765452037632:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 150us (410us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167016.960032:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167016.960039:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7682 00010000:00010000:3.0:1762167016.960047:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:3.0:1762167016.960479:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454553728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762167016.960522:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167016.960557:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762167016.960607:0:6543:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454553728 00000100:00100000:1.0:1762167016.960612:0:6543:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454553728 00000100:00080000:0.0:1762167016.960653:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762167016.960674:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1762167016.960683:0:6543:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454553728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762167016.960758:0:6543:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee348254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454553728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167016.960804:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1762167016.961176:0:30820:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843715 gen 2 00000004:00080000:2.0:1762167016.961183:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550c000, transno 21474843696 00000004:00080000:2.0:1762167016.961197:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24732f100, transno 21474843697 00000004:00080000:2.0:1762167016.961200:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550ea00, transno 21474843698 00000004:00080000:2.0:1762167016.961202:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24732ed80, transno 21474843699 00000004:00080000:2.0:1762167016.961204:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550d880, transno 21474843700 00000004:00080000:2.0:1762167016.961207:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550f480, transno 21474843701 00000004:00080000:2.0:1762167016.961209:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550f800, transno 21474843702 00000004:00080000:2.0:1762167016.961212:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550e680, transno 21474843703 00000004:00080000:2.0:1762167016.961215:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550dc00, transno 21474843704 00000004:00080000:2.0:1762167016.961218:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550fb80, transno 21474843705 00000004:00080000:2.0:1762167016.961221:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550e300, transno 21474843706 00000004:00080000:2.0:1762167016.961224:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550ce00, transno 21474843707 00000004:00080000:2.0:1762167016.961227:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550c700, transno 21474843708 00000004:00080000:2.0:1762167016.961230:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550d500, transno 21474843709 00000004:00080000:2.0:1762167016.961232:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550d180, transno 21474843710 00000004:00080000:2.0:1762167016.961234:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9500, transno 21474843711 00000004:00080000:2.0:1762167016.961236:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550f100, transno 21474843712 00000004:00080000:2.0:1762167016.961238:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee24550df80, transno 21474843713 00000004:00080000:2.0:1762167016.961240:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e628a80, transno 21474843714 00000004:00080000:2.0:1762167016.961242:0:30820:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee36e628380, transno 21474843715 00000100:00100000:2.0:1762167016.961249:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454553728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167016.961338:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454553856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167016.961376:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167016.961403:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c6c0 going to sleep for 11 seconds 00000004:00080000:3.0:1762167016.961413:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 10 changes, 10 in progress, 0 in flight, 10 done 00000100:00100000:0.0:1762167016.961424:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454553856 00000100:00100000:0.0:1762167016.961429:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454553856 00000100:00100000:0.0:1762167016.961500:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1762167016.961511:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454553856:12345-0@lo:1000:mdt_rdpg00_000.0 00000004:00080000:3.0:1762167016.961536:0:30840:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 10 changes, 0 in progress, 0 in flight, 10 done 00000100:00080000:1.0:1762167016.961589:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762167016.961609:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454553856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 100us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167016.961616:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1762167016.961668:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454553856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762167016.961820:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953210 00000100:00100000:2.0:1762167016.961891:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454553984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167016.961920:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167016.961938:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1762167016.961983:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454553984 00000100:00100000:0.0:1762167016.961988:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454553984 00000100:00100000:0.0:1762167016.962020:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1762167016.962031:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:30820:x1847765454553984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167016.962182:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454553984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 154us (260us total) trans 21474843722 rc 0/0 00000100:00100000:0.0:1762167016.962189:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:2.0:1762167016.962249:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454553984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762167016.962301:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953211 00010000:00010000:2.0:1762167016.962357:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962368:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962376:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962383:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167016.962386:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962393:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962406:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x650:0x0].0x0 (ffff9ee2429d0500) 00010000:00010000:2.0:1762167016.962409:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167016.962414:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962419:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c47b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962437:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962443:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962448:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962453:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167016.962455:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962459:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962465:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:2.0:1762167016.962468:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167016.962470:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962475:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c474 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167016.962486:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee2429d0100) 00010000:00010000:2.0:1762167016.962489:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167016.962494:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c44a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42c9 expref: 918 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167016.962580:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee381d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:57119:x1847765452037376:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6278us (6389us total) trans 8589953212 rc 0/0 00000100:00100000:2.0:1762167016.962589:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7405 00000020:00080000:2.0:1762167016.962593:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762167016.964231:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.964301:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452037760 00000100:00100000:0.0:1762167016.964310:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452037760 00000100:00100000:0.0:1762167016.964373:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20118 00000100:00100000:0.0:1762167016.964383:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+917:57119:x1847765452037760:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167016.964408:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167016.964427:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c482 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42d7 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.964470:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c482 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d7 expref: 918 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.964480:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c482 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d7 expref: 918 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.964495:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167016.964498:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167016.964500:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2800, rc 0) 00000100:00100000:0.0:1762167016.964546:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:57119:x1847765452037760:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 166us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167016.964553:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20118 00000100:00100000:3.0:1762167016.966199:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.966252:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452038016 00000100:00100000:2.0:1762167016.966259:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452038016 00000100:00100000:2.0:1762167016.966311:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7406 00000100:00100000:2.0:1762167016.966331:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+918:57119:x1847765452038016:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167016.966526:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2435a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:57119:x1847765452038016:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 196us (338us total) trans 8589953213 rc 0/0 00000100:00100000:2.0:1762167016.966533:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7406 00000100:00100000:1.0:1762167016.967391:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167016.967455:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452038272 00000100:00100000:2.0:1762167016.967460:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452038272 00000100:00100000:2.0:1762167016.967503:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7407 00000100:00100000:2.0:1762167016.967511:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+919:57119:x1847765452038272:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167016.967652:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:57119:x1847765452038272:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 140us (262us total) trans 8589953214 rc 0/0 00000100:00100000:2.0:1762167016.967660:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7407 00000100:00100000:1.0:1762167016.968891:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.968977:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452038400 00000100:00100000:0.0:1762167016.968984:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452038400 00000100:00100000:0.0:1762167016.969027:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20119 00000100:00100000:0.0:1762167016.969037:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:57119:x1847765452038400:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167016.969054:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167016.969071:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42de expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.969136:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c490 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969150:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969161:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969176:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c497 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969182:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969188:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969279:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c49e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x650:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969287:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c49e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969294:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c49e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167016.969332:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x650:0x0]: returning size 0 00000004:00200000:0.0:1762167016.969336:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167016.969352:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c49e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969362:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c49e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969370:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969376:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c490 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969387:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c490 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969393:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167016.969397:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c490 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969404:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c490 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969414:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0e00) 00010000:00010000:0.0:1762167016.969417:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167016.969421:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c490 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969427:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c490 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969439:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969445:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c497 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969451:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c497 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969454:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167016.969457:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c497 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969461:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c497 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969470:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167016.969472:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167016.969475:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c497 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969479:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c497 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.969505:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42de expref: 922 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.969519:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c49e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42de expref: 921 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.969526:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x650:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167016.969528:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167016.969530:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3a00, rc 0) 00000100:00100000:0.0:1762167016.969596:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:57119:x1847765452038400:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 561us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167016.969606:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20119 00000100:00100000:3.0:1762167016.971289:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.971355:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452038656 00000100:00100000:0.0:1762167016.971363:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452038656 00000100:00100000:0.0:1762167016.971417:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20120 00000100:00100000:0.0:1762167016.971427:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:57119:x1847765452038656:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:0.0:1762167016.971476:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762167016.971501:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c49e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x650:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42de expref: 921 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.971523:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x650:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167016.971537:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8e00/0xf915a5bdf3d0c3e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42a6 expref: 920 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.971545:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0e00) 00010000:00010000:0.0:1762167016.971551:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167016.971578:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.971589:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.971598:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.971610:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.971616:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.971622:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.971730:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4b3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.971738:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.971745:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972030:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 3/0,1 mode: --/PW res: [0x200000404:0x650:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972039:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x650:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972047:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x650:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972053:0:30817:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x650:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972059:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x650:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972064:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x650:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972090:0:30817:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762167016.972106:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4b3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972111:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4b3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972117:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4b3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972123:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee343ef3600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167016.972127:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4b3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972134:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4b3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x650:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.972137:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167016.972146:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x650:0x0].0x0 (ffff9ee35075dc00) 00010000:00010000:2.0:1762167016.972147:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x650:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972152:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1762167016.972158:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4b3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.972159:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee37f4d9c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167016.972167:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x650:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972169:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4b3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x650:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.972187:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x650:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.972199:0:5743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x650:0x0].0x0 (ffff9ee35075dc00) 00010000:00010000:2.0:1762167016.972202:0:5743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762167016.972205:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 1/0,0 mode: --/PW res: [0x200000404:0x650:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972209:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.972211:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4ba lrc: 0/0,0 mode: --/PW res: [0x200000404:0x650:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972225:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4a5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972233:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972237:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167016.972240:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972246:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.972250:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167016.972254:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167016.972255:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee381d9b100) 00010000:00010000:2.0:1762167016.972257:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167016.972261:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167016.972266:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.972272:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000004:00010000:0.0:1762167016.972286:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008994ae10 reply state 0000000003b3b7cc transno 8589953215 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167016.972294:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762167016.972376:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:57119:x1847765452038656:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 949us (1091us total) trans 8589953215 rc 0/0 00000100:00100000:0.0:1762167016.972384:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20120 00010000:00010000:2.0:1762167016.973296:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.973307:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.973326:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.973332:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167016.973336:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.973343:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.973355:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff9ee35075d000) 00010000:00010000:2.0:1762167016.973357:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167016.973361:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167016.973367:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4ac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167016.980800:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.980895:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452038784 00000100:00100000:0.0:1762167016.980906:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452038784 00000100:00100000:0.0:1762167016.980962:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20121 00000100:00100000:0.0:1762167016.980973:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+920:57120:x1847765452038784:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167016.981000:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167016.981022:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42e5 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.981085:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.981096:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.981105:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167016.981154:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:0.0:1762167016.981156:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 33 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167016.981176:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.981198:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee37f4d9c00/0xf915a5bdf3d0c4c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42e5 expref: 922 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.981218:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42e5 expref: 921 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.981227:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee35075dc00) 00010000:00010000:0.0:1762167016.981230:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762167016.981234:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee343ef3600, rc 0) 00000100:00100000:0.0:1762167016.981310:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:57120:x1847765452038784:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 336us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167016.981329:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20121 00000100:00100000:1.0:1762167016.983219:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.983290:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452039040 00000100:00100000:0.0:1762167016.983299:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452039040 00000100:00100000:0.0:1762167016.983356:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20122 00000100:00100000:0.0:1762167016.983363:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+921:57120:x1847765452039040:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167016.983377:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167016.983390:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42ec expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.983441:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c4d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983450:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983458:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983467:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c4dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983472:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983475:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983577:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c4e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983585:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983592:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167016.983601:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:0.0:1762167016.983705:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983712:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c4d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983719:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c4d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983724:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167016.983729:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c4d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983736:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c4d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983747:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee35075dc00) 00010000:00010000:0.0:1762167016.983750:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167016.983754:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c4d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983779:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c4d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983791:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c4dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983794:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c4dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983797:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c4dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983800:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167016.983802:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c4dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983805:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c4dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983811:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee381d9b100) 00010000:00010000:0.0:1762167016.983813:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167016.983815:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c4dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983818:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c4dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.983851:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c4cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42ec expref: 924 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.983865:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42ec expref: 923 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.983872:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167016.983874:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167016.983877:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3200, rc 0) 00000100:00100000:0.0:1762167016.983933:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:57120:x1847765452039040:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 569us (721us total) trans 8589953216 rc 0/0 00000100:00100000:0.0:1762167016.983941:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20122 00000100:00100000:1.0:1762167016.985744:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.985817:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452039296 00000100:00100000:0.0:1762167016.985827:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452039296 00000100:00100000:0.0:1762167016.985884:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20123 00000100:00100000:0.0:1762167016.985894:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+923:57120:x1847765452039296:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167016.985920:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167016.985938:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c4f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42f3 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.986005:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986018:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986028:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986044:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c500 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986050:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986057:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986177:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x651:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986186:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986193:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167016.986202:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x651:0x0]: returning size 0 00010000:00010000:0.0:1762167016.986289:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986296:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986301:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986307:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167016.986311:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986331:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986343:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee35075dc00) 00010000:00010000:0.0:1762167016.986346:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167016.986350:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986357:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c4f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986372:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986383:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c500 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986388:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c500 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986392:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3480ed600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167016.986395:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c500 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986401:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c500 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986409:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff9ee381d9b600) 00010000:00010000:0.0:1762167016.986411:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167016.986414:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c500 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986420:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3480ed600/0xf915a5bdf3d0c500 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.986465:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c4f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42f3 expref: 926 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.986478:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42f3 expref: 925 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.986486:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x651:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:0.0:1762167016.986488:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167016.986490:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee359390a00, rc 0) 00000100:00100000:0.0:1762167016.986554:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:57120:x1847765452039296:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 661us (830us total) trans 8589953217 rc 0/0 00000100:00100000:0.0:1762167016.986562:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20123 00000100:00100000:3.0:1762167016.988371:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167016.988427:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452039424 00000100:00100000:1.0:1762167016.988437:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452039424 00000100:00100000:1.0:1762167016.988492:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17551 00000100:00100000:1.0:1762167016.988502:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452039424:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167016.988521:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167016.988546:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c515 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb42fa expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167016.988574:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x820:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167016.988592:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167016.988595:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167016.988604:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42fa expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167016.988619:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42fa expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167016.988630:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:1.0:1762167016.988687:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765452039424:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 188us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167016.988695:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17551 00000100:00100000:1.0:1762167016.990552:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167016.990635:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452039680 00000100:00100000:0.0:1762167016.990644:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452039680 00000100:00100000:0.0:1762167016.990707:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20124 00000100:00100000:0.0:1762167016.990717:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+925:57120:x1847765452039680:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167016.990739:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167016.990758:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d0c51c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4301 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.990892:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c523 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.990905:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c523 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:0.0:1762167016.990915:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c523 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:0.0:1762167016.990926:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:0.0:1762167016.991042:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d0c51c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4301 expref: 928 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.991057:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c523 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4301 expref: 927 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167016.991064:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167016.991067:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762167016.991070:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36f35fe00, rc 0) 00000100:00100000:0.0:1762167016.991122:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:57120:x1847765452039680:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 407us (576us total) trans 8589953218 rc 0/0 00000100:00100000:0.0:1762167016.991129:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20124 00000100:00100000:0.0:1762167017.037114:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.037292:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452039808 00000100:00100000:1.0:1762167017.037302:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452039808 00000100:00100000:1.0:1762167017.037385:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17552 00000100:00100000:1.0:1762167017.037395:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765452039808:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167017.037413:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167017.037439:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c531 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4308 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762167017.037466:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81f:0x0] initial LVB size: 0, mtime: 0x690888e9, atime: 0x690888e9, ctime: 0x690888e9, blocks: 0x1 00010000:00010000:1.0:1762167017.037486:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167017.037488:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167017.037498:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4308 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167017.037516:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4308 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167017.037530:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b8800, rc 0) 00000100:00100000:1.0:1762167017.037593:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452039808:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 198us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.037601:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17552 00000100:00100000:3.0:1762167017.049284:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.049958:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452039936 00000100:00100000:1.0:1762167017.049969:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452039936 00000100:00100000:1.0:1762167017.050032:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17553 00000100:00100000:1.0:1762167017.050043:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765452039936:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167017.050089:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.050108:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c531 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4308 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167017.050117:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167017.050119:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167017.050122:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.050157:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4308 expref: 20 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167017.050171:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c531 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4308 expref: 20 pid: 26444 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1762167017.050187:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454554112:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167017.050277:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485480 going to sleep for 11 seconds 00000100:00100000:0.0:1762167017.052893:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.052940:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452040064 00000100:00100000:2.0:1762167017.052949:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452040064 00010000:00010000:2.0:1762167017.052985:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c531 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4308 expref: 21 pid: 26444 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1762167017.053006:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454554112:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167017.053032:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.053035:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7683 00000100:00100000:2.0:1762167017.053050:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+21:2361:x1847765452040064:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167017.053065:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167017.053085:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c531 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4308 expref: 21 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:2.0:1762167017.053099:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c531 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4308 expref: 21 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:2.0:1762167017.053121:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8800/0xf915a5bdf3d0c531 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4308 expref: 21 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:2.0:1762167017.053134:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.053136:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.053140:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.053148:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.053189:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167017.053233:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765452040064:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 187us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.053241:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7683 00010000:00010000:1.0:1762167017.053426:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.053436:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.053460:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.053468:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.053475:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.053482:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167017.053486:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.053494:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.053512:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.053519:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c538 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167017.053582:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765452039936:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 3540us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.053591:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17553 00000100:00100000:0.0:1762167017.054747:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.054864:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452040192 00000100:00100000:1.0:1762167017.054871:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452040192 00000100:00100000:1.0:1762167017.054913:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17554 00000100:00100000:1.0:1762167017.054922:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765452040192:12345-192.168.203.35@tcp:1:lfs.0 00010000:00010000:1.0:1762167017.054974:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.054992:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c515 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42fa expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167017.054998:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167017.055000:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167017.055003:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.055033:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42fa expref: 19 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167017.055049:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42fa expref: 19 pid: 26444 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1762167017.055061:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454554240:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167017.055113:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee350485480 going to sleep for 11 seconds 00000100:00100000:1.0:1762167017.056235:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454554240:192.168.203.35@tcp:104: 00010000:00010000:1.0:1762167017.056253:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.056682:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.056882:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452040320 00000100:00100000:3.0:1762167017.056889:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452040320 00010000:00010000:3.0:1762167017.056920:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42fa expref: 20 pid: 26444 timeout: 737 lvb_type: 1 00000100:00100000:3.0:1762167017.056955:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7684 00000100:00100000:3.0:1762167017.056965:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765452040320:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167017.056978:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167017.057001:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42fa expref: 20 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:3.0:1762167017.057013:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42fa expref: 20 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:3.0:1762167017.057033:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c515 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42fa expref: 20 pid: 26444 timeout: 737 lvb_type: 1 00010000:00010000:3.0:1762167017.057046:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.057048:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.057053:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.057063:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.057092:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167017.057118:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.057129:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167017.057130:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765452040320:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 165us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.057146:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7684 00010000:00010000:1.0:1762167017.057161:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.057171:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.057179:0:26444:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.057185:0:26444:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167017.057190:0:26444:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.057197:0:26444:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.057211:0:26444:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.057219:0:26444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c53f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167017.057297:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765452040192:12345-192.168.203.35@tcp:1:lfs.0 Request processed in 2376us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.057309:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17554 00000100:00100000:0.0:1762167017.058565:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.058920:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452040576 00000100:00100000:1.0:1762167017.058948:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452040576 00000100:00100000:1.0:1762167017.059035:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20125 00000100:00100000:1.0:1762167017.059047:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:57120:x1847765452040576:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167017.059125:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167017.059156:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c4e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42ec expref: 927 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.059179:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:1.0:1762167017.059185:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167017.059235:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.059253:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.059264:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00010000:1.0:1762167017.059448:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000070d1bc25 reply state 00000000105c5e49 transno 8589953219 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167017.059458:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762167017.059583:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:57120:x1847765452040576:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 537us (1019us total) trans 8589953219 rc 0/0 00000100:00100000:1.0:1762167017.059591:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20125 00010000:00010000:1.0:1762167017.061142:0:3280:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.061161:0:3280:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.061168:0:3280:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.061174:0:3280:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167017.061179:0:3280:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.061186:0:3280:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.061202:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:1.0:1762167017.061206:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167017.061210:0:3280:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.061217:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c546 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:0.0:1762167017.061563:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.061617:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452040704 00000100:00100000:1.0:1762167017.061629:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452040704 00000100:00100000:1.0:1762167017.061686:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17555 00000100:00100000:1.0:1762167017.061698:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765452040704:12345-192.168.203.35@tcp:2:lfs.0 00000100:00100000:1.0:1762167017.061963:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765452040704:12345-192.168.203.35@tcp:2:lfs.0 Request processed in 266us (402us total) trans 21474843723 rc 0/0 00000100:00100000:1.0:1762167017.061972:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17555 00000100:00100000:0.0:1762167017.067008:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.067113:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452040960 00000100:00100000:2.0:1762167017.067123:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452040960 00000100:00100000:2.0:1762167017.067181:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7408 00000100:00100000:2.0:1762167017.067191:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:57120:x1847765452040960:12345-192.168.203.35@tcp:35:lfs.0 00000004:00010000:2.0:1762167017.067269:0:30820:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x64f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c523 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4301 expref: 927 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.067306:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.067331:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c482 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d7 expref: 927 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.067340:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.067373:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c482 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d7 expref: 927 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.067387:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c482 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d7 expref: 927 pid: 30817 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1762167017.067403:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454554368:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167017.067488:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167017.068686:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454554368:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167017.068704:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:0.0:1762167017.068990:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.069101:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452041088 00000100:00100000:3.0:1762167017.069150:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452041088 00010000:00010000:3.0:1762167017.069181:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c482 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d7 expref: 928 pid: 30817 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1762167017.069222:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7685 00000100:00100000:3.0:1762167017.069232:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:2361:x1847765452041088:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167017.069248:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167017.069255:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c482 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d7 expref: 928 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1762167017.069266:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c482 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d7 expref: 928 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1762167017.069285:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c482 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42d7 expref: 928 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1762167017.069303:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:3.0:1762167017.069309:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167017.069329:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167017.069337:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167017.069362:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167017.069410:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:2361:x1847765452041088:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 179us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.069418:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7685 00010000:00010000:2.0:1762167017.069476:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.069484:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.069503:0:30820:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.069514:0:30820:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42f3 expref: 926 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.069522:0:30820:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.069546:0:30820:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42f3 expref: 926 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.069556:0:30820:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42f3 expref: 926 pid: 30817 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1762167017.069569:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454554496:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167017.069628:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167017.071037:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:30820:1847765454554496:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167017.071056:0:30820:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:1.0:1762167017.071486:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.071613:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452041216 00000100:00100000:3.0:1762167017.071620:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452041216 00010000:00010000:3.0:1762167017.071651:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42f3 expref: 927 pid: 30817 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1762167017.071680:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7686 00000100:00100000:3.0:1762167017.071691:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:2360:x1847765452041216:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167017.071704:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167017.071709:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42f3 expref: 927 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1762167017.071720:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42f3 expref: 927 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1762167017.071738:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee359390a00/0xf915a5bdf3d0c507 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42f3 expref: 927 pid: 30817 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1762167017.071750:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x651:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:3.0:1762167017.071755:0:29775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167017.071794:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167017.071803:0:29775:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30820 initiator: MDT0 00010000:00010000:3.0:1762167017.071830:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167017.071866:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+926:2360:x1847765452041216:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 176us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.071873:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7686 00010000:00010000:2.0:1762167017.071937:0:30820:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.071944:0:30820:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30820 initiator: MDT0 00000100:00100000:2.0:1762167017.072352:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454554624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167017.072398:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167017.072425:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167017.072453:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454554624 00000100:00100000:0.0:1762167017.072463:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454554624 00000100:00100000:0.0:1762167017.072512:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:0.0:1762167017.072521:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454554624:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167017.072592:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454554624:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.072597:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:2.0:1762167017.072621:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454554624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167017.072650:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454554752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167017.072667:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167017.072686:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2424b9480 going to sleep for 11 seconds 00000100:00100000:0.0:1762167017.072712:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454554752 00000100:00100000:0.0:1762167017.072716:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454554752 00000100:00100000:0.0:1762167017.072741:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:0.0:1762167017.072748:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454554752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167017.072834:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:30820:x1847765454554752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.072840:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1762167017.072853:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454554752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167017.072882:0:30820:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454554880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762167017.072904:0:30820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167017.072926:0:30820:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee24262c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167017.072952:0:6544:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454554880 00000100:00100000:0.0:1762167017.072958:0:6544:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454554880 00000100:00100000:0.0:1762167017.072988:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1762167017.072996:0:6544:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454554880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762167017.073055:0:6544:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:30820:x1847765454554880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.073062:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1762167017.073071:0:30820:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:30820:1847765454554880:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762167017.073112:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953220 00000001:00080000:2.0:1762167017.073179:0:30820:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589953221 00010000:00010000:2.0:1762167017.073215:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073223:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073230:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073237:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167017.073241:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073247:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073259:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x651:0x0].0x0 (ffff9ee381d9b200) 00010000:00010000:2.0:1762167017.073262:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167017.073266:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073272:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d200/0xf915a5bdf3d0c554 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073289:0:30820:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073295:0:30820:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073300:0:30820:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073305:0:30820:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167017.073308:0:30820:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073325:0:30820:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073333:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167017.073335:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762167017.073338:0:30820:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073342:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d800/0xf915a5bdf3d0c54d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30820 initiator: MDT0 00010000:00010000:2.0:1762167017.073353:0:30820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b900) 00010000:00010000:2.0:1762167017.073355:0:30820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762167017.073361:0:30820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c523 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x64f:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4301 expref: 928 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.073452:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:57120:x1847765452040960:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 6263us (6453us total) trans 8589953222 rc 0/0 00000100:00100000:2.0:1762167017.073460:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7408 00000020:00080000:2.0:1762167017.073464:0:30820:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762167017.074738:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.074823:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452041344 00000100:00100000:0.0:1762167017.074829:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452041344 00000100:00100000:0.0:1762167017.074876:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20126 00000100:00100000:0.0:1762167017.074886:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+927:57120:x1847765452041344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167017.074903:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167017.074924:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d0c55b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb430f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.074975:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d0c55b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb430f expref: 928 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.074993:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d0c55b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb430f expref: 928 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.075010:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167017.075013:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167017.075015:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36f35f800, rc 0) 00000100:00100000:0.0:1762167017.075066:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:57120:x1847765452041344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 182us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.075072:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20126 00000100:00100000:0.0:1762167017.076070:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.076148:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452041344 00000100:00100000:1.0:1762167017.076155:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452041344 00000004:00100000:1.0:1762167017.076251:0:30817:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) @@@ lock 00000000ba62b98d cookie 0x779cfd37a0fb430f req@ffff9ee37f795880 x1847765452041344/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:48/0 lens 376/0 e 0 to 0 dl 1762167028 ref 1 fl New:/602/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00010000:1.0:1762167017.076264:0:30817:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) ### hpreq resend ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d0c55b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb430f expref: 928 pid: 30817 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167017.076296:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 116 00000100:00100000:1.0:1762167017.076305:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:57120:x1847765452041344:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167017.076327:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167017.076334:0:30817:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue()) @@@ found existing lock cookie 0xf915a5bdf3d0c55b req@ffff9ee37f795880 x1847765452041344/t0(0) o101->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:48/0 lens 376/0 e 0 to 0 dl 1762167028 ref 1 fl Interpret:H/602/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1762167017.076371:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d0c55b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb430f expref: 928 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.076398:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167017.076401:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762167017.076404:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36f35f800, rc 0) 00000100:00100000:1.0:1762167017.076446:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:57120:x1847765452041344:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 140us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.076452:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 116 00000100:00100000:3.0:1762167017.078161:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.078213:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452041728 00000100:00100000:2.0:1762167017.078222:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452041728 00000100:00100000:2.0:1762167017.078272:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7409 00000100:00100000:2.0:1762167017.078281:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+928:57120:x1847765452041728:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167017.078510:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+929:57120:x1847765452041728:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 229us (354us total) trans 8589953223 rc 0/0 00000100:00100000:2.0:1762167017.078518:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7409 00000100:00100000:0.0:1762167017.079672:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.079718:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452041984 00000100:00100000:2.0:1762167017.079725:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452041984 00000100:00100000:2.0:1762167017.079794:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7410 00000100:00100000:2.0:1762167017.079804:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+929:57120:x1847765452041984:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:2.0:1762167017.079961:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+930:57120:x1847765452041984:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 157us (303us total) trans 8589953224 rc 0/0 00000100:00100000:2.0:1762167017.079973:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7410 00000100:00100000:0.0:1762167017.081194:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.081277:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452042112 00000100:00100000:1.0:1762167017.081284:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452042112 00000100:00100000:1.0:1762167017.081336:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20127 00000100:00100000:1.0:1762167017.081345:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+930:57120:x1847765452042112:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:1.0:1762167017.081360:0:30817:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167017.081378:0:30817:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4316 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.081428:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c569 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081441:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081451:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081475:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c570 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081482:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081488:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081575:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c577 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x651:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081582:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081593:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000004:00200000:1.0:1762167017.081618:0:30817:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x651:0x0]: returning size 0 00000004:00200000:1.0:1762167017.081621:0:30817:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1762167017.081635:0:30817:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081644:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081651:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081657:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c569 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081663:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c569 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081668:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167017.081672:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c569 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081679:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c569 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081688:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee35075dc00) 00010000:00010000:1.0:1762167017.081692:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167017.081696:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c569 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081701:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081711:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081716:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c570 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081721:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081725:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167017.081727:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081732:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c570 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081737:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff9ee2429d0f00) 00010000:00010000:1.0:1762167017.081739:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167017.081741:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c570 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081746:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c570 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.081805:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9000/0xf915a5bdf3d0c562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4316 expref: 932 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.081823:0:30817:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c577 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4316 expref: 931 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.081831:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x651:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167017.081833:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762167017.081836:0:30817:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9c00, rc 0) 00000100:00100000:1.0:1762167017.081889:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:57120:x1847765452042112:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 545us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.081895:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20127 00000100:00100000:3.0:1762167017.084668:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.084725:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452042368 00000100:00100000:1.0:1762167017.084736:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452042368 00000100:00100000:1.0:1762167017.084813:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20128 00000100:00100000:1.0:1762167017.084823:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:57120:x1847765452042368:12345-192.168.203.35@tcp:36:lfs.0 00010000:00010000:1.0:1762167017.084870:0:30817:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762167017.084898:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9c00/0xf915a5bdf3d0c577 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x651:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4316 expref: 931 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.084917:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x651:0x0].0x0 (ffff9ee2429d0600) 00010000:00010000:1.0:1762167017.084933:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee343ef3600/0xf915a5bdf3d0c4c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb42e5 expref: 930 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.084941:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee35075dc00) 00010000:00010000:1.0:1762167017.084946:0:30817:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167017.084968:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c57e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.084979:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c57e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.084989:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c57e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.084998:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085004:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085009:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085101:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c58c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085108:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c58c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085115:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c58c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085371:0:30817:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x651:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085380:0:30817:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x651:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085387:0:30817:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x651:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085393:0:30817:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x651:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085398:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x651:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085404:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x651:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085428:0:30817:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762167017.085446:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c58c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085452:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c58c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085457:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c58c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085462:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:1.0:1762167017.085466:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c58c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085472:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c58c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x651:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085480:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x651:0x0].0x0 (ffff9ee2429d0c00) 00010000:00010000:1.0:1762167017.085483:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1762167017.085486:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c58c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085492:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9e00/0xf915a5bdf3d0c58c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x651:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085524:0:30817:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c57e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.085530:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167017.085530:0:30817:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c57e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.085540:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x651:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085545:0:30817:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c57e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.085554:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b9200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167017.085556:0:30817:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167017.085561:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x651:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085562:0:30817:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c57e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.085580:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x651:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085580:0:30817:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c57e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085603:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee2429d0900) 00010000:00010000:2.0:1762167017.085605:0:5744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x651:0x0].0x0 (ffff9ee2429d0c00) 00010000:00010000:1.0:1762167017.085606:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762167017.085611:0:30817:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c57e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.085612:0:5744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762167017.085618:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x651:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30817 initiator: MDT0 00010000:00010000:1.0:1762167017.085620:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8c00/0xf915a5bdf3d0c57e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.085633:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9200/0xf915a5bdf3d0c593 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x651:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30817 initiator: MDT0 00000004:00010000:1.0:1762167017.085639:0:30817:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008cdf44e2 reply state 000000002cc47885 transno 8589953225 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 00000100:00100000:1.0:1762167017.085648:0:30817:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762167017.085651:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.085654:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.085656:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762167017.085726:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:57120:x1847765452042368:12345-192.168.203.35@tcp:36:lfs.0 Request processed in 904us (1066us total) trans 8589953225 rc 0/0 00000100:00100000:1.0:1762167017.085733:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20128 00010000:00010000:2.0:1762167017.087608:0:3279:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.087623:0:3279:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.087630:0:3279:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.087635:0:3279:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee3819b8400 already unused, calling callback (ffffffffc2129310) 00010000:00010000:2.0:1762167017.087640:0:3279:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.087648:0:3279:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.087660:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff9ee2429d0700) 00010000:00010000:2.0:1762167017.087664:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762167017.087668:0:3279:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00010000:00010000:2.0:1762167017.087673:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8400/0xf915a5bdf3d0c585 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 00000100:00100000:3.0:1762167017.146639:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.148873:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452042496 00000100:00100000:2.0:1762167017.148890:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452042496 00000100:00100000:2.0:1762167017.148974:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 124 00000100:00100000:2.0:1762167017.148986:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+9:57132:x1847765452042496:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1762167017.149008:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167017.149029:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee381f1d800/0xf915a5bdf3d0c59a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb431d expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.149058:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee381f1d800/0xf915a5bdf3d0c59a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb431d expref: 10 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.149070:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee381f1d800/0xf915a5bdf3d0c59a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb431d expref: 10 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.149079:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d800, rc 0) 00000100:00100000:2.0:1762167017.149160:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:57132:x1847765452042496:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 176us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.149171:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 124 00000100:00100000:0.0:1762167017.152934:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.153047:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452042624 00000100:00100000:2.0:1762167017.153058:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452042624 00000100:00100000:2.0:1762167017.153159:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 125 00000100:00100000:2.0:1762167017.153171:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee2451ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:57132:x1847765452042624:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1762167017.154054:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee2451ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:57132:x1847765452042624:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 882us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.154064:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 125 00000100:00100000:0.0:1762167017.155716:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.155791:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452042752 00000100:00100000:2.0:1762167017.155802:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452042752 00000100:00100000:2.0:1762167017.155853:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 126 00000100:00100000:2.0:1762167017.155864:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:57132:x1847765452042752:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1762167017.156272:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:57132:x1847765452042752:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 404us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.156281:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 126 00000100:00100000:0.0:1762167017.159653:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.159899:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452042880 00000100:00100000:2.0:1762167017.159911:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452042880 00000100:00100000:2.0:1762167017.159970:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 127 00000100:00100000:2.0:1762167017.159999:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:57136:x1847765452042880:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1762167017.160430:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:57136:x1847765452042880:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 447us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.160440:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 127 00000100:00100000:0.0:1762167017.167649:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.167742:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452043008 00000100:00100000:3.0:1762167017.167754:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452043008 00000100:00100000:3.0:1762167017.167848:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 128 00000100:00100000:3.0:1762167017.167858:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:57136:x1847765452043008:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762167017.168125:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:57136:x1847765452043008:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 268us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.168133:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 128 00000100:00100000:0.0:1762167017.170243:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.170532:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452043136 00000100:00100000:2.0:1762167017.170544:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452043136 00000100:00100000:2.0:1762167017.170600:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 129 00000100:00100000:2.0:1762167017.170610:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+10:57132:x1847765452043136:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1762167017.170628:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167017.170648:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee381f1d200/0xf915a5bdf3d0c5a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4347 expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.170677:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee381f1d200/0xf915a5bdf3d0c5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4347 expref: 11 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.170687:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee381f1d200/0xf915a5bdf3d0c5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4347 expref: 11 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.170696:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d200, rc 0) 00000100:00100000:2.0:1762167017.170752:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:57132:x1847765452043136:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 144us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.170794:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 129 00000100:00100000:0.0:1762167017.172515:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.172599:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452043264 00000100:00100000:2.0:1762167017.172607:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452043264 00000100:00100000:2.0:1762167017.172656:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 130 00000100:00100000:2.0:1762167017.172665:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:57132:x1847765452043264:12345-192.168.203.35@tcp:256:mount.lustre.0 20000000:01000000:2.0:1762167017.172686:0:30815:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1762167017.172708:0:30815:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1762167017.172711:0:30815:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1762167017.174105:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:57132:x1847765452043264:12345-192.168.203.35@tcp:256:mount.lustre.0 Request processed in 1434us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.174117:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 130 00000100:00100000:0.0:1762167017.176261:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.176348:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452043392 00000100:00100000:2.0:1762167017.176359:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452043392 00000100:00100000:2.0:1762167017.176416:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 131 00000100:00100000:2.0:1762167017.176426:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+11:57132:x1847765452043392:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1762167017.176442:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167017.176460:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee381f1c600/0xf915a5bdf3d0c5a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb434e expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.176496:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee381f1c600/0xf915a5bdf3d0c5a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb434e expref: 12 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.176508:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee381f1c600/0xf915a5bdf3d0c5a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb434e expref: 12 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.176517:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c600, rc 0) 00000100:00100000:2.0:1762167017.176577:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:57132:x1847765452043392:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 151us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.176584:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 131 00000100:00100000:0.0:1762167017.178121:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.178200:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452043520 00000100:00100000:3.0:1762167017.178207:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452043520 00000100:00100000:3.0:1762167017.178262:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 132 00000100:00100000:3.0:1762167017.178272:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343f68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:57132:x1847765452043520:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1762167017.178467:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343f68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:57132:x1847765452043520:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 196us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.178476:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 132 00000100:00100000:0.0:1762167017.180209:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.180275:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452043648 00000100:00100000:3.0:1762167017.180283:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452043648 00000100:00100000:3.0:1762167017.180341:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 133 00000100:00100000:3.0:1762167017.180351:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:57132:x1847765452043648:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1762167017.180743:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:57132:x1847765452043648:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 393us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.180751:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 133 00000100:00100000:0.0:1762167017.182452:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.182611:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452043776 00000100:00100000:3.0:1762167017.182619:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452043776 00000100:00100000:3.0:1762167017.182680:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 134 00000100:00100000:3.0:1762167017.182691:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24249b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:57142:x1847765452043776:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762167017.182961:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24249b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:57142:x1847765452043776:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 267us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.182970:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 134 00000100:00100000:0.0:1762167017.184386:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.184449:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452043904 00000100:00100000:2.0:1762167017.184456:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452043904 00000100:00100000:2.0:1762167017.184505:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 135 00000100:00100000:2.0:1762167017.184515:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:57142:x1847765452043904:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1762167017.184695:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:57142:x1847765452043904:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 181us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.184703:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 135 00000100:00100000:0.0:1762167017.188026:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.188656:0:30817:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452044032 00000100:00100000:1.0:1762167017.188668:0:30817:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452044032 00000100:00100000:1.0:1762167017.188722:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20129 00000100:00100000:1.0:1762167017.188731:0:30817:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1847765452044032:12345-192.168.203.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1762167017.188789:0:30817:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from 12bd460f-a83f-41fe-92df-dfba4795e03a@192.168.203.35@tcp t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:1.0:1762167017.188846:0:30817:0:(genops.c:1402:class_connect()) connect: client 12bd460f-a83f-41fe-92df-dfba4795e03a, cookie 0xf915a5bdf3d0c5af 00000004:00100000:1.0:1762167017.188887:0:30817:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:01000000:1.0:1762167017.189113:0:30817:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee34aa0e300 00000100:00080000:1.0:1762167017.189152:0:30817:0:(import.c:65:import_set_state_nolock()) ffff9ee2448d9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762167017.189230:0:30817:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+6:2357:x1847765452044032:12345-192.168.203.35@tcp:38:mount.lustre.0 Request processed in 499us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.189238:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20129 00000100:00100000:0.0:1762167017.190975:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.191020:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.191092:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452044160 00000100:00100000:3.0:1762167017.191100:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452044160 00000100:00100000:3.0:1762167017.191179:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452044288 00000100:00100000:3.0:1762167017.191183:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452044288 00000100:00100000:3.0:1762167017.191228:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20130 00000100:00100000:2.0:1762167017.191244:0:33893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20131 00000100:00100000:2.0:1762167017.191262:0:33893:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12bd460f-a83f-41fe-92df-dfba4795e03a+7:57132:x1847765452044288:12345-192.168.203.35@tcp:41:mount.lustre.0 00000100:00080000:0.0:1762167017.191283:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1762167017.191323:0:33893:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 5505024 pending 0 free 2258632704 avail 2256535552 00000100:00100000:3.0:1762167017.191358:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12bd460f-a83f-41fe-92df-dfba4795e03a+7:0:x1847765452044160:12345-192.168.203.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1762167017.191376:0:31205:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 5505024 pending 0 free 2258632704 avail 2256535552 00000100:00100000:2.0:1762167017.191432:0:33893:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12bd460f-a83f-41fe-92df-dfba4795e03a+7:57132:x1847765452044288:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 178us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.191442:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12bd460f-a83f-41fe-92df-dfba4795e03a+7:0:x1847765452044160:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 203us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.191443:0:33893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20131 00000100:00100000:3.0:1762167017.191458:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20130 00000100:00100000:0.0:1762167017.192685:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.192751:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452044416 00000100:00100000:2.0:1762167017.192758:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452044416 00000100:00100000:2.0:1762167017.192829:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20132 00000100:00100000:2.0:1762167017.192838:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12bd460f-a83f-41fe-92df-dfba4795e03a+6:57132:x1847765452044416:12345-192.168.203.35@tcp:40:mount.lustre.0 00000100:00100000:2.0:1762167017.192903:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12bd460f-a83f-41fe-92df-dfba4795e03a+6:57132:x1847765452044416:12345-192.168.203.35@tcp:40:mount.lustre.0 Request processed in 66us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.192911:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20132 00000100:00100000:0.0:1762167017.194651:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.194693:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.194725:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.194814:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452044544 00000100:00100000:1.0:1762167017.194831:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452044544 00000100:00100000:2.0:1762167017.194887:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452044800 00000100:00100000:2.0:1762167017.194898:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452044800 00000100:00100000:1.0:1762167017.194907:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452044672 00000100:00100000:1.0:1762167017.194914:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452044672 00000100:00100000:1.0:1762167017.194964:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17556 00000100:00100000:1.0:1762167017.194979:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2357:x1847765452044544:12345-192.168.203.35@tcp:8:mount.lustre.0 00000100:00100000:3.0:1762167017.194989:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17557 00000100:00100000:2.0:1762167017.194991:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7411 00000100:00100000:3.0:1762167017.195010:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1847765452044672:12345-192.168.203.35@tcp:8:mount.lustre.0 00000100:00100000:2.0:1762167017.195011:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:12bd460f-a83f-41fe-92df-dfba4795e03a+6:57132:x1847765452044800:12345-192.168.203.35@tcp:33:mount.lustre.0 00010000:00080000:1.0:1762167017.195044:0:26444:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from 12bd460f-a83f-41fe-92df-dfba4795e03a@192.168.203.35@tcp t0 exp 0000000000000000 cur 637 last 0 00010000:00080000:3.0:1762167017.195062:0:6533:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from 12bd460f-a83f-41fe-92df-dfba4795e03a@192.168.203.35@tcp t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:1.0:1762167017.195117:0:26444:0:(genops.c:1402:class_connect()) connect: client 12bd460f-a83f-41fe-92df-dfba4795e03a, cookie 0xf915a5bdf3d0c5b6 00000020:00000080:3.0:1762167017.195118:0:6533:0:(genops.c:1402:class_connect()) connect: client 12bd460f-a83f-41fe-92df-dfba4795e03a, cookie 0xf915a5bdf3d0c5bd 00002000:00100000:1.0:1762167017.195137:0:26444:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli 12bd460f-a83f-41fe-92df-dfba4795e03a/ffff9ee2448da000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000004:00200000:2.0:1762167017.195139:0:33886:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00002000:00100000:3.0:1762167017.195145:0:6533:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli 12bd460f-a83f-41fe-92df-dfba4795e03a/ffff9ee37f2a6800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1762167017.195188:0:26444:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:3.0:1762167017.195189:0:6533:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1762167017.195271:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:12bd460f-a83f-41fe-92df-dfba4795e03a+6:57132:x1847765452044800:12345-192.168.203.35@tcp:33:mount.lustre.0 Request processed in 261us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.195281:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7411 00000020:01000000:3.0:1762167017.195367:0:6533:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee36f323700 00000020:01000000:1.0:1762167017.195369:0:26444:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee247a17800 00002000:00080000:1.0:1762167017.195385:0:26444:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:2.0:1762167017.195465:0:6533:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1762167017.195506:0:6533:0:(import.c:65:import_set_state_nolock()) ffff9ee24530a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1762167017.195558:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12bd460f-a83f-41fe-92df-dfba4795e03a+6:2357:x1847765452044672:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 549us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.195567:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17557 00000100:00080000:1.0:1762167017.195939:0:26444:0:(import.c:65:import_set_state_nolock()) ffff9ee2448df000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762167017.196023:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12bd460f-a83f-41fe-92df-dfba4795e03a+6:2357:x1847765452044544:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 1044us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.196033:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17556 00000100:00100000:0.0:1762167017.312993:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.313089:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452044928 00000100:00100000:2.0:1762167017.313100:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452044928 00000100:00100000:2.0:1762167017.313163:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 136 00000100:00100000:2.0:1762167017.313173:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+12:57168:x1847765452044928:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1762167017.313193:0:30815:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167017.313211:0:30815:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee381f1dc00/0xf915a5bdf3d0c5c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4378 expref: -99 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.313238:0:30815:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee381f1dc00/0xf915a5bdf3d0c5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4378 expref: 13 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.313250:0:30815:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee381f1dc00/0xf915a5bdf3d0c5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4378 expref: 13 pid: 30815 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.313258:0:30815:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1dc00, rc 0) 00000100:00100000:2.0:1762167017.313345:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:57168:x1847765452044928:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 172us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.313353:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 136 00000100:00100000:0.0:1762167017.314866:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.315077:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452045056 00000100:00100000:3.0:1762167017.315084:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452045056 00000100:00100000:3.0:1762167017.315134:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 137 00000100:00100000:3.0:1762167017.315144:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:57168:x1847765452045056:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1762167017.315299:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:57168:x1847765452045056:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 155us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.315320:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 137 00000100:00100000:0.0:1762167017.316714:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.316789:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452045184 00000100:00100000:3.0:1762167017.316797:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452045184 00000100:00100000:3.0:1762167017.316840:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 138 00000100:00100000:3.0:1762167017.316849:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:57168:x1847765452045184:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1762167017.317050:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:57168:x1847765452045184:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 200us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.317059:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 138 00000100:00100000:0.0:1762167017.318523:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.318720:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452045312 00000100:00100000:3.0:1762167017.318727:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452045312 00000100:00100000:2.0:1762167017.318814:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 139 00000100:00100000:2.0:1762167017.318828:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:57172:x1847765452045312:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1762167017.319171:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:57172:x1847765452045312:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 345us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.319180:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 139 00000100:00100000:0.0:1762167017.325742:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.325875:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452045440 00000100:00100000:2.0:1762167017.325886:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452045440 00000100:00100000:2.0:1762167017.325946:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 140 00000100:00100000:2.0:1762167017.325956:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:57172:x1847765452045440:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1762167017.326239:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:57172:x1847765452045440:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 281us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.326248:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 140 00000100:00100000:0.0:1762167017.327646:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.327750:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452045568 00000100:00100000:3.0:1762167017.327758:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452045568 00000100:00100000:3.0:1762167017.327828:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 141 00000100:00100000:3.0:1762167017.327840:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+13:57168:x1847765452045568:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762167017.327855:0:30813:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167017.327873:0:30813:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee347922600/0xf915a5bdf3d0c5cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb43a2 expref: -99 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.327900:0:30813:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee347922600/0xf915a5bdf3d0c5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43a2 expref: 14 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.327910:0:30813:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee347922600/0xf915a5bdf3d0c5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43a2 expref: 14 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.327919:0:30813:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922600, rc 0) 00000100:00100000:3.0:1762167017.327967:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:57168:x1847765452045568:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 131us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.327977:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 141 00000100:00100000:0.0:1762167017.331049:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.331142:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452045696 00000100:00100000:3.0:1762167017.331156:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452045696 00000100:00100000:3.0:1762167017.331217:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 142 00000100:00100000:3.0:1762167017.331227:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:57168:x1847765452045696:12345-192.168.203.35@tcp:256:mount.lustre.0 20000000:01000000:3.0:1762167017.331256:0:30813:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1762167017.331286:0:30813:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1762167017.331288:0:30813:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1762167017.332283:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:57168:x1847765452045696:12345-192.168.203.35@tcp:256:mount.lustre.0 Request processed in 1049us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.332295:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 142 00000100:00100000:0.0:1762167017.334554:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.334616:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452045824 00000100:00100000:3.0:1762167017.334627:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452045824 00000100:00100000:3.0:1762167017.334689:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 143 00000100:00100000:3.0:1762167017.334699:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+14:57168:x1847765452045824:12345-192.168.203.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762167017.334718:0:30813:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167017.334741:0:30813:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ee347922e00/0xf915a5bdf3d0c5d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb43a9 expref: -99 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.334797:0:30813:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ee347922e00/0xf915a5bdf3d0c5d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43a9 expref: 15 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.334809:0:30813:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ee347922e00/0xf915a5bdf3d0c5d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43a9 expref: 15 pid: 30813 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.334818:0:30813:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922e00, rc 0) 00000100:00100000:3.0:1762167017.334879:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:57168:x1847765452045824:12345-192.168.203.35@tcp:101:mount.lustre.0 Request processed in 181us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.334886:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 143 00000100:00100000:0.0:1762167017.336649:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.336708:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452045952 00000100:00100000:3.0:1762167017.336716:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452045952 00000100:00100000:3.0:1762167017.336793:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 144 00000100:00100000:3.0:1762167017.336803:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:57168:x1847765452045952:12345-192.168.203.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1762167017.336930:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:57168:x1847765452045952:12345-192.168.203.35@tcp:501:mount.lustre.0 Request processed in 128us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.336939:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 144 00000100:00100000:0.0:1762167017.338184:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.338258:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452046080 00000100:00100000:3.0:1762167017.338269:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452046080 00000100:00100000:3.0:1762167017.338337:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 145 00000100:00100000:3.0:1762167017.338349:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:57168:x1847765452046080:12345-192.168.203.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1762167017.338614:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:57168:x1847765452046080:12345-192.168.203.35@tcp:503:mount.lustre.0 Request processed in 266us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.338623:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 145 00000100:00100000:0.0:1762167017.340040:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.340201:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452046208 00000100:00100000:3.0:1762167017.340215:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452046208 00000100:00100000:3.0:1762167017.340272:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 146 00000100:00100000:3.0:1762167017.340282:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:57177:x1847765452046208:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762167017.340566:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:57177:x1847765452046208:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 284us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.340575:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 146 00000100:00100000:0.0:1762167017.341708:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.341789:0:30813:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452046336 00000100:00100000:3.0:1762167017.341795:0:30813:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452046336 00000100:00100000:3.0:1762167017.341841:0:30813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 147 00000100:00100000:3.0:1762167017.341850:0:30813:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:57177:x1847765452046336:12345-192.168.203.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1762167017.342028:0:30813:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d2907fd-ec36-418b-9892-2b7af8c34cb2+15:57177:x1847765452046336:12345-192.168.203.35@tcp:502:llog_process_th.0 Request processed in 179us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.342036:0:30813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 147 00000100:00100000:0.0:1762167017.343396:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.343474:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452046464 00000100:00100000:2.0:1762167017.343481:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452046464 00000100:00100000:2.0:1762167017.343516:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20133 00000100:00100000:2.0:1762167017.343522:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2357:x1847765452046464:12345-192.168.203.35@tcp:38:mount.lustre.0 00010000:00080000:2.0:1762167017.343547:0:32138:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from b4e369e7-58c9-4605-91cc-bb6f1ca9b31b@192.168.203.35@tcp t0 exp 0000000000000000 cur 638 last 0 00000020:00000080:2.0:1762167017.343588:0:32138:0:(genops.c:1402:class_connect()) connect: client b4e369e7-58c9-4605-91cc-bb6f1ca9b31b, cookie 0xf915a5bdf3d0c5d9 00000004:00100000:2.0:1762167017.343606:0:32138:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:01000000:2.0:1762167017.343704:0:32138:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee34aa0e300 00000100:00080000:2.0:1762167017.343738:0:32138:0:(import.c:65:import_set_state_nolock()) ffff9ee24530e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1762167017.343815:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+6:2357:x1847765452046464:12345-192.168.203.35@tcp:38:mount.lustre.0 Request processed in 291us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.343823:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20133 00000100:00100000:0.0:1762167017.345479:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.345530:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.345602:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452046592 00000100:00100000:2.0:1762167017.345602:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452046720 00000100:00100000:2.0:1762167017.345614:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452046720 00000100:00100000:3.0:1762167017.345615:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452046592 00000100:00100000:2.0:1762167017.345684:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20134 00000100:00100000:3.0:1762167017.345693:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20135 00000100:00100000:2.0:1762167017.345698:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:57168:x1847765452046720:12345-192.168.203.35@tcp:41:mount.lustre.0 00000100:00080000:0.0:1762167017.345699:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762167017.345708:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:0:x1847765452046592:12345-192.168.203.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1762167017.345745:0:31205:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 8912896 pending 0 free 2258632704 avail 2256535552 00000004:00000024:2.0:1762167017.345745:0:32138:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 8912896 pending 0 free 2258632704 avail 2256535552 00000100:00100000:3.0:1762167017.345846:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:0:x1847765452046592:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 141us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.345849:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:57168:x1847765452046720:12345-192.168.203.35@tcp:41:mount.lustre.0 Request processed in 155us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.345859:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20135 00000100:00100000:2.0:1762167017.345866:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20134 00000100:00100000:0.0:1762167017.346884:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.346951:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452046848 00000100:00100000:2.0:1762167017.346957:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452046848 00000100:00100000:2.0:1762167017.346989:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20136 00000100:00100000:2.0:1762167017.346997:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+6:57168:x1847765452046848:12345-192.168.203.35@tcp:40:mount.lustre.0 00000100:00100000:2.0:1762167017.347053:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+6:57168:x1847765452046848:12345-192.168.203.35@tcp:40:mount.lustre.0 Request processed in 56us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.347065:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20136 00000100:00100000:0.0:1762167017.348182:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.348215:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.348248:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452046976 00000100:00100000:1.0:1762167017.348256:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452046976 00000100:00100000:2.0:1762167017.348268:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452047104 00000100:00100000:2.0:1762167017.348274:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452047104 00000100:00100000:1.0:1762167017.348295:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17558 00000100:00100000:1.0:1762167017.348304:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2357:x1847765452046976:12345-192.168.203.35@tcp:8:mount.lustre.0 00000100:00100000:2.0:1762167017.348323:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17559 00000100:00100000:2.0:1762167017.348332:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1847765452047104:12345-192.168.203.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1762167017.348343:0:26444:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from b4e369e7-58c9-4605-91cc-bb6f1ca9b31b@192.168.203.35@tcp t0 exp 0000000000000000 cur 638 last 0 00010000:00080000:2.0:1762167017.348353:0:6533:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from b4e369e7-58c9-4605-91cc-bb6f1ca9b31b@192.168.203.35@tcp t0 exp 0000000000000000 cur 638 last 0 00000020:00000080:2.0:1762167017.348396:0:6533:0:(genops.c:1402:class_connect()) connect: client b4e369e7-58c9-4605-91cc-bb6f1ca9b31b, cookie 0xf915a5bdf3d0c5e7 00000020:00000080:1.0:1762167017.348405:0:26444:0:(genops.c:1402:class_connect()) connect: client b4e369e7-58c9-4605-91cc-bb6f1ca9b31b, cookie 0xf915a5bdf3d0c5e0 00002000:00100000:2.0:1762167017.348410:0:6533:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli b4e369e7-58c9-4605-91cc-bb6f1ca9b31b/ffff9ee24530c800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1762167017.348414:0:26444:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli b4e369e7-58c9-4605-91cc-bb6f1ca9b31b/ffff9ee2448d8000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1762167017.348423:0:6533:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1762167017.348423:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00002000:00100000:1.0:1762167017.348425:0:26444:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1762167017.348485:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452047232 00000100:00100000:3.0:1762167017.348490:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452047232 00000020:01000000:1.0:1762167017.348556:0:26444:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee247a17800 00002000:00080000:1.0:1762167017.348567:0:26444:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:01000000:2.0:1762167017.348572:0:6533:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff9ee36f323700 00000100:00100000:3.0:1762167017.348577:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7412 00002000:00080000:2.0:1762167017.348588:0:6533:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1762167017.348590:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+6:57168:x1847765452047232:12345-192.168.203.35@tcp:33:mount.lustre.0 00000100:00080000:1.0:1762167017.348602:0:26444:0:(import.c:65:import_set_state_nolock()) ffff9ee34a53c000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1762167017.348610:0:6533:0:(import.c:65:import_set_state_nolock()) ffff9ee245308000 : changing import state from RECOVER to FULL 00000004:00200000:3.0:1762167017.348668:0:30820:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000100:00100000:2.0:1762167017.348669:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+6:2357:x1847765452047104:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 332us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.348670:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+6:2357:x1847765452046976:12345-192.168.203.35@tcp:8:mount.lustre.0 Request processed in 360us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.348687:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17558 00000100:00100000:2.0:1762167017.348694:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17559 00000100:00100000:3.0:1762167017.348725:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+6:57168:x1847765452047232:12345-192.168.203.35@tcp:33:mount.lustre.0 Request processed in 137us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.348747:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7412 00000100:00100000:0.0:1762167017.410079:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.410190:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452047360 00000100:00100000:2.0:1762167017.410201:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452047360 00000100:00100000:2.0:1762167017.410274:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20137 00000100:00100000:2.0:1762167017.410285:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+6:57194:x1847765452047360:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:2.0:1762167017.410305:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167017.410341:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0c5ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb43d3 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.410417:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c5f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167017.410434:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167017.410447:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167017.410506:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:2.0:1762167017.410510:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167017.410534:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167017.410560:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1cc00/0xf915a5bdf3d0c5ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43d3 expref: 8 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.410580:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c000/0xf915a5bdf3d0c5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43d3 expref: 7 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.410589:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:2.0:1762167017.410591:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762167017.410595:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c000, rc 0) 00000100:00100000:2.0:1762167017.410660:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:57194:x1847765452047360:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 378us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.410668:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20137 00000100:00100000:0.0:1762167017.412874:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.412933:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452047616 00000100:00100000:3.0:1762167017.412944:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452047616 00000100:00100000:3.0:1762167017.413004:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20138 00000100:00100000:3.0:1762167017.413014:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:57194:x1847765452047616:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167017.413037:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167017.413056:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c5fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb43da expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.413122:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c603 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413135:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413145:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413158:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c60a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413165:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c60a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413170:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c60a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413290:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413297:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c603 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413335:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c603 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413341:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167017.413345:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c603 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413355:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c603 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413367:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167017.413370:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167017.413374:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c603 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413380:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c603 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413393:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c60a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413398:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c60a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413403:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c60a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413408:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167017.413410:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c60a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413414:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c60a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413420:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee345a77a00) 00010000:00010000:3.0:1762167017.413422:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167017.413424:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c60a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413429:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c60a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.413462:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c5fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43da expref: 8 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.413471:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167017.413473:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762167017.413476:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c5fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43da expref: 8 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.413484:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923c00, rc 0) 00000100:00100000:3.0:1762167017.413548:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:57194:x1847765452047616:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 535us (683us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167017.413555:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20138 00000100:00100000:0.0:1762167017.416637:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.417283:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452047744 00000100:00100000:3.0:1762167017.417296:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452047744 00000100:00100000:3.0:1762167017.417383:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20139 00000100:00100000:3.0:1762167017.417394:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:57194:x1847765452047744:12345-192.168.203.35@tcp:34:lfs.0 00010000:00010000:3.0:1762167017.417480:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c611 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417497:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417512:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417527:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c618 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417534:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417542:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417654:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417662:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417669:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762167017.417703:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00000004:00200000:3.0:1762167017.417708:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167017.417719:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417749:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417754:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c611 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417779:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c611 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417787:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167017.417792:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c611 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417800:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c611 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417813:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167017.417818:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167017.417823:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c611 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417830:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c611 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417847:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417853:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c618 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417859:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c618 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417864:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347922000 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167017.417867:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c618 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417873:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c618 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417880:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee345a77e00) 00010000:00010000:3.0:1762167017.417883:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167017.417886:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c618 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417891:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c618 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417908:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417914:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417921:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417926:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923800 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167017.417929:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417935:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417942:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:3.0:1762167017.417944:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167017.417947:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.417952:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c61f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00000100:00100000:3.0:1762167017.418045:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:57194:x1847765452047744:12345-192.168.203.35@tcp:34:lfs.0 Request processed in 649us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.418054:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20139 00000100:00100000:0.0:1762167017.436793:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.436931:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452047872 00000100:00100000:3.0:1762167017.436941:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452047872 00000100:00100000:3.0:1762167017.436999:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20140 00000100:00100000:3.0:1762167017.437009:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+930:57197:x1847765452047872:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167017.437032:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167017.437053:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb43e1 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.437120:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c62d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.437135:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c62d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.437145:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c62d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762167017.437204:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:3.0:1762167017.437207:0:31205:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:3.0:1762167017.437227:0:31205:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c62d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.437265:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43e1 expref: 932 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.437286:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922000/0xf915a5bdf3d0c62d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43e1 expref: 931 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.437294:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167017.437297:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762167017.437301:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922000, rc 0) 00000100:00100000:3.0:1762167017.437386:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:57197:x1847765452047872:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 378us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.437394:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20140 00000100:00100000:0.0:1762167017.439804:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.439849:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452048128 00000100:00100000:3.0:1762167017.439859:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452048128 00000100:00100000:3.0:1762167017.439926:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20141 00000100:00100000:3.0:1762167017.439937:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:57197:x1847765452048128:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167017.439956:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167017.439974:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb43e8 expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.440080:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c63b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440095:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c63b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440108:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c63b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440126:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c642 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440132:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440139:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440245:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c63b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440252:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c63b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440258:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c63b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440263:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167017.440267:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c63b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440274:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c63b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440289:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167017.440292:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167017.440298:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c63b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440303:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c63b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440326:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440332:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c642 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440337:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440351:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167017.440354:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440362:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c642 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440376:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee345a77e00) 00010000:00010000:3.0:1762167017.440379:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167017.440382:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c642 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440387:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c642 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.440424:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c634 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43e8 expref: 932 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.440434:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167017.440437:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762167017.440441:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43e8 expref: 932 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.440451:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00000100:00100000:3.0:1762167017.440509:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:57197:x1847765452048128:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 574us (714us total) trans 0 rc 301/301 00000100:00100000:3.0:1762167017.440516:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20141 00000100:00100000:0.0:1762167017.443046:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.443109:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452048384 00000100:00100000:3.0:1762167017.443119:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452048384 00000100:00100000:3.0:1762167017.443171:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20142 00000100:00100000:3.0:1762167017.443178:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+931:57197:x1847765452048384:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:3.0:1762167017.443194:0:31205:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167017.443211:0:31205:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb43ef expref: -99 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.443277:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c650 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443292:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443303:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443331:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c657 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443342:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443347:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443479:0:31205:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443488:0:31205:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443495:0:31205:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31205 initiator: MDT0 00000004:00200000:3.0:1762167017.443505:0:31205:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:3.0:1762167017.443601:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443609:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c650 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443615:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c650 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443621:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167017.443625:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c650 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443632:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c650 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443643:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:3.0:1762167017.443652:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167017.443657:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443663:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443676:0:31205:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443681:0:31205:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c657 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443686:0:31205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c657 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443691:0:31205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc2129310) 00010000:00010000:3.0:1762167017.443694:0:31205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c657 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443699:0:31205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c657 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443706:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee345a77a00) 00010000:00010000:3.0:1762167017.443708:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762167017.443710:0:31205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c657 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443715:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c657 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31205 initiator: MDT0 00010000:00010000:3.0:1762167017.443754:0:31205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43ef expref: 934 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.443802:0:31205:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43ef expref: 933 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.443810:0:31205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:3.0:1762167017.443812:0:31205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762167017.443815:0:31205:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922400, rc 0) 00000100:00100000:3.0:1762167017.443883:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+933:57197:x1847765452048384:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 704us (849us total) trans 8589953226 rc 0/0 00000100:00100000:3.0:1762167017.443891:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20142 00000100:00100000:0.0:1762167017.445980:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.446029:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452048640 00000100:00100000:3.0:1762167017.446038:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452048640 00000100:00100000:3.0:1762167017.446085:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7413 00000100:00100000:3.0:1762167017.446096:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+933:57197:x1847765452048640:12345-192.168.203.35@tcp:35:lfs.0 00000100:00100000:3.0:1762167017.446297:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+934:57197:x1847765452048640:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 202us (324us total) trans 8589953227 rc 0/0 00000100:00100000:3.0:1762167017.446306:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7413 00000004:00080000:0.0:1762167017.639994:0:30841:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638432228861ns, next at 639432226677ns, rc = 0 00000100:00100000:0.0:1762167017.640039:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454555008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762167017.640046:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765454555136:0@lo:400:kworker.0 00000100:00100000:1.0:1762167017.640110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.640110:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762167017.640147:0:30843:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638432383291ns, next at 639432380558ns, rc = 0 00000100:00100000:1.0:1762167017.640161:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454555648:0@lo:400:kworker.0 00000100:00100000:0.0:1762167017.640161:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454555520:0@lo:400:kworker.0 00000100:00100000:3.0:1762167017.640170:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1847765454555392:0@lo:400:kworker.0 00000100:00100000:0.0:1762167017.640187:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167017.640219:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.640238:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454555008 00000100:00100000:3.0:1762167017.640244:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454555904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762167017.640246:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454555008 00000100:00100000:3.0:1762167017.640273:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762167017.640285:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.640297:0:6537:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454555904 00000100:00100000:0.0:1762167017.640301:0:6537:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454555904 00000100:00100000:1.0:1762167017.640329:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1762167017.640338:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765454555264:0@lo:400:kworker.0 00000100:00100000:0.0:1762167017.640346:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1762167017.640358:0:6537:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454555008:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762167017.640366:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454555392 00000100:00100000:1.0:1762167017.640366:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167017.640372:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454555392 00002000:00000024:0.0:1762167017.640379:0:6537:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 354746368 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1762167017.640408:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24240ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765454555776:0@lo:400:kworker.0 00000100:00100000:3.0:1762167017.640412:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454555264 00000100:00100000:3.0:1762167017.640416:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454555264 00000100:00100000:0.0:1762167017.640428:0:6537:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454555008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.640432:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.640436:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1762167017.640446:0:31205:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454555776 00000100:00100000:3.0:1762167017.640450:0:31205:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454555776 00000100:00100000:0.0:1762167017.640459:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1762167017.640466:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454555520 00000100:00100000:0.0:1762167017.640468:0:6537:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+25:3293:x1847765454555904:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762167017.640470:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454555520 00000100:00100000:3.0:1762167017.640478:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00002000:00000024:0.0:1762167017.640478:0:6537:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 231931904 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1762167017.640491:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1847765454555392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762167017.640500:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454555648 00000100:00100000:1.0:1762167017.640505:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454555648 00000100:00100000:0.0:1762167017.640513:0:6537:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+26:3293:x1847765454555904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.640519:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1762167017.640531:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1762167017.640536:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1847765454555392:12345-0@lo:400:kworker.0 Request processed in 47us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.640542:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454555520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762167017.640548:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1762167017.640569:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1762167017.640579:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765454555264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762167017.640588:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3294:x1847765454555520:12345-0@lo:400:kworker.0 Request processed in 49us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.640594:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1762167017.640613:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1762167017.640619:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1847765454555264:12345-0@lo:400:kworker.0 Request processed in 41us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.640623:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454555648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762167017.640630:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1762167017.640650:0:31205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1762167017.640664:0:31205:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765454555776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762167017.640665:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3295:x1847765454555648:12345-0@lo:400:kworker.0 Request processed in 40us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.640675:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1762167017.640703:0:31205:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1847765454555776:12345-0@lo:400:kworker.0 Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.640710:0:31205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1762167017.640875:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762167017.640910:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454555008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762167017.640921:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454555520:0@lo:400:kworker.0 00000100:00100000:0.0:1762167017.641151:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1847765454555392:0@lo:400:kworker.0 00000100:00100000:0.0:1762167017.641168:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454555904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762167017.641194:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1847765454555264:0@lo:400:kworker.0 00000100:00100000:1.0:1762167017.641207:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24240ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1847765454555776:0@lo:400:kworker.0 00000100:00100000:1.0:1762167017.641222:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454555648:0@lo:400:kworker.0 00000100:00100000:3.0:1762167017.641282:0:30815:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454555136 00000100:00100000:3.0:1762167017.641287:0:30815:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454555136 00000100:00100000:3.0:1762167017.641326:0:30815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1762167017.641334:0:30815:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee343e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765454555136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762167017.641376:0:30815:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee343e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f1807908-b95d-4027-b65a-753b7d69e554+18:3295:x1847765454555136:12345-0@lo:400:kworker.0 Request processed in 43us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.641383:0:30815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1762167017.641426:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f1807908-b95d-4027-b65a-753b7d69e554:3295:1847765454555136:0@lo:400:kworker.0 00000001:00080000:1.0:1762167017.661866:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876140 is committed 00000001:00080000:1.0:1762167017.661882:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876133 is committed 00000001:00080000:1.0:1762167017.661914:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876136 is committed 00000001:00100000:1.0:1762167017.661932:0:23749:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b4e369e7-58c9-4605-91cc-bb6f1ca9b31b 00000001:00080000:1.0:1762167017.661937:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876138 is committed 00000001:00100000:1.0:1762167017.661958:0:23749:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12bd460f-a83f-41fe-92df-dfba4795e03a 00000001:00080000:1.0:1762167017.661965:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876141 is committed 00000001:00080000:1.0:1762167017.661974:0:23749:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876139 is committed 00000001:00080000:1.0:1762167017.663200:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843722 is committed 00000001:00100000:1.0:1762167017.663218:0:22362:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b4e369e7-58c9-4605-91cc-bb6f1ca9b31b 00000001:00100000:1.0:1762167017.663226:0:22362:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12bd460f-a83f-41fe-92df-dfba4795e03a 00000001:00080000:1.0:1762167017.663232:0:22362:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843723 is committed 00000004:00080000:3.0:1762167017.665833:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3783 committed 00000001:00080000:3.0:1762167017.665862:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953218 is committed 00000001:00100000:3.0:1762167017.665888:0:30849:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 12bd460f-a83f-41fe-92df-dfba4795e03a 00000001:00080000:3.0:1762167017.665896:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953225 is committed 00000001:00100000:3.0:1762167017.665929:0:30849:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b4e369e7-58c9-4605-91cc-bb6f1ca9b31b 00000020:00080000:3.0:1762167017.665962:0:30849:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ee2424b9840 refcount 2 committed 0 result 0 batchid 4294969187 00000020:00080000:3.0:1762167017.665968:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee247822200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ee246e2ae40 00000020:00080000:3.0:1762167017.665972:0:30849:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9ee247822800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ee371ac1000 00000004:00080000:3.0:1762167017.666010:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3796 committed 00000001:00080000:3.0:1762167017.666024:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953227 is committed 00000004:00080000:3.0:1762167017.666042:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3795 committed 00000004:00080000:3.0:1762167017.666048:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3782 committed 00000100:00100000:2.0:1762167017.666050:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454556160:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.666065:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454556032:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1762167017.666080:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969187 committed batchid 4294969186 00000100:00100000:2.0:1762167017.666122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.666126:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454556416:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.666166:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167017.666167:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454556672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.666196:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454556928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167017.666202:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.666231:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167017.666233:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1762167017.666243:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454556288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167017.666273:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.666284:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454556160 00000100:00100000:0.0:1762167017.666292:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454556160 00000100:00100000:2.0:1762167017.666306:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454556800:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167017.666349:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1762167017.666353:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969186 00000100:00100000:0.0:1762167017.666363:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454556416 00000100:00100000:0.0:1762167017.666369:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454556416 00000100:00100000:0.0:1762167017.666399:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454556672 00000100:00100000:0.0:1762167017.666402:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454556672 00000100:00100000:3.0:1762167017.666418:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454556928 00000100:00100000:3.0:1762167017.666424:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454556928 00000100:00100000:0.0:1762167017.666432:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454556288 00000100:00100000:0.0:1762167017.666437:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454556288 00000100:00100000:3.0:1762167017.666449:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454556800 00000100:00100000:3.0:1762167017.666454:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454556800 00000100:00100000:0.0:1762167017.666466:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17560 00000100:00100000:0.0:1762167017.666480:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454556160:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762167017.666486:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17561 00000100:00100000:3.0:1762167017.666497:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454556416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1762167017.666507:0:33894:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2049 count 1 00002000:00080000:3.0:1762167017.666514:0:12400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2068 count 1 00010000:00010000:0.0:1762167017.666531:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167017.666543:0:12400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x814:0x0] initial LVB size: 152547, mtime: 0x690888e4, atime: 0x690888db, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:3.0:1762167017.666552:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c673 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.666553:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.666570:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17562 00010000:00010000:3.0:1762167017.666576:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.666578:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167017.666581:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.666582:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1762167017.666588:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454556672:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1762167017.666591:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.666591:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1762167017.666604:0:33892:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2073 count 1 00010000:00010000:2.0:1762167017.666622:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.666623:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.666638:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.666651:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.666653:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 16 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.666661:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 16 pid: 6535 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.666674:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.666677:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1762167017.666691:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245188a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454558080:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167017.666696:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167017.666701:0:12400:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762167017.666701:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.666732:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 16 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.666742:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 16 pid: 33894 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.666755:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454558208:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167017.666800:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f939d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762167017.666824:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17563 00000100:00100000:2.0:1762167017.666828:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762167017.666835:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3293:x1847765454556928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1762167017.666850:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2076 count 1 00000100:00100000:2.0:1762167017.666854:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17564 00000100:00100000:2.0:1762167017.666866:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454556288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762167017.666882:0:6535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2065 count 1 00010000:00010000:2.0:1762167017.666896:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x811:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.666909:0:6535:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dd59800/0xf915a5bdf3d0725e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb24a0 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.666916:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167017.666918:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167017.666921:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.666944:0:6535:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee36dd59800/0xf915a5bdf3d0725e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb24a0 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.666956:0:6535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee36dd59800/0xf915a5bdf3d0725e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb24a0 expref: 16 pid: 6533 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.666957:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.666980:0:6535:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454558336:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167017.666983:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c24b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4221 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167017.666995:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.666997:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.667000:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.667017:0:6535:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee2435c1000 going to sleep for 11 seconds 00010000:00010000:0.0:1762167017.667026:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c24b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4221 expref: 16 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167017.667038:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c24b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4221 expref: 16 pid: 26444 timeout: 738 lvb_type: 1 00000100:00100000:2.0:1762167017.667046:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17565 00000100:00100000:0.0:1762167017.667052:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee245189500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454558464:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167017.667060:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3295:x1847765454556800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1762167017.667074:0:6532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2074 count 1 00000100:00100000:0.0:1762167017.667085:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee346b14180 going to sleep for 11 seconds 00002000:00010000:2.0:1762167017.667095:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81a:0x0] initial LVB size: 152547, mtime: 0x690888e4, atime: 0x690888dd, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:2.0:1762167017.667102:0:6532:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c68f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667111:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.667113:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.667116:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c68f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667127:0:6532:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c68f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667135:0:6532:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c68f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667143:0:6532:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c68f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667162:0:6532:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1762167017.667272:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3293:x1847765454556416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 776us (1106us total) trans 21474843724 rc 0/0 00000100:00100000:3.0:1762167017.667285:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17561 00000100:00100000:0.0:1762167017.667289:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167017.667319:0:12400:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454556032 00000100:00100000:3.0:1762167017.667324:0:12400:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454556032 00000100:00100000:0.0:1762167017.667329:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454556544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.667359:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.667379:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454557056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762167017.667407:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762167017.667418:0:12400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17566 00000100:00100000:0.0:1762167017.667423:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454557568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762167017.667431:0:12400:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3294:x1847765454556032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1762167017.667447:0:12400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2047 count 1 00000100:00100000:0.0:1762167017.667453:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167017.667462:0:12400:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.667475:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:3.0:1762167017.667478:0:12400:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c260 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->135167) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb422f expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.667486:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454557440:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762167017.667489:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167017.667493:0:12400:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167017.667496:0:12400:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.667521:0:12400:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c260 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->135167) gid 0 flags: 0x50000000010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb422f expref: 16 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.667528:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167017.667531:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1847765454556800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 473us (1180us total) trans 21474843725 rc 0/0 00010000:00010000:3.0:1762167017.667547:0:12400:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c260 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->135167) gid 0 flags: 0x70000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb422f expref: 16 pid: 26444 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.667547:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17565 00000100:00100000:0.0:1762167017.667547:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454557952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762167017.667566:0:12400:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454558592:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167017.667569:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454556544 00000100:00100000:2.0:1762167017.667575:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454556544 00000100:00100000:0.0:1762167017.667579:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167017.667598:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454557056 00000100:00100000:2.0:1762167017.667603:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454557056 00000100:00100000:3.0:1762167017.667610:0:12400:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee360510540 going to sleep for 11 seconds 00000100:00100000:2.0:1762167017.667623:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454557568 00000100:00100000:2.0:1762167017.667628:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454557568 00000100:00100000:3.0:1762167017.667634:0:6533:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454557440 00000100:00100000:3.0:1762167017.667640:0:6533:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454557440 00000100:00100000:2.0:1762167017.667649:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454557952 00000100:00100000:2.0:1762167017.667654:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454557952 00000100:00100000:3.0:1762167017.667671:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17567 00000100:00100000:3.0:1762167017.667682:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454556544:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.667691:0:12402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17568 00002000:00080000:3.0:1762167017.667695:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2071 count 1 00000100:00100000:0.0:1762167017.667704:0:12402:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3294:x1847765454557056:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762167017.667708:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762167017.667710:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667717:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1762167017.667721:0:12402:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2050 count 1 00010000:00010000:3.0:1762167017.667726:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 16 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.667742:0:12402:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x802:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.667747:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167017.667752:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167017.667755:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167017.667757:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667787:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.667797:0:12402:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee342edf200/0xf915a5bdf3d02cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb09e2 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667799:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c673 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.667816:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167017.667820:0:12402:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167017.667823:0:12402:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667830:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c673 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667840:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923800/0xf915a5bdf3d0c673 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.667847:0:12402:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee342edf200/0xf915a5bdf3d02cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb09e2 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.667861:0:12402:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee342edf200/0xf915a5bdf3d02cc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb09e2 expref: 21 pid: 6533 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.667870:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1762167017.667875:0:12402:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454558720:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167017.667876:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c68f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667887:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c400 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167017.667890:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c68f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667898:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c68f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667910:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c68f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667923:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c68f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.667925:0:12402:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee346b149c0 going to sleep for 11 seconds 00010000:00010000:3.0:1762167017.667946:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 16 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.667946:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.667949:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.667953:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167017.667963:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 16 pid: 33892 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.667970:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454557312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762167017.667979:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454558848:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167017.668015:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3605109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167017.668016:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762167017.668034:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167017.668044:0:7858:0:(service.c:3434:ptlrpc_start_thread()) ost[0] started 9 min 3 max 116 00000100:00100000:2.0:1762167017.668046:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454557824:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762167017.668054:0:7858:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_ost00_009' 00000100:00100000:3.0:1762167017.668075:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454557184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762167017.668079:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167017.668109:0:6532:0:(service.c:3434:ptlrpc_start_thread()) ost[0] started 9 min 3 max 116 00000100:00100000:3.0:1762167017.668116:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167017.668121:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454557312 00000100:00100000:2.0:1762167017.668126:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454557312 00000100:00100000:3.0:1762167017.668135:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee359065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454557696:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762167017.668148:0:6532:0:(service.c:3434:ptlrpc_start_thread()) ost[0] started 9 min 3 max 116 00000100:00100000:2.0:1762167017.668156:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454557824 00000100:00100000:2.0:1762167017.668160:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454557824 00000100:00100000:3.0:1762167017.668163:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762167017.668182:0:6532:0:(service.c:3434:ptlrpc_start_thread()) ost[0] started 9 min 3 max 116 00000100:00100000:2.0:1762167017.668190:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454557184 00000100:00100000:2.0:1762167017.668194:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454557184 00000100:00100000:3.0:1762167017.668198:0:3295:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474843722 gen 2 00000004:00080000:3.0:1762167017.668204:0:3295:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843722 committed transno 21474843722 00000100:00100000:2.0:1762167017.668212:0:6532:0:(service.c:3434:ptlrpc_start_thread()) ost[0] started 9 min 3 max 116 00000100:00100000:2.0:1762167017.668219:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454557696 00000100:00100000:2.0:1762167017.668222:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454557696 00000100:00100000:3.0:1762167017.668229:0:3295:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee36e629880 x1847765454556800/t21474843725(21474843725) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762167033 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762167017.668240:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e629880/2, rc 0, transno 21474843725 00000004:00080000:0.0:1762167017.668243:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e62b480/2, rc 0, transno 21474843724 00000100:00100000:3.0:1762167017.668253:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454556800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.668254:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454556416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762167017.668369:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454559104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167017.668396:0:34499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17569 00000100:00100000:2.0:1762167017.668405:0:34499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454557568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762167017.668420:0:34499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2074 count 1 00002000:00010000:2.0:1762167017.668442:0:34499:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81a:0x0] initial LVB size: 152547, mtime: 0x690888e4, atime: 0x690888db, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:2.0:1762167017.668448:0:34499:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c6ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.668457:0:34499:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.668458:0:34499:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.668462:0:34499:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c6ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.668475:0:34499:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c6ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.668485:0:34499:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c6ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.668493:0:34499:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c6ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.668510:0:34499:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762167017.668520:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167017.668525:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c6ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.668533:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ca00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167017.668537:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c6ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.668545:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c6ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.668556:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c6ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.668563:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c6ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.668578:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.668580:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.668581:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167017.668614:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762167017.668625:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454558976:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.668656:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.668685:0:7858:0:(service.c:3434:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:3.0:1762167017.668692:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.668693:0:7858:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_ost00_010' 00000100:00100000:2.0:1762167017.668729:0:6532:0:(service.c:3434:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:2.0:1762167017.668738:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454558976 00000100:00100000:2.0:1762167017.668743:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454558976 00000100:00100000:2.0:1762167017.668892:0:6532:0:(service.c:3434:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:2.0:1762167017.668900:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454559104 00000100:00100000:2.0:1762167017.668903:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454559104 00000100:00100000:3.0:1762167017.669276:0:34499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3294:x1847765454557568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 871us (1823us total) trans 17179876142 rc 0/0 00000100:00100000:3.0:1762167017.669285:0:34499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17569 00000100:00100000:0.0:1762167017.669304:0:3294:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179876139 gen 2 00000004:00080000:0.0:1762167017.669323:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243306680, transno 17179876120 00000004:00080000:0.0:1762167017.669334:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435ab480, transno 17179876121 00000004:00080000:0.0:1762167017.669338:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243306d80, transno 17179876122 00000004:00080000:0.0:1762167017.669341:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243307800, transno 17179876123 00000004:00080000:0.0:1762167017.669344:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243304380, transno 17179876124 00000004:00080000:0.0:1762167017.669346:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243304a80, transno 17179876125 00000004:00080000:0.0:1762167017.669349:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243305c00, transno 17179876126 00000004:00080000:0.0:1762167017.669352:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee243305500, transno 17179876127 00000004:00080000:0.0:1762167017.669354:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345732d80, transno 17179876128 00000004:00080000:0.0:1762167017.669357:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345730700, transno 17179876129 00000004:00080000:0.0:1762167017.669361:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345732300, transno 17179876130 00000004:00080000:0.0:1762167017.669365:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345732a00, transno 17179876131 00000004:00080000:0.0:1762167017.669369:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345731180, transno 17179876132 00000004:00080000:0.0:1762167017.669372:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345730e00, transno 17179876133 00000004:00080000:0.0:1762167017.669375:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345733800, transno 17179876134 00000004:00080000:0.0:1762167017.669378:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345730a80, transno 17179876135 00000004:00080000:0.0:1762167017.669382:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345731c00, transno 17179876136 00000004:00080000:0.0:1762167017.669384:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a9c00, transno 17179876137 00000004:00080000:0.0:1762167017.669387:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee345731880, transno 17179876138 00000004:00080000:0.0:1762167017.669390:0:3294:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9ee2435a8000, transno 17179876139 00000100:00100000:0.0:1762167017.669396:0:3294:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff9ee37f8c1880 x1847765454557568/t17179876142(17179876142) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762167033 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762167017.669406:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c1880/2, rc 0, transno 17179876142 00000100:00100000:0.0:1762167017.669411:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454557568:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1762167017.669689:0:30842:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 8 in progress, 7 in flight, 20 done 00000100:00100000:3.0:1762167017.669702:0:34499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17570 00000100:00100000:2.0:1762167017.669712:0:34500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17571 00000100:00100000:3.0:1762167017.669716:0:34499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454557440:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762167017.669727:0:34500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3294:x1847765454557952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1762167017.669734:0:34499:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2071 count 1 00000100:00100000:0.0:1762167017.669740:0:3296:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454559232:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762167017.669745:0:34500:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2079 count 1 00010000:00010000:3.0:1762167017.669751:0:34499:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.669785:0:34500:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.669801:0:34500:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 21 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.669802:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167017.669812:0:34500:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167017.669814:0:34500:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167017.669818:0:34500:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.669829:0:34499:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.669838:0:34499:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167017.669841:0:34499:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1762167017.669843:0:7858:0:(service.c:3434:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00010000:00010000:3.0:1762167017.669844:0:34499:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.669847:0:34500:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 21 pid: 7858 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.669854:0:7858:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_ost00_011' 00010000:00010000:2.0:1762167017.669876:0:34500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 21 pid: 7858 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.669888:0:34500:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:34500:1847765454559360:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167017.669913:0:34499:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 21 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.669924:0:34499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 21 pid: 33892 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.669936:0:34499:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:34499:1847765454559488:192.168.203.35@tcp:104: 00000100:00100000:2.0:1762167017.669963:0:34500:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee349c6ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167017.670005:0:34499:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3605103c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762167017.670077:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245188a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454558080:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167017.670097:0:33894:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.670222:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.670259:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.670275:0:6535:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6535:1847765454558336:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167017.670290:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:3.0:1762167017.670294:0:6535:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.670336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.670371:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.670387:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee245189500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26444:1847765454558464:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167017.670403:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.670423:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.670442:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452048768 00000100:00100000:3.0:1762167017.670447:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452048768 00010000:00010000:3.0:1762167017.670472:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 17 pid: 33894 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.670487:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452049024 00000100:00100000:3.0:1762167017.670490:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452049024 00010000:00010000:3.0:1762167017.670506:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36dd59800/0xf915a5bdf3d0725e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb24a0 expref: 18 pid: 6533 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1762167017.670507:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.670522:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:33892:1847765454558208:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167017.670523:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452049280 00000100:00100000:3.0:1762167017.670527:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452049280 00000100:00100000:0.0:1762167017.670532:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452048896 00000100:00100000:0.0:1762167017.670539:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452048896 00010000:00010000:2.0:1762167017.670543:0:33892:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.670545:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c260 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->135167) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb422f expref: 20 pid: 26444 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.670563:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 20 pid: 6535 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.670573:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452049152 00000100:00100000:3.0:1762167017.670578:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452049152 00010000:00010000:3.0:1762167017.670595:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c24b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4221 expref: 21 pid: 26444 timeout: 738 lvb_type: 1 00000100:00100000:0.0:1762167017.670595:0:5741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452049408 00000100:00100000:0.0:1762167017.670601:0:5741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452049408 00000100:00100000:3.0:1762167017.670613:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452049536 00000100:00100000:3.0:1762167017.670617:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452049536 00010000:00010000:0.0:1762167017.670624:0:5741:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee342edf200/0xf915a5bdf3d02cc7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb09e2 expref: 22 pid: 6533 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.670635:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 22 pid: 33892 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1762167017.670646:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7687 00000100:00100000:0.0:1762167017.670656:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765452048768:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762167017.670663:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7688 00010000:00010000:0.0:1762167017.670668:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762167017.670674:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765452049024:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167017.670678:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 22 pid: 33894 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.670684:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167017.670691:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36dd59800/0xf915a5bdf3d0725e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb24a0 expref: 22 pid: 6533 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.670695:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 22 pid: 33894 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.670711:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36dd59800/0xf915a5bdf3d0725e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb24a0 expref: 22 pid: 6533 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.670728:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d09f21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb34ad expref: 22 pid: 33894 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.670729:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36dd59800/0xf915a5bdf3d0725e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x811:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb24a0 expref: 22 pid: 6533 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.670745:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.670747:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.670751:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.670781:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.670806:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167017.670811:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.670814:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.670818:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.670826:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.670842:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452048768:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 186us (619us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167017.670849:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167017.670851:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7687 00000100:00100000:3.0:1762167017.670877:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2360:x1847765452049024:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 205us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.670885:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7688 00000100:00100000:0.0:1762167017.670901:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7689 00000100:00100000:3.0:1762167017.670909:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7690 00000100:00100000:0.0:1762167017.670914:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765452049280:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762167017.670921:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2361:x1847765452048896:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762167017.670923:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167017.670930:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c260 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 110592->135167) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb422f expref: 18 pid: 26444 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.670932:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167017.670941:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 18 pid: 6535 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.670947:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c260 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 110592->135167) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb422f expref: 18 pid: 26444 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.670959:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 18 pid: 6535 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.670966:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.670970:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.670973:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.670976:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36e30d200/0xf915a5bdf3d0c18e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41f0 expref: 18 pid: 6535 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.670993:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.670996:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.671000:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.671005:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.671012:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.671014:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167017.671040:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765452049280:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 130us (751us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167017.671049:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167017.671049:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7689 00000100:00100000:0.0:1762167017.671069:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7691 00000100:00100000:3.0:1762167017.671078:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765452048896:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 159us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.671079:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2361:x1847765452049152:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762167017.671093:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7690 00010000:00010000:0.0:1762167017.671095:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167017.671102:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c24b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4221 expref: 16 pid: 26444 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1762167017.671111:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7692 00010000:00010000:0.0:1762167017.671115:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c24b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4221 expref: 15 pid: 26444 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1762167017.671129:0:5741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef2800/0xf915a5bdf3d0c24b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x81c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4221 expref: 15 pid: 26444 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1762167017.671139:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.671140:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.671143:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.671151:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.671170:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167017.671191:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765452049408:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762167017.671193:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+14:2361:x1847765452049152:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 116us (821us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167017.671195:0:33894:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.671204:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762167017.671205:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7691 00010000:00010000:3.0:1762167017.671211:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee342edf200/0xf915a5bdf3d02cc7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb09e2 expref: 22 pid: 6533 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.671215:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.671223:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee342edf200/0xf915a5bdf3d02cc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb09e2 expref: 22 pid: 6533 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.671224:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.671229:0:5741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7693 00010000:00010000:2.0:1762167017.671237:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.671241:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762167017.671244:0:5741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765452049536:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167017.671245:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.671250:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.671255:0:5741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167017.671256:0:33894:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762167017.671259:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.671264:0:5741:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 13 pid: 33892 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.671276:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167017.671284:0:5741:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 13 pid: 33892 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.671297:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.671299:0:5741:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.671302:0:5741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.671321:0:5741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.671337:0:5741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167017.671357:0:5741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+13:2361:x1847765452049536:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 118us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.671365:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2360:x1847765452049408:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 242us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.671369:0:5741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7693 00000100:00100000:3.0:1762167017.671378:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7692 00010000:00010000:0.0:1762167017.671409:0:33892:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.671417:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.671426:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.671431:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8000/0xf915a5bdf3d097e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb320d expref: 12 pid: 33892 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.671438:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167017.671449:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6533:1847765454558848:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167017.671465:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.671474:0:33892:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1762167017.671475:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.671484:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.671491:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.671497:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.671513:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1762167017.671738:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454556160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5261us (5615us total) trans 21474843726 rc 0/0 00000100:00100000:2.0:1762167017.671746:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17560 00000100:00100000:2.0:1762167017.671898:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454559232 00000100:00100000:2.0:1762167017.671904:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454559232 00000100:00100000:2.0:1762167017.671932:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17572 00000100:00100000:2.0:1762167017.671939:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454557312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762167017.671958:0:33894:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2068 count 1 00002000:00010000:2.0:1762167017.671990:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x814:0x0] initial LVB size: 152547, mtime: 0x690888e4, atime: 0x690888d5, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:2.0:1762167017.671997:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c6c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.672007:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.672010:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.672014:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.672026:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.672026:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3295:x1847765454556672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5443us (5822us total) trans 21474843727 rc 0/0 00000100:00100000:3.0:1762167017.672041:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3294:x1847765454556544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4362us (4682us total) trans 21474843728 rc 0/0 00010000:00010000:2.0:1762167017.672043:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.672044:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17562 00000100:00100000:3.0:1762167017.672054:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17567 00010000:00010000:2.0:1762167017.672054:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c6c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.672068:0:33894:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1762167017.672074:0:33892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17573 00000100:00100000:3.0:1762167017.672082:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17574 00000100:00100000:0.0:1762167017.672087:0:33892:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454557824:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762167017.672094:0:6533:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454557184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762167017.672103:0:33892:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2077 count 1 00002000:00080000:3.0:1762167017.672110:0:6533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2052 count 1 00010000:00010000:0.0:1762167017.672117:0:33892:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672124:0:6533:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672133:0:33892:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 21 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672138:0:6533:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672148:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167017.672152:0:33892:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167017.672154:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167017.672157:0:33892:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672158:0:6533:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762167017.672163:0:6533:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672195:0:6533:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672197:0:33892:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 21 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672220:0:6533:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 21 pid: 6535 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.672220:0:33892:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 21 pid: 7858 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1762167017.672245:0:33892:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454559744:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167017.672253:0:6533:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454559616:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167017.672297:0:33892:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee37f939d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762167017.672299:0:6533:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3605109c0 going to sleep for 11 seconds 00010000:00010000:0.0:1762167017.672323:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1762167017.672330:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1762167017.672331:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672338:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672340:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36f35e800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167017.672346:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672351:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c800 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167017.672356:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672357:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672377:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672382:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672391:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672393:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35e800/0xf915a5bdf3d0c66c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672411:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1c800/0xf915a5bdf3d0c67a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672432:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762167017.672434:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167017.672438:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672439:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c6c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672458:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923e00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167017.672460:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1de00 already unused, calling callback (ffffffffc1709320) 00000100:00100000:2.0:1762167017.672460:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3296:x1847765454557312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 521us (4445us total) trans 17179876143 rc 0/0 00010000:00010000:3.0:1762167017.672467:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c6c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.672468:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17572 00010000:00010000:0.0:1762167017.672468:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672485:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c6c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.672485:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17575 00010000:00010000:0.0:1762167017.672490:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672497:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c6c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.672497:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1847765454557696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762167017.672512:0:33894:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2076 count 1 00010000:00010000:3.0:1762167017.672516:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1de00/0xf915a5bdf3d0c6c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672527:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672531:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1762167017.672531:0:33894:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x81c:0x0] initial LVB size: 152547, mtime: 0x690888e4, atime: 0x690888dd, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:3.0:1762167017.672535:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167017.672538:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.672541:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672544:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923e00/0xf915a5bdf3d0c69d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672550:0:6535:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.672558:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.672561:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.672564:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672568:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.672574:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672576:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672579:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.672582:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672584:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167017.672587:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.672589:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.672591:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.672606:0:6535:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762167017.672612:0:33894:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1762167017.672625:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c0700/2, rc 0, transno 17179876143 00000100:00100000:0.0:1762167017.672641:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454557312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762167017.672840:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.672956:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.673001:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454557696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 506us (4838us total) trans 17179876144 rc 0/0 00000100:00100000:3.0:1762167017.673002:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454556288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6139us (6729us total) trans 21474843729 rc 0/0 00000100:00100000:2.0:1762167017.673009:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17575 00000100:00100000:3.0:1762167017.673014:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17564 00000100:00100000:2.0:1762167017.673029:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17576 00000100:00100000:3.0:1762167017.673034:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17577 00000100:00100000:2.0:1762167017.673039:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454558976:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762167017.673042:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3295:x1847765454559104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1762167017.673052:0:6535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2078 count 1 00002000:00080000:2.0:1762167017.673053:0:33894:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2077 count 1 00010000:00010000:2.0:1762167017.673066:0:33894:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762167017.673072:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81e:0x0] initial LVB size: 152547, mtime: 0x690888e4, atime: 0x690888e0, ctime: 0x690888e4, blocks: 0x203 00010000:00010000:3.0:1762167017.673077:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c6e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673078:0:33894:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 11 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.673085:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.673086:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762167017.673087:0:33894:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1762167017.673088:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452049664 00010000:00010000:2.0:1762167017.673090:0:33894:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.673096:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452049664 00010000:00010000:2.0:1762167017.673120:0:33894:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 11 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673125:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 22 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.673140:0:33894:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 11 pid: 7858 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.673153:0:33894:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36dc30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454559872:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167017.673158:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762167017.673158:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452049792 00000100:00100000:0.0:1762167017.673163:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452049792 00010000:00010000:3.0:1762167017.673164:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.673176:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673181:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 23 pid: 33892 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.673187:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.673196:0:33894:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee348626000 going to sleep for 11 seconds 00010000:00010000:3.0:1762167017.673199:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.673209:0:6535:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1762167017.673211:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1762167017.673217:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.673218:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7694 00010000:00010000:2.0:1762167017.673228:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d400 already unused, calling callback (ffffffffc1709320) 00000100:00100000:0.0:1762167017.673232:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765452049664:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167017.673233:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673246:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673246:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167017.673256:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 23 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.673278:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673280:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 23 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.673298:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c681 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673319:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.673323:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.673327:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673330:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762167017.673338:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673339:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673357:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1c200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167017.673362:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673369:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673369:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167017.673383:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673390:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.673398:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+23:2361:x1847765452049664:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 169us (558us total) trans 0 rc 0/0 00010000:00010000:2.0:1762167017.673405:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1762167017.673406:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7694 00010000:00010000:2.0:1762167017.673410:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673423:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167017.673426:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673433:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c6e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673443:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c6e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673450:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923c00/0xf915a5bdf3d0c6e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.673456:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7695 00000100:00100000:0.0:1762167017.673471:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765452049792:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167017.673475:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.673478:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.673480:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167017.673480:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167017.673488:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 22 pid: 33892 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.673499:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 22 pid: 33892 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.673518:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.673520:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.673524:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673531:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673547:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762167017.673554:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167017.673571:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+22:2361:x1847765452049792:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 104us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.673580:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7695 00000100:00100000:3.0:1762167017.673587:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454559104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 545us (4895us total) trans 21474843730 rc 0/0 00000100:00100000:3.0:1762167017.673595:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17577 00000004:00080000:2.0:1762167017.673596:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550e680/2, rc 0, transno 21474843730 00000100:00100000:2.0:1762167017.673602:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454559104:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762167017.673613:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17578 00000004:00080000:2.0:1762167017.673616:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee359065f80/2, rc 0, transno 17179876144 00000100:00100000:2.0:1762167017.673620:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454557696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762167017.673621:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1847765454559232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1762167017.673634:0:6535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2080 count 1 00000004:00080000:2.0:1762167017.673634:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e629180/2, rc 0, transno 21474843729 00000100:00100000:2.0:1762167017.673638:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454556288:0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1762167017.673653:0:6535:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x820:0x0] initial LVB size: 152547, mtime: 0x690888e4, atime: 0x690888de, ctime: 0x690888e4, blocks: 0x203 00000004:00080000:2.0:1762167017.673654:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e629500/2, rc 0, transno 21474843726 00010000:00010000:0.0:1762167017.673657:0:12402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee342edf200/0xf915a5bdf3d02cc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb09e2 expref: 21 pid: 6533 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.673659:0:6535:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c6ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.673659:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454556160:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1762167017.673673:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e629f80/2, rc 0, transno 21474843727 00010000:00010000:3.0:1762167017.673679:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762167017.673679:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454556672:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1762167017.673681:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.673684:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c6ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.673686:0:12402:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:12402:1847765454558720:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167017.673701:0:6535:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c6ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.673709:0:6535:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c6ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673710:0:34500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9a00/0xf915a5bdf3d0aaf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb395a expref: 20 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.673711:0:12402:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.673721:0:6535:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c6ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.673730:0:34500:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:34500:1847765454559360:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167017.673738:0:12402:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.673744:0:6535:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762167017.673748:0:12402:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673749:0:34500:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673793:0:12402:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673800:0:12402:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.673818:0:12402:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762167017.673830:0:34500:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673838:0:34500:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673847:0:34500:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673853:0:34500:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.673863:0:34500:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1762167017.674340:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454559232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 719us (4538us total) trans 17179876145 rc 0/0 00000100:00100000:3.0:1762167017.674348:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17578 00000100:00100000:2.0:1762167017.674348:0:34500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454557952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4626us (6770us total) trans 17179876146 rc 0/0 00000100:00100000:2.0:1762167017.674354:0:34500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17571 00010000:00010000:2.0:1762167017.674371:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1762167017.674376:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c6ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674383:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923000 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167017.674387:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c6ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674395:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c6ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674407:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c6ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674415:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923000/0xf915a5bdf3d0c6ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674433:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1762167017.674437:0:12402:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3294:x1847765454557056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6736us (7028us total) trans 17179876147 rc 0/0 00010000:00010000:2.0:1762167017.674438:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674454:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b2800 already unused, calling callback (ffffffffc1709320) 00000100:00100000:0.0:1762167017.674455:0:12402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17568 00010000:00010000:2.0:1762167017.674459:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.674465:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167017.674469:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.674470:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.674480:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.674481:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.674483:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1ce00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167017.674488:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674490:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c6a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.674496:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762167017.674503:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24732d500/2, rc 0, transno 17179876145 00010000:00010000:3.0:1762167017.674507:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674510:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167017.674511:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454559232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762167017.674513:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.674516:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167017.674522:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1ce00/0xf915a5bdf3d0c6b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.674535:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167017.674537:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167017.674540:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167017.674566:0:12400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee343ef3200/0xf915a5bdf3d0c260 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->135167) gid 0 flags: 0x44801400010020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb422f expref: 11 pid: 26444 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.674577:0:12400:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12400:1847765454558592:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167017.674597:0:12400:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.674597:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.674619:0:12400:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.674620:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.674642:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.674646:0:12400:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.674657:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.674660:0:12400:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.674680:0:3293:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454560000:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762167017.674680:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762167017.674724:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762167017.674819:0:34499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7ac00/0xf915a5bdf3d097a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb31ea expref: 19 pid: 33892 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.674831:0:34499:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:34499:1847765454559488:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167017.674845:0:34499:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674852:0:34499:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674858:0:34499:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674866:0:34499:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674873:0:34499:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674888:0:34499:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1762167017.674889:0:12400:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674896:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762167017.674903:0:12400:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762167017.674908:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674916:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36f35fe00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167017.674919:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674926:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674940:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674947:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee36f35fe00/0xf915a5bdf3d0c688 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674964:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762167017.674968:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674974:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167017.674977:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674989:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.674999:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.675006:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c6b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.675023:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762167017.675026:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.675033:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:2.0:1762167017.675037:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.675044:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.675054:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.675060:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c696 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.675080:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.675082:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.675085:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167017.675132:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454556928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8300us (8901us total) trans 21474843731 rc 0/0 00000100:00100000:0.0:1762167017.675139:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17563 00000100:00100000:0.0:1762167017.675155:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454560000 00000100:00100000:0.0:1762167017.675160:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454560000 00000100:00100000:0.0:1762167017.675195:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17579 00000100:00100000:0.0:1762167017.675205:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3293:x1847765454560000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762167017.675220:0:26444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2081 count 1 00010000:00010000:0.0:1762167017.675233:0:26444:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.675243:0:26444:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 18 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.675248:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167017.675250:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762167017.675252:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.675273:0:26444:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 18 pid: 7858 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.675281:0:26444:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 18 pid: 7858 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1762167017.675290:0:26444:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454560128:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167017.675355:0:26444:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee246a9a840 going to sleep for 11 seconds 00010000:00010000:0.0:1762167017.675367:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762167017.675458:0:34499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454557440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5747us (7933us total) trans 17179876148 rc 0/0 00000100:00100000:2.0:1762167017.675465:0:34499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17570 00000100:00100000:0.0:1762167017.675619:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.675652:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.675676:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452050048 00000100:00100000:0.0:1762167017.675682:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452050048 00000100:00100000:2.0:1762167017.675711:0:6533:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6533:1847765454559616:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167017.675713:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 19 pid: 6535 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.675728:0:6533:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.675748:0:7415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452049920 00000100:00100000:0.0:1762167017.675753:0:7415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452049920 00010000:00010000:0.0:1762167017.675800:0:7415:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 20 pid: 7858 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.675806:0:12400:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3294:x1847765454556032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8378us (8521us total) trans 21474843732 rc 0/0 00000100:00100000:3.0:1762167017.675819:0:12400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17566 00010000:00010000:3.0:1762167017.675839:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167017.675839:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7696 00000100:00100000:0.0:1762167017.675852:0:7415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2360:x1847765452050048:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762167017.675863:0:6549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7697 00010000:00010000:0.0:1762167017.675863:0:7415:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167017.675872:0:7415:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 20 pid: 6535 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.675873:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762167017.675878:0:6549:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+20:2361:x1847765452049920:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167017.675893:0:6549:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167017.675897:0:7415:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 20 pid: 6535 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.675902:0:6549:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 20 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.675921:0:6549:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 20 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.675926:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e30d800/0xf915a5bdf3d0c187 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb41e9 expref: 20 pid: 6535 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.675940:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.675941:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.675942:0:7415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.675945:0:6549:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.675949:0:7415:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.675951:0:6549:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762167017.675967:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c3b80/2, rc 0, transno 17179876148 00010000:00010000:0.0:1762167017.675969:0:7415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.675971:0:6549:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167017.675974:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454557440:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1762167017.675991:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fc5a680/2, rc 0, transno 17179876146 00000100:00100000:3.0:1762167017.675994:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454557952:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1762167017.675999:0:6549:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1762167017.676005:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c0380/2, rc 0, transno 17179876147 00000100:00100000:3.0:1762167017.676009:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454557056:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762167017.676011:0:7415:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1762167017.676023:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e62b800/2, rc 0, transno 21474843732 00000100:00100000:2.0:1762167017.676023:0:6549:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da9d93ea-d728-4b01-a76b-4b4ff9c19538+19:2361:x1847765452049920:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 150us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.676028:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454556032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167017.676031:0:6549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7697 00000100:00100000:0.0:1762167017.676040:0:7415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2360:x1847765452050048:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 189us (420us total) trans 0 rc 0/0 00000004:00080000:3.0:1762167017.676043:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e62aa00/2, rc 0, transno 21474843728 00000100:00100000:0.0:1762167017.676050:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7696 00000100:00100000:3.0:1762167017.676052:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454556544:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1762167017.676093:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee36e628e00/2, rc 0, transno 21474843731 00000100:00100000:0.0:1762167017.676101:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454556928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762167017.676128:0:33894:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36dc30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:33894:1847765454559872:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167017.676147:0:33894:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.676176:0:33892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b8600/0xf915a5bdf3d0aaab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3930 expref: 17 pid: 7858 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1762167017.676190:0:33892:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:33892:1847765454559744:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167017.676207:0:33892:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.676216:0:33892:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.676222:0:33892:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.676230:0:33892:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.676237:0:33892:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167017.676244:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:0.0:1762167017.676262:0:33892:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1762167017.676322:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452050176 00000100:00100000:3.0:1762167017.676327:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452050176 00010000:00010000:3.0:1762167017.676345:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 11 pid: 7858 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.676367:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7698 00000100:00100000:3.0:1762167017.676375:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2361:x1847765452050176:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762167017.676382:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762167017.676387:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 11 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.676398:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 11 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.676414:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee3819b8a00/0xf915a5bdf3d0ab14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb396f expref: 11 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.676425:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.676427:0:5742:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.676431:0:5742:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.676437:0:5742:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.676459:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762167017.676487:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:2361:x1847765452050176:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 112us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.676495:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7698 00010000:00010000:3.0:1762167017.676621:0:5744:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762167017.676627:0:5744:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.676636:0:5744:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3c00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:3.0:1762167017.676641:0:5744:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.676649:0:5744:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.676662:0:5744:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.676670:0:5744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c6c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33892 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.676690:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167017.676692:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762167017.676695:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762167017.676697:0:33892:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3296:x1847765454557824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4614us (8619us total) trans 17179876149 rc 0/0 00010000:00010000:3.0:1762167017.676707:0:6533:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.676710:0:33892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17573 00010000:00010000:3.0:1762167017.676725:0:6533:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.676733:0:6533:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.676740:0:6533:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762167017.676752:0:3296:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee359065500/2, rc 0, transno 17179876149 00010000:00010000:3.0:1762167017.676755:0:6533:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762167017.676783:0:3296:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee359065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1847765454557824:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762167017.676800:0:5743:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167017.676806:0:5743:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.676814:0:5743:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee347923200 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167017.676817:0:5743:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.676825:0:5743:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.676837:0:5743:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.676845:0:5743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c6ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.676864:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167017.676867:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167017.676869:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762167017.676978:0:33894:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.676987:0:33894:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.676994:0:33894:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.677001:0:33894:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.677026:0:33894:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762167017.677083:0:6548:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762167017.677089:0:6548:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.677101:0:6548:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee381f1d600 already unused, calling callback (ffffffffc1709320) 00010000:00010000:0.0:1762167017.677105:0:6548:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.677113:0:6548:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.677126:0:6548:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167017.677135:0:6533:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3295:x1847765454557184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5042us (9021us total) trans 17179876150 rc 0/0 00010000:00010000:0.0:1762167017.677136:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1d600/0xf915a5bdf3d0c6dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 33894 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167017.677151:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17574 00010000:00010000:0.0:1762167017.677167:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167017.677172:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762167017.677174:0:6548:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1762167017.677201:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37f8c3800/2, rc 0, transno 17179876150 00000100:00100000:3.0:1762167017.677207:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37f8c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454557184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762167017.677407:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454558976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4371us (8749us total) trans 21474843733 rc 0/0 00000100:00100000:2.0:1762167017.677415:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17576 00000004:00080000:0.0:1762167017.677446:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550f800/2, rc 0, transno 21474843733 00000100:00100000:0.0:1762167017.677453:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454558976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762167017.677802:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.677887:0:26444:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345732300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26444:1847765454560128:192.168.203.35@tcp:104: 00000100:00100000:1.0:1762167017.677890:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452050304 00000100:00100000:1.0:1762167017.677899:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452050304 00010000:00010000:0.0:1762167017.677910:0:26444:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.677927:0:29775:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 17 pid: 7858 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1762167017.677964:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7699 00000100:00100000:1.0:1762167017.677974:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2360:x1847765452050304:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762167017.677986:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167017.677991:0:29775:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 17 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1762167017.678003:0:29775:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 17 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1762167017.678021:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee37fb7a200/0xf915a5bdf3d0b3bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb3cb7 expref: 17 pid: 7858 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1762167017.678033:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167017.678035:0:29775:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167017.678040:0:29775:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.678049:0:29775:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.678080:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167017.678118:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2360:x1847765452050304:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.678125:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7699 00010000:00010000:2.0:1762167017.678348:0:26444:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.678358:0:26444:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.678367:0:26444:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.678374:0:26444:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.678400:0:26444:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762167017.678441:0:32135:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762167017.678447:0:32135:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.678455:0:32135:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3a00 already unused, calling callback (ffffffffc1709320) 00010000:00010000:1.0:1762167017.678459:0:32135:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.678468:0:32135:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.678480:0:32135:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.678486:0:32135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c6f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.678501:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167017.678503:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762167017.678504:0:32135:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762167017.678797:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3293:x1847765454560000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3593us (4070us total) trans 17179876151 rc 0/0 00000100:00100000:2.0:1762167017.678806:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17579 00000004:00080000:0.0:1762167017.678830:0:3293:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee345730700/2, rc 0, transno 17179876151 00000100:00100000:0.0:1762167017.678839:0:3293:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee345730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1847765454560000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762167017.827069:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.827149:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452050432 00000100:00100000:2.0:1762167017.827159:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452050432 00000100:00100000:2.0:1762167017.827220:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20143 00000100:00100000:2.0:1762167017.827231:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12bd460f-a83f-41fe-92df-dfba4795e03a+5:57212:x1847765452050432:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:2.0:1762167017.827251:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167017.827271:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb43f6 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.827341:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c6ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167017.827355:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167017.827367:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:2.0:1762167017.827432:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:2.0:1762167017.827436:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:2.0:1762167017.827459:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167017.827481:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c200/0xf915a5bdf3d0c6f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43f6 expref: 7 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.827497:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1d400/0xf915a5bdf3d0c6ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43f6 expref: 6 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.827505:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:2.0:1762167017.827508:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762167017.827512:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d400, rc 0) 00000100:00100000:2.0:1762167017.827570:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12bd460f-a83f-41fe-92df-dfba4795e03a+6:57212:x1847765452050432:12345-192.168.203.35@tcp:101:stat.0 Request processed in 341us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.827577:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20143 00000100:00100000:0.0:1762167017.829338:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.829375:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452050560 00000100:00100000:0.0:1762167017.829384:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452050560 00000100:00100000:0.0:1762167017.829438:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20144 00000100:00100000:0.0:1762167017.829454:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12bd460f-a83f-41fe-92df-dfba4795e03a+6:57212:x1847765452050560:12345-192.168.203.35@tcp:101:stat.0 00010000:00010000:0.0:1762167017.829471:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167017.829489:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb43fd expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.829543:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c70d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829555:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c70d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829563:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c70d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829576:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c714 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829582:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829588:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829687:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829696:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829702:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167017.829732:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00000004:00200000:0.0:1762167017.829736:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167017.829751:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829813:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829822:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c70d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829828:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c70d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829833:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c70d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829839:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167017.829842:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c70d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829848:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c70d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829858:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:0.0:1762167017.829861:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167017.829865:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c70d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829870:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c70d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829877:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829883:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c714 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829887:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c714 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829891:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167017.829893:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c714 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829898:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c714 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829903:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167017.829905:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167017.829907:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c714 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829912:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c714 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.829936:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43fd expref: 8 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.829945:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43fd expref: 7 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.829951:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167017.829953:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167017.829956:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3c00, rc 0) 00000100:00100000:0.0:1762167017.830003:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12bd460f-a83f-41fe-92df-dfba4795e03a+7:57212:x1847765452050560:12345-192.168.203.35@tcp:101:stat.0 Request processed in 557us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.830010:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20144 00000100:00100000:3.0:1762167017.834702:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.834953:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452050688 00000100:00100000:0.0:1762167017.834970:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452050688 00000100:00100000:0.0:1762167017.835062:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20145 00000100:00100000:0.0:1762167017.835079:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+6:57218:x1847765452050688:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167017.835107:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167017.835133:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c722 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4404 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.835214:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c729 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835231:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835258:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835274:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c730 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835281:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835288:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835458:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835468:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835476:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167017.835521:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00000004:00200000:0.0:1762167017.835527:0:32138:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1762167017.835556:0:32138:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835570:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835580:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835587:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c729 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835594:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c729 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835601:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3a00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167017.835606:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c729 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835615:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c729 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835630:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:0.0:1762167017.835634:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167017.835640:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c729 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835646:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c729 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835662:0:32138:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835669:0:32138:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c730 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835675:0:32138:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835681:0:32138:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167017.835685:0:32138:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835692:0:32138:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c730 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835701:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167017.835705:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167017.835709:0:32138:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c730 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835716:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c730 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.835800:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4404 expref: 8 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.835821:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4404 expref: 7 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.835831:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167017.835834:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167017.835838:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2800, rc 0) 00000100:00100000:0.0:1762167017.835939:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:57218:x1847765452050688:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 865us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.835949:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20145 00000100:00100000:3.0:1762167017.839723:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.839909:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452050944 00000100:00100000:0.0:1762167017.839927:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452050944 00000100:00100000:0.0:1762167017.840002:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20146 00000100:00100000:0.0:1762167017.840015:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+7:57218:x1847765452050944:12345-192.168.203.35@tcp:101:lfs.0 00010000:00010000:0.0:1762167017.840041:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167017.840067:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c73e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb440b expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.840201:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c745 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.840217:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c745 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:0.0:1762167017.840231:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c745 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:0.0:1762167017.840245:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:0.0:1762167017.840478:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c73e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb440b expref: 10 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.840502:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c745 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb440b expref: 9 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.840512:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167017.840516:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762167017.840521:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2e00, rc 0) 00000100:00100000:0.0:1762167017.840613:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+9:57218:x1847765452050944:12345-192.168.203.35@tcp:101:lfs.0 Request processed in 600us (899us total) trans 8589953228 rc 0/0 00000100:00100000:0.0:1762167017.840621:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20146 00000100:00100000:3.0:1762167017.842935:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.842936:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.843004:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.843013:0:29775:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452051072 00000100:00100000:1.0:1762167017.843024:0:29775:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452051072 00000100:00100000:0.0:1762167017.843047:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452051328 00000100:00100000:0.0:1762167017.843053:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452051328 00000100:00100000:1.0:1762167017.843103:0:29775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 666 00000100:00100000:0.0:1762167017.843103:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7414 00000100:00100000:1.0:1762167017.843119:0:29775:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+10:2361:x1847765452051072:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762167017.843121:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36cba2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+10:57218:x1847765452051328:12345-192.168.203.35@tcp:35:lfs.0 00010000:00010000:1.0:1762167017.843147:0:29775:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762167017.843177:0:29775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c745 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb440b expref: 10 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.843204:0:29775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167017.843210:0:29775:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167017.843289:0:29775:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+9:2361:x1847765452051072:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 173us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.843298:0:29775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 666 00000100:00100000:3.0:1762167017.843348:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.843402:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452051712 00000100:00100000:2.0:1762167017.843411:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452051712 00000100:00100000:0.0:1762167017.843429:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36cba2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+9:57218:x1847765452051328:12345-192.168.203.35@tcp:35:lfs.0 Request processed in 307us (418us total) trans 8589953229 rc 0/0 00000100:00100000:3.0:1762167017.843432:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.843446:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7414 00000100:00100000:2.0:1762167017.843477:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452051840 00000100:00100000:2.0:1762167017.843485:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452051840 00000100:00100000:1.0:1762167017.843526:0:32138:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452052096 00000100:00100000:1.0:1762167017.843534:0:32138:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452052096 00000100:00100000:2.0:1762167017.843545:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20147 00000100:00100000:2.0:1762167017.843565:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12bd460f-a83f-41fe-92df-dfba4795e03a+7:57222:x1847765452051712:12345-192.168.203.35@tcp:101:cat.0 00000100:00100000:1.0:1762167017.843577:0:32138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20148 00010000:00010000:2.0:1762167017.843588:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762167017.843589:0:32138:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:57223:x1847765452051840:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:1.0:1762167017.843610:0:32138:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167017.843618:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4412 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.843626:0:32138:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c75a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4419 expref: -99 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.843707:0:32138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c761 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32138 initiator: MDT0 00010000:00010000:1.0:1762167017.843738:0:32138:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c761 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32138 initiator: MDT0 00010000:00010000:2.0:1762167017.843742:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167017.843755:0:32138:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c761 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 32138 initiator: MDT0 00000004:00200000:1.0:1762167017.843799:0:32138:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:2.0:1762167017.843804:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167017.843821:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:3.0:1762167017.843823:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20149 00000004:00200000:2.0:1762167017.843841:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00000100:00100000:3.0:1762167017.843843:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:57219:x1847765452052096:12345-192.168.203.35@tcp:101:multiop.0 00010000:00010000:3.0:1762167017.843859:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762167017.843876:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0c776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4420 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.843915:0:32138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c75a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4419 expref: 896 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.843935:0:32138:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c761 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4419 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.843945:0:32138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167017.843948:0:32138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762167017.843951:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167017.843953:0:32138:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9800, rc 0) 00010000:00010000:3.0:1762167017.843975:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43ef expref: 895 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.843985:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43fd expref: 9 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167017.843996:0:32138:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:57223:x1847765452051840:12345-192.168.203.35@tcp:101:cat.0 Request processed in 406us (704us total) trans 8589953230 rc 0/0 00010000:00010000:3.0:1762167017.843997:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4404 expref: 8 pid: 32138 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762167017.844028:0:32138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20148 00010000:00010000:3.0:1762167017.844029:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:3.0:1762167017.844041:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 7/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.844070:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4412 expref: 10 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.844093:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4412 expref: 9 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.844116:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4412 expref: 9 pid: 30818 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.844132:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 6/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4412 expref: 9 pid: 30818 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.844136:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560256:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167017.844151:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 6/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4412 expref: 9 pid: 30818 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.844162:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1c400, rc 0) 00000100:00100000:2.0:1762167017.844242:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12bd460f-a83f-41fe-92df-dfba4795e03a+9:57222:x1847765452051712:12345-192.168.203.35@tcp:101:cat.0 Request processed in 685us (1325us total) trans 8589953231 rc 0/0 00000100:00100000:2.0:1762167017.844253:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20147 00010000:00010000:3.0:1762167017.844275:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4404 expref: 8 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.844294:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4404 expref: 8 pid: 32138 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.844320:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc59880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560384:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167017.844381:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43fd expref: 8 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.844392:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43fd expref: 8 pid: 32138 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.844403:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fc5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560512:192.168.203.35@tcp:104: 00010000:00010000:3.0:1762167017.844534:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43ef expref: 894 pid: 31205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.844548:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43ef expref: 894 pid: 31205 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.844558:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560640:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167017.844879:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee34881f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762167017.845706:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560256:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167017.845718:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc59880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560384:192.168.203.35@tcp:104: 00000100:00100000:3.0:1762167017.845727:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fc5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560512:192.168.203.35@tcp:104: 00000100:00100000:0.0:1762167017.846140:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.846197:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452052224 00000100:00100000:2.0:1762167017.846206:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452052224 00010000:00010000:2.0:1762167017.846270:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4404 expref: 9 pid: 32138 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.846335:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7700 00000100:00100000:2.0:1762167017.846348:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee347ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+9:2360:x1847765452052224:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167017.846366:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167017.846377:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4404 expref: 9 pid: 32138 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.846392:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4404 expref: 9 pid: 32138 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.846420:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c737 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4404 expref: 9 pid: 32138 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.846439:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167017.846446:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.846457:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.846468:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167017.846471:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee36e62a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560640:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167017.846524:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167017.846546:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee347ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e369e7-58c9-4605-91cc-bb6f1ca9b31b+8:2360:x1847765452052224:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 200us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.846556:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7700 00000100:00100000:0.0:1762167017.847397:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.847446:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.847484:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452052352 00000100:00100000:2.0:1762167017.847494:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452052352 00000100:00100000:0.0:1762167017.847497:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.847539:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167017.847545:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43fd expref: 9 pid: 32138 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.847549:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452052480 00000100:00100000:3.0:1762167017.847555:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452052480 00000100:00100000:0.0:1762167017.847574:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.847587:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452052608 00000100:00100000:2.0:1762167017.847591:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452052608 00010000:00010000:2.0:1762167017.847607:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43ef expref: 895 pid: 31205 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1762167017.847610:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452052864 00000100:00100000:0.0:1762167017.847610:0:5742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452052736 00000100:00100000:0.0:1762167017.847617:0:5742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452052736 00000100:00100000:3.0:1762167017.847618:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452052864 00000100:00100000:2.0:1762167017.847641:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7701 00010000:00010000:0.0:1762167017.847643:0:5742:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4412 expref: 11 pid: 30818 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.847660:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+11:2360:x1847765452052352:12345-192.168.203.35@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762167017.847665:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20150 00000100:00100000:0.0:1762167017.847671:0:5742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7702 00000100:00100000:3.0:1762167017.847680:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12bd460f-a83f-41fe-92df-dfba4795e03a+11:57222:x1847765452052480:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:2.0:1762167017.847680:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762167017.847681:0:5742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2360:x1847765452052608:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167017.847693:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43fd expref: 11 pid: 32138 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.847696:0:5742:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762167017.847703:0:5742:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43ef expref: 896 pid: 31205 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.847705:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167017.847711:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43fd expref: 11 pid: 32138 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.847721:0:5742:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43ef expref: 896 pid: 31205 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1762167017.847726:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0c78b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4427 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.847742:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c71b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43fd expref: 12 pid: 32138 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.847756:0:5742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922400/0xf915a5bdf3d0c65e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb43ef expref: 896 pid: 31205 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.847757:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:3.0:1762167017.847859:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167017.847860:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.847878:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.847886:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167017.847888:0:5742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167017.847894:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167017.847902:0:5742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167017.847908:0:5742:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762167017.847912:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:3.0:1762167017.847923:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167017.847937:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345733800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+11:2360:x1847765452052352:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 284us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.847941:0:5742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+895:2360:x1847765452052608:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 261us (449us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167017.847943:0:30818:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167017.847952:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7701 00000100:00100000:0.0:1762167017.847963:0:5742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7702 00010000:00010000:3.0:1762167017.847965:0:30818:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167017.847994:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7703 00000100:00100000:2.0:1762167017.848006:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+10:2360:x1847765452052736:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167017.848016:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167017.848022:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4412 expref: 10 pid: 30818 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.848040:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4412 expref: 10 pid: 30818 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.848051:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee381f1c400/0xf915a5bdf3d0c768 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4412 expref: 10 pid: 30818 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.848062:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167017.848064:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.848070:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.848075:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.848080:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167017.848084:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167017.848087:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167017.848112:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762167017.848139:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167017.848141:0:33893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20151 00000100:00100000:2.0:1762167017.848152:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+9:2360:x1847765452052736:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 146us (613us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167017.848152:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 30819 initiator: MDT0 00000100:00100000:3.0:1762167017.848160:0:33893:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:57223:x1847765452052864:12345-192.168.203.35@tcp:101:cat.0 00000100:00100000:2.0:1762167017.848171:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7703 00010000:00010000:3.0:1762167017.848179:0:33893:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:0.0:1762167017.848184:0:30819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00010000:00010000:3.0:1762167017.848188:0:33893:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c799 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb442e expref: -99 pid: 33893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.848346:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922a00/0xf915a5bdf3d0c776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4420 expref: 897 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.848378:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4420 expref: 896 pid: 30819 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1762167017.848388:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4420 expref: 896 pid: 30819 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.848389:0:33893:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167017.848405:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923400, rc 0) 00010000:00010000:2.0:1762167017.848408:0:33893:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 33893 initiator: MDT0 00010000:00010000:2.0:1762167017.848419:0:33893:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00000100:00100000:0.0:1762167017.848455:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24550c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:57219:x1847765452052096:12345-192.168.203.35@tcp:101:multiop.0 Request processed in 4619us (5035us total) trans 8589953232 rc 0/0 00000100:00100000:0.0:1762167017.848466:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20149 00000100:00100000:0.0:1762167017.851438:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.851490:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452052992 00000100:00100000:2.0:1762167017.851500:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452052992 00010000:00010000:2.0:1762167017.851538:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4420 expref: 896 pid: 30819 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.851648:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7704 00000100:00100000:2.0:1762167017.851659:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765452052992:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167017.851676:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167017.851685:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4420 expref: 896 pid: 30819 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.851700:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4420 expref: 896 pid: 30819 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.851724:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923400/0xf915a5bdf3d0c784 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x64f:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4420 expref: 896 pid: 30819 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1762167017.851735:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167017.851743:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167017.851749:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167017.851759:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167017.851808:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167017.851816:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00010000:00010000:2.0:1762167017.851822:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 33893 initiator: MDT0 00010000:00010000:2.0:1762167017.851827:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 33893 initiator: MDT0 00010000:00010000:2.0:1762167017.851869:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762167017.851874:0:30819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452053248 00000100:00100000:1.0:1762167017.851881:0:30819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452053248 00000100:00100000:1.0:1762167017.851920:0:30819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20152 00000100:00100000:2.0:1762167017.851926:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:2361:x1847765452052992:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 266us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.851934:0:30819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+896:57219:x1847765452053248:12345-192.168.203.35@tcp:101:multiop.0 00000100:00100000:2.0:1762167017.851940:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7704 00010000:00010000:1.0:1762167017.851960:0:30819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167017.851964:0:30819:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762167017.851979:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9800/0xf915a5bdf3d0c761 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4419 expref: 895 pid: 32138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.851990:0:30818:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167017.851999:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36f35f800/0xf915a5bdf3d0c55b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb430f expref: 894 pid: 30817 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.852000:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167017.852018:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:1.0:1762167017.852023:0:30819:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762167017.852035:0:30819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c7ae lrc: 2/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4435 expref: -99 pid: 30819 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1762167017.852054:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00000004:00200000:2.0:1762167017.852060:0:30818:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1762167017.852073:0:30819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30819 initiator: MDT0 00000004:00010000:2.0:1762167017.852080:0:30818:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167017.852085:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:1.0:1762167017.852094:0:30819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 33893 initiator: MDT0 00010000:00010000:1.0:1762167017.852160:0:30819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30819 initiator: MDT0 00010000:00010000:1.0:1762167017.852179:0:30819:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 33893 initiator: MDT0 00010000:00010000:2.0:1762167017.852196:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922800/0xf915a5bdf3d0c78b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4427 expref: 9 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.852203:0:30819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4427 expref: 9 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762167017.852219:0:30819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4427 expref: 8 pid: 30818 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.852231:0:30818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 6/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4427 expref: 8 pid: 30818 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1762167017.852234:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee242409500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560768:192.168.203.35@tcp:104: 00010000:00010000:2.0:1762167017.852252:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 6/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4427 expref: 8 pid: 30818 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.852259:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922c00, rc 0) 00000100:00100000:1.0:1762167017.852295:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee3605159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762167017.852595:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12bd460f-a83f-41fe-92df-dfba4795e03a+8:57222:x1847765452052480:12345-192.168.203.35@tcp:101:cat.0 Request processed in 4919us (5147us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.852603:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20150 00000100:00100000:0.0:1762167017.852803:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.852953:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452053504 00000100:00100000:0.0:1762167017.852959:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452053504 00000100:00100000:0.0:1762167017.853005:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20153 00000100:00100000:0.0:1762167017.853016:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12bd460f-a83f-41fe-92df-dfba4795e03a+8:57224:x1847765452053504:12345-192.168.203.35@tcp:101:multiop.0 00010000:00010000:0.0:1762167017.853027:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167017.853041:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb443c expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.853099:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c7c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853112:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853122:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853138:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c7ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853145:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c7ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853153:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c7ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00010000:00010000:2.0:1762167017.853293:0:33893:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 33893 initiator: MDT0 00010000:00010000:2.0:1762167017.853303:0:33893:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 33893 initiator: MDT0 00010000:00010000:0.0:1762167017.853330:0:30818:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c7d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853340:0:30818:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00000004:00200000:2.0:1762167017.853345:0:33893:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00000004:00200000:2.0:1762167017.853351:0:33893:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:0.0:1762167017.853352:0:30818:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30818 initiator: MDT0 00000004:00200000:0.0:1762167017.853362:0:30818:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x64f:0x0]: returning size 0 00000004:00010000:2.0:1762167017.853369:0:33893:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 33893 initiator: MDT0 00010000:00010000:2.0:1762167017.853399:0:33893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923600/0xf915a5bdf3d0c799 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb442e expref: 895 pid: 33893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.853418:0:33893:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb442e expref: 894 pid: 33893 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.853433:0:33893:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb442e expref: 894 pid: 33893 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.853440:0:33893:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923a00, rc 0) 00010000:00010000:0.0:1762167017.853485:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853495:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c7d1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167017.853500:0:33893:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:57223:x1847765452052864:12345-192.168.203.35@tcp:101:cat.0 Request processed in 5344us (5923us total) trans 0 rc 0/0 00010000:00010000:0.0:1762167017.853504:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00000100:00100000:2.0:1762167017.853515:0:33893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20151 00010000:00010000:0.0:1762167017.853524:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3c00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167017.853528:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853536:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853633:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167017.853637:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1762167017.853641:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c7d1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853646:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c7d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853660:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853666:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c7c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853671:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c7c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853676:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3e00 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167017.853678:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c7c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853684:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c7c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853691:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:0.0:1762167017.853693:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167017.853697:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c7c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853702:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3e00/0xf915a5bdf3d0c7c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853711:0:30818:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c7ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853716:0:30818:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c7ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853722:0:30818:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c7ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853725:0:30818:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9ee36e4b3200 already unused, calling callback (ffffffffc2129310) 00010000:00010000:0.0:1762167017.853728:0:30818:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c7ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853734:0:30818:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c7ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853741:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff9ee381d9b900) 00010000:00010000:0.0:1762167017.853743:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762167017.853746:0:30818:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c7ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853751:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3200/0xf915a5bdf3d0c7ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30818 initiator: MDT0 00010000:00010000:0.0:1762167017.853805:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb443c expref: 10 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.853816:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ee342c23300) 00010000:00010000:0.0:1762167017.853818:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762167017.853824:0:30818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb443c expref: 10 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.853833:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3a00, rc 0) 00000100:00100000:0.0:1762167017.853872:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12bd460f-a83f-41fe-92df-dfba4795e03a+9:57224:x1847765452053504:12345-192.168.203.35@tcp:101:multiop.0 Request processed in 859us (1113us total) trans 8589953233 rc 301/301 00000100:00100000:0.0:1762167017.853879:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20153 00000100:00100000:0.0:1762167017.854058:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee242409500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560768:192.168.203.35@tcp:104: 00010000:00010000:0.0:1762167017.854091:0:30819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:1.0:1762167017.855075:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.855139:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452053632 00000100:00100000:2.0:1762167017.855149:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452053632 00000100:00100000:1.0:1762167017.855171:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.855223:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17580 00000100:00100000:2.0:1762167017.855235:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12bd460f-a83f-41fe-92df-dfba4795e03a+5:57222:x1847765452053632:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:2.0:1762167017.855251:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1762167017.855262:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1762167017.855275:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c7df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4443 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762167017.855304:0:26444:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x81f:0x0] initial LVB size: 0, mtime: 0x690888e9, atime: 0x690888e9, ctime: 0x690888e9, blocks: 0x1 00010000:00010000:2.0:1762167017.855340:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.855342:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.855351:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c7df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4443 expref: 6 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.855367:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee381f1ca00/0xf915a5bdf3d0c7df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4443 expref: 6 pid: 26444 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.855378:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1ca00, rc 0) 00000100:00100000:2.0:1762167017.855447:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12bd460f-a83f-41fe-92df-dfba4795e03a+6:57222:x1847765452053632:12345-192.168.203.35@tcp:101:cat.0 Request processed in 214us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.855454:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17580 00000100:00100000:2.0:1762167017.855490:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452053760 00000100:00100000:2.0:1762167017.855493:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452053760 00010000:00010000:2.0:1762167017.855508:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4427 expref: 9 pid: 30818 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.855535:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7705 00000100:00100000:2.0:1762167017.855542:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+9:2360:x1847765452053760:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167017.855554:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167017.855560:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4427 expref: 9 pid: 30818 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.855573:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4427 expref: 9 pid: 30818 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.855594:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347922c00/0xf915a5bdf3d0c792 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4427 expref: 9 pid: 30818 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.855607:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167017.855612:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.855619:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.855625:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762167017.855649:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+8:2360:x1847765452053760:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 108us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.855657:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7705 00000100:00100000:0.0:1762167017.855808:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:2.0:1762167017.855844:0:5740:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452053888 00000100:00100000:2.0:1762167017.855849:0:5740:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452053888 00010000:00010000:2.0:1762167017.855866:0:5740:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb442e expref: 894 pid: 33893 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1762167017.855905:0:5740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7706 00000100:00100000:2.0:1762167017.855914:0:5740:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765452053888:12345-192.168.203.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762167017.855923:0:5740:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762167017.855928:0:5740:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb442e expref: 894 pid: 33893 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.855939:0:5740:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb442e expref: 894 pid: 33893 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1762167017.855955:0:5740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee347923a00/0xf915a5bdf3d0c7a7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x64f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb442e expref: 894 pid: 33893 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1762167017.855961:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00010000:00010000:2.0:1762167017.855973:0:5740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:2.0:1762167017.855979:0:5740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.855987:0:5740:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00000100:00100000:0.0:1762167017.855989:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452054016 00000100:00100000:0.0:1762167017.855995:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452054016 00010000:00010000:2.0:1762167017.855997:0:5740:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30819 initiator: MDT0 00010000:00010000:2.0:1762167017.856031:0:5740:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762167017.856036:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20154 00000100:00100000:0.0:1762167017.856047:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:57223:x1847765452054016:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762167017.856058:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167017.856063:0:30819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000100:00100000:2.0:1762167017.856065:0:5740:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:2361:x1847765452053888:12345-192.168.203.35@tcp:103:ldlm_bl.0 Request processed in 151us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1762167017.856072:0:5740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7706 00010000:00010000:1.0:1762167017.856072:0:30819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167017.856073:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c7e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb444a expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.856124:0:30818:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30819 initiator: MDT0 00000004:02000000:1.0:1762167017.856125:0:30819:0:(lod_object.c:7768:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00010000:00010000:0.0:1762167017.856138:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c7e6 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb444a expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.856157:0:30818:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 30819 initiator: MDT0 00010000:00010000:0.0:1762167017.856169:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c7e6 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb444a expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.856179:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167017.856183:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167017.856186:0:30818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c7e6 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb444a expref: 894 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.856193:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2800, rc 0) 00000100:00100000:0.0:1762167017.856229:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee242408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+894:57223:x1847765452054016:12345-192.168.203.35@tcp:101:cat.0 Request processed in 185us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.856236:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20154 00000100:00100000:3.0:1762167017.857103:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.857498:0:30818:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452054144 00000100:00100000:0.0:1762167017.857505:0:30818:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452054144 00000100:00100000:0.0:1762167017.857550:0:30818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 20155 00000100:00100000:0.0:1762167017.857559:0:30818:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12bd460f-a83f-41fe-92df-dfba4795e03a+8:57222:x1847765452054144:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762167017.857576:0:30818:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167017.857590:0:30818:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c7ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4451 expref: -99 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.857635:0:30818:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c7ed lrc: 3/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4451 expref: 9 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.857652:0:30818:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c7ed lrc: 3/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4451 expref: 9 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.857662:0:30818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:0.0:1762167017.857665:0:30818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762167017.857669:0:30818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c7e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb444a expref: 893 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.857677:0:30818:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2e00, rc 0) 00000100:00100000:0.0:1762167017.857739:0:30818:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12bd460f-a83f-41fe-92df-dfba4795e03a+9:57222:x1847765452054144:12345-192.168.203.35@tcp:101:cat.0 Request processed in 172us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.857746:0:30818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20155 00000004:00080000:1.0:1762167017.859070:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x823:0x0], index 1: 0 00000004:00080000:1.0:1762167017.859086:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x824:0x0], index 1: 0 00000004:00080000:1.0:1762167017.859091:0:30819:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x821:0x0], index 0: 0 00000040:00080000:1.0:1762167017.859319:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5687, 88 off460448 00000004:00080000:1.0:1762167017.859331:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638651568170ns, next at 639432226677ns, rc = 0 00000040:00080000:1.0:1762167017.859405:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5695, 88 off461504 00000004:00080000:1.0:1762167017.859417:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638651653788ns, next at 639432380558ns, rc = 0 00000040:00080000:1.0:1762167017.859477:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5696, 88 off461592 00000004:00080000:1.0:1762167017.859485:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638651722075ns, next at 639432380558ns, rc = 0 00000040:00080000:1.0:1762167017.859539:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5688, 88 off460536 00000004:00080000:1.0:1762167017.859546:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638651782340ns, next at 639432226677ns, rc = 0 00000040:00080000:1.0:1762167017.859578:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].5697, 88 off461680 00000004:00080000:1.0:1762167017.859583:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638651820417ns, next at 639432380558ns, rc = 0 00000040:00080000:1.0:1762167017.859646:0:30819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5689, 88 off460624 00000004:00080000:1.0:1762167017.859652:0:30819:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638651889587ns, next at 639432226677ns, rc = 0 00010000:00010000:3.0:1762167017.875683:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4435 expref: 895 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.875707:0:30819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x64f:0x0].0x0 (ffff9ee381d9b600) 00010000:00010000:3.0:1762167017.875711:0:30819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762167017.875717:0:30819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c7e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb444a expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.875731:0:30819:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c7e6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb444a expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.875741:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c7e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb444a expref: 895 pid: 30818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.875751:0:30819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c7ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4451 expref: 8 pid: 30818 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167017.875818:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953233 is committed 00010000:00010000:3.0:1762167017.875831:0:30819:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c7ed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4451 expref: 8 pid: 30818 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167017.875836:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953232 is committed 00000001:00080000:0.0:1762167017.875846:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953229 is committed 00010000:00010000:3.0:1762167017.875851:0:30819:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c7ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4451 expref: 7 pid: 30818 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762167017.875861:0:30849:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589953234 is committed 00000004:00080000:0.0:1762167017.875868:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3786 committed 00000004:00080000:0.0:1762167017.875881:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3799 committed 00000004:00080000:0.0:1762167017.875888:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3785 committed 00000004:00080000:0.0:1762167017.875891:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3798 committed 00000004:00080000:0.0:1762167017.875895:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3797 committed 00000004:00080000:0.0:1762167017.875897:0:30849:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3784 committed 00010000:00010000:3.0:1762167017.875913:0:30819:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2e00/0xf915a5bdf3d0c7ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4451 expref: 6 pid: 30818 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1762167017.875913:0:30849:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969187 batchid updated 00000100:00100000:3.0:1762167017.875937:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560896:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167017.876090:0:30819:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ee36e4b2800/0xf915a5bdf3d0c7e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb444a expref: 892 pid: 30818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167017.876109:0:30819:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee372a4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454561280:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167017.876149:0:30819:0:(client.c:2680:ptlrpc_set_wait()) set ffff9ee36e62fc00 going to sleep for 11 seconds 00000020:00080000:0.0:1762167017.876186:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969187 00000020:00080000:0.0:1762167017.876198:0:30853:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969187 00000100:00100000:0.0:1762167017.876217:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454561024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.876278:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.876326:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454561664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167017.876356:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.876394:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1762167017.876400:0:3294:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee37fb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454561536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167017.876421:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.876455:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454561152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.876480:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.876496:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24732c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454561792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167017.876515:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.876532:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762167017.876539:0:3295:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454561408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.876557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762167017.876598:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454561024 00000100:00100000:0.0:1762167017.876606:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454561024 00000100:00100000:3.0:1762167017.876615:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454561664 00000100:00100000:3.0:1762167017.876625:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454561664 00000100:00100000:0.0:1762167017.876663:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454561536 00000100:00100000:0.0:1762167017.876670:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454561536 00000100:00100000:3.0:1762167017.876699:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454561152 00000100:00100000:2.0:1762167017.876705:0:34499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454561408 00000100:00100000:0.0:1762167017.876705:0:33894:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765454561792 00000100:00100000:3.0:1762167017.876707:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454561152 00000100:00100000:2.0:1762167017.876712:0:34499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454561408 00000100:00100000:0.0:1762167017.876712:0:33894:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765454561792 00000100:00100000:3.0:1762167017.876810:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17581 00000100:00100000:2.0:1762167017.876821:0:34499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17582 00000100:00100000:3.0:1762167017.876828:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454561024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.876837:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17583 00000100:00100000:2.0:1762167017.876839:0:34499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24518a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454561664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762167017.876849:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3294:x1847765454561536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1762167017.877141:0:26444:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762167017.877146:0:26444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb mtime from disk: 1762167017 -> 1762167017 00002000:00010000:3.0:1762167017.877150:0:26444:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb atime from disk: 1762167017 -> 1762167017 00002000:00010000:3.0:1762167017.877153:0:26444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb ctime from disk: 1762167017 -> 1762167017 00002000:00010000:3.0:1762167017.877157:0:26444:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x81f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1762167017.877164:0:34499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24518a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454561664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 325us (800us total) trans 17179876152 rc 0/0 00000100:00100000:0.0:1762167017.877164:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3294:x1847765454561536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 310us (734us total) trans 17179876153 rc 0/0 00000100:00100000:2.0:1762167017.877174:0:34499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17582 00000100:00100000:0.0:1762167017.877179:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17583 00000100:00100000:2.0:1762167017.877194:0:34499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17584 00000100:00100000:0.0:1762167017.877198:0:33894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17585 00000100:00100000:2.0:1762167017.877208:0:34499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36f445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454561152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762167017.877208:0:33894:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454561792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167017.877225:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24732f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3294:x1847765454561024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 402us (944us total) trans 21474843734 rc 0/0 00000100:00100000:3.0:1762167017.877235:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17581 00000100:00100000:3.0:1762167017.877274:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17586 00000100:00100000:3.0:1762167017.877286:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3295:x1847765454561408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762167017.877438:0:34499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36f445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454561152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 235us (955us total) trans 21474843735 rc 0/0 00000100:00100000:0.0:1762167017.877438:0:33894:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee245188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454561792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (917us total) trans 17179876154 rc 0/0 00000100:00100000:2.0:1762167017.877448:0:34499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17584 00000100:00100000:0.0:1762167017.877454:0:33894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17585 00000004:00080000:0.0:1762167017.877547:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550ea00/2, rc 0, transno 21474843735 00000100:00100000:0.0:1762167017.877552:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454561152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167017.877562:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24732c380/2, rc 0, transno 17179876154 00000100:00100000:0.0:1762167017.877566:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24732c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454561792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167017.877581:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb10700/2, rc 0, transno 17179876153 00000100:00100000:0.0:1762167017.877584:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454561536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762167017.877593:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550c000/2, rc 0, transno 21474843734 00000100:00100000:0.0:1762167017.877597:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454561024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762167017.877605:0:3294:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee37fb10000/2, rc 0, transno 17179876152 00000100:00100000:0.0:1762167017.877608:0:3294:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee37fb10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1847765454561664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762167017.877689:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3295:x1847765454561408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 406us (1127us total) trans 21474843736 rc 0/0 00000100:00100000:3.0:1762167017.877697:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17586 00000004:00080000:1.0:1762167017.877993:0:3295:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9ee24550d500/2, rc 0, transno 21474843736 00000100:00100000:1.0:1762167017.878005:0:3295:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee24550d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1847765454561408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762167017.878683:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.878837:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.879010:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454560896:192.168.203.35@tcp:105: 00000100:00100000:3.0:1762167017.879049:0:30819:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff9ee372a4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30819:1847765454561280:192.168.203.35@tcp:105: 00010000:00010000:3.0:1762167017.879216:0:30819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b8200/0xf915a5bdf3d0c7ae lrc: 0/0,0 mode: --/EX res: [0x200000404:0x64f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4435 expref: 892 pid: 30819 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1762167017.879254:0:30819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ee3819b9600/0xf915a5bdf3d0c7b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x64f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4435 expref: 891 pid: 30819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762167017.879340:0:30819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9600, rc 0) 00000100:00100000:0.0:1762167017.879342:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452054272 00000100:00100000:0.0:1762167017.879352:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452054272 00000100:00100000:0.0:1762167017.879405:0:33886:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452054400 00000100:00100000:0.0:1762167017.879410:0:33886:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452054400 00000100:00100000:3.0:1762167017.879432:0:30819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee345730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:57219:x1847765452053248:12345-192.168.203.35@tcp:101:multiop.0 Request processed in 27498us (27695us total) trans 8589953234 rc 0/0 00000100:00100000:0.0:1762167017.879442:0:33886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7415 00000100:00100000:3.0:1762167017.879449:0:30819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 20152 00000100:00100000:1.0:1762167017.879459:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7416 00000100:00100000:0.0:1762167017.879460:0:33886:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:12bd460f-a83f-41fe-92df-dfba4795e03a+7:57222:x1847765452054272:12345-192.168.203.35@tcp:49:cat.0 00000100:00100000:1.0:1762167017.879478:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:57223:x1847765452054400:12345-192.168.203.35@tcp:49:cat.0 00000100:00100000:0.0:1762167017.879588:0:33886:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:12bd460f-a83f-41fe-92df-dfba4795e03a+7:57222:x1847765452054272:12345-192.168.203.35@tcp:49:cat.0 Request processed in 132us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.879591:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee24240bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:57223:x1847765452054400:12345-192.168.203.35@tcp:49:cat.0 Request processed in 119us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.879602:0:33886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7415 00000100:00100000:1.0:1762167017.879609:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7416 00000100:00100000:3.0:1762167017.882216:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.882263:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.882380:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452054528 00000100:00100000:1.0:1762167017.882390:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452054528 00000100:00100000:3.0:1762167017.882396:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.882441:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7417 00000100:00100000:1.0:1762167017.882452:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:57219:x1847765452054528:12345-192.168.203.35@tcp:49:multiop.0 00000100:00100000:0.0:1762167017.882528:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452054656 00000100:00100000:0.0:1762167017.882533:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452054656 00000100:00100000:3.0:1762167017.882590:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.882631:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452054784 00000100:00100000:0.0:1762167017.882635:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452054784 00000100:00100000:1.0:1762167017.882654:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:57219:x1847765452054528:12345-192.168.203.35@tcp:49:multiop.0 Request processed in 202us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.882660:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.882660:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452054912 00000100:00100000:0.0:1762167017.882664:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452054912 00000100:00100000:1.0:1762167017.882674:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7417 00000100:00100000:0.0:1762167017.882687:0:34501:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452055040 00000100:00100000:0.0:1762167017.882692:0:34501:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452055040 00000100:00100000:2.0:1762167017.882700:0:34499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17587 00000100:00100000:2.0:1762167017.882714:0:34499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12bd460f-a83f-41fe-92df-dfba4795e03a+6:2358:x1847765452054656:12345-192.168.203.35@tcp:101:cat.0 00000100:00100000:0.0:1762167017.882727:0:34501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17588 00010000:00010000:2.0:1762167017.882728:0:34499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762167017.882739:0:34501:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+10:57223:x1847765452054784:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762167017.882750:0:34501:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762167017.882752:0:34499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0c7f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4458 expref: -99 pid: 34499 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.882794:0:34501:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb445f expref: -99 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.882819:0:34501:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.882823:0:34501:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1762167017.882827:0:34499:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x823:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1762167017.882834:0:34501:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb445f expref: 11 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.882845:0:34499:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762167017.882848:0:34499:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.882857:0:34501:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b3a00/0xf915a5bdf3d0c7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x81f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb445f expref: 11 pid: 34501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762167017.882858:0:34499:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0c7f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4458 expref: 7 pid: 34499 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167017.882886:0:34501:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3a00, rc 0) 00010000:00010000:2.0:1762167017.882890:0:34499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee381f1d000/0xf915a5bdf3d0c7f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4458 expref: 7 pid: 34499 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167017.882900:0:34500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17589 00010000:00010000:2.0:1762167017.882904:0:34499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee381f1d000, rc 0) 00000100:00100000:3.0:1762167017.882911:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17590 00000100:00100000:1.0:1762167017.882913:0:34500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:12bd460f-a83f-41fe-92df-dfba4795e03a+7:2359:x1847765452054912:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:1.0:1762167017.882923:0:34500:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762167017.882928:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+6:2358:x1847765452055040:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:3.0:1762167017.882938:0:6532:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762167017.882938:0:34500:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c802 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4466 expref: -99 pid: 34500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.882941:0:34499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12bd460f-a83f-41fe-92df-dfba4795e03a+7:2358:x1847765452054656:12345-192.168.203.35@tcp:101:cat.0 Request processed in 230us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.882942:0:34501:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:57223:x1847765452054784:12345-192.168.203.35@tcp:101:cat.0 Request processed in 191us (531us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167017.882952:0:6532:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c809 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb446d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762167017.882962:0:34499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17587 00002000:00010000:1.0:1762167017.882970:0:34500:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x824:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:0.0:1762167017.882973:0:34501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17588 00002000:00010000:3.0:1762167017.882982:0:6532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x821:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1762167017.882983:0:34500:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167017.882986:0:34500:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762167017.882995:0:34500:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4466 expref: 7 pid: 34500 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167017.883009:0:34500:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee3819b9400/0xf915a5bdf3d0c802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4466 expref: 7 pid: 34500 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762167017.883018:0:34500:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee3819b9400, rc 0) 00010000:00010000:3.0:1762167017.883037:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.883041:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762167017.883046:0:34500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:12bd460f-a83f-41fe-92df-dfba4795e03a+7:2359:x1847765452054912:12345-192.168.203.35@tcp:101:cat.0 Request processed in 137us (456us total) trans 0 rc 0/0 00010000:00010000:3.0:1762167017.883050:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c809 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb446d expref: 7 pid: 6532 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762167017.883056:0:34500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17589 00010000:00010000:3.0:1762167017.883072:0:6532:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee347923200/0xf915a5bdf3d0c809 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb446d expref: 7 pid: 6532 timeout: 0 lvb_type: 1 00000100:00080000:1.0:1762167017.883077:0:5752:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1762167017.883090:0:6532:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347923200, rc 0) 00000100:00100000:3.0:1762167017.883115:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+7:2358:x1847765452055040:12345-192.168.203.35@tcp:101:cat.0 Request processed in 194us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.883121:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17590 00000100:00100000:0.0:1762167017.885114:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.885158:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.885190:0:26444:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452055168 00000100:00100000:0.0:1762167017.885190:0:14117:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452055296 00000100:00100000:3.0:1762167017.885199:0:26444:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452055168 00000100:00100000:0.0:1762167017.885199:0:14117:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452055296 00000100:00100000:3.0:1762167017.885249:0:26444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17591 00002000:00100000:0.0:1762167017.885257:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x81f:0x0] (0->4095) req@ffff9ee37f794700 x1847765452055296/t0(0) o3->12bd460f-a83f-41fe-92df-dfba4795e03a@192.168.203.35@tcp:48/0 lens 488/0 e 0 to 0 dl 1762167028 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1762167017.885262:0:26444:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+16:2359:x1847765452055168:12345-192.168.203.35@tcp:101:cat.0 00002000:00100000:0.0:1762167017.885274:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f794700 with x1847765452055296 ext(0->4095) 00010000:00010000:3.0:1762167017.885281:0:26444:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1762167017.885281:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f794700 00010000:00010000:3.0:1762167017.885298:0:26444:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0c810 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4474 expref: -99 pid: 26444 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762167017.885321:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3271 00000100:00100000:0.0:1762167017.885331:0:14117:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12bd460f-a83f-41fe-92df-dfba4795e03a+7:2358:x1847765452055296:12345-192.168.203.35@tcp:3:cat.0 00000100:00100000:0.0:1762167017.885580:0:14117:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12bd460f-a83f-41fe-92df-dfba4795e03a+7:2358:x1847765452055296:12345-192.168.203.35@tcp:3:cat.0 Request processed in 249us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.885591:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3271 00002000:00100000:0.0:1762167017.885598:0:14117:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x81f:0x0] (0->4095) req@ffff9ee37f794700 x1847765452055296/t0(0) o3->12bd460f-a83f-41fe-92df-dfba4795e03a@192.168.203.35@tcp:48/0 lens 488/440 e 0 to 0 dl 1762167028 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762167017.885605:0:14117:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f794700 with x1847765452055296 ext(0->4095) 00002000:00010000:0.0:1762167017.885608:0:14117:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f794700 00010000:00010000:3.0:1762167017.885838:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.885842:0:26444:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762167017.885854:0:26444:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0c810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4474 expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167017.885874:0:26444:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee347922200/0xf915a5bdf3d0c810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4474 expref: 17 pid: 26444 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762167017.885886:0:26444:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee347922200, rc 0) 00000100:00100000:3.0:1762167017.885910:0:26444:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765452055168:12345-192.168.203.35@tcp:101:cat.0 Request processed in 654us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1762167017.885917:0:26444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17591 00000100:00100000:3.0:1762167017.886103:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.886164:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452055424 00000100:00100000:0.0:1762167017.886170:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452055424 00000100:00100000:3.0:1762167017.886184:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.886217:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:0.0:1762167017.886218:0:6535:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452055552 00000100:00100000:0.0:1762167017.886224:0:6535:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452055552 00000100:00100000:3.0:1762167017.886248:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452055808 00000100:00100000:3.0:1762167017.886254:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452055808 00000100:00100000:0.0:1762167017.886259:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17592 00000100:00100000:0.0:1762167017.886269:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+17:2359:x1847765452055424:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762167017.886280:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167017.886291:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c817 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb447b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762167017.886295:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7418 00000100:00100000:3.0:1762167017.886320:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+891:57219:x1847765452055808:12345-192.168.203.35@tcp:35:multiop.0 00010000:00010000:0.0:1762167017.886397:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.886400:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.886407:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c817 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb447b expref: 18 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167017.886422:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9ee36e4b3c00/0xf915a5bdf3d0c817 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb447b expref: 18 pid: 6535 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762167017.886442:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b3c00, rc 0) 00000100:00100000:0.0:1762167017.886484:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee372a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+18:2359:x1847765452055424:12345-192.168.203.35@tcp:101:cat.0 Request processed in 215us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.886495:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17592 00000100:00100000:0.0:1762167017.886516:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 17593 00000100:00100000:0.0:1762167017.886526:0:6535:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36e3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+11:2358:x1847765452055552:12345-192.168.203.35@tcp:101:cat.0 00010000:00010000:0.0:1762167017.886542:0:6535:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762167017.886554:0:6535:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c81e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x779cfd37a0fb4482 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762167017.886570:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.886572:0:6535:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762167017.886578:0:6535:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c81e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4482 expref: 12 pid: 6535 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167017.886588:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:57219:x1847765452055808:12345-192.168.203.35@tcp:35:multiop.0 Request processed in 279us (369us total) trans 8589953235 rc 0/0 00010000:00010000:0.0:1762167017.886595:0:6535:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9ee36e4b2200/0xf915a5bdf3d0c81e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.35@tcp remote: 0x779cfd37a0fb4482 expref: 12 pid: 6535 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762167017.886600:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7418 00010000:00010000:0.0:1762167017.886611:0:6535:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ee36e4b2200, rc 0) 00000100:00100000:0.0:1762167017.886640:0:6535:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36e3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2358:x1847765452055552:12345-192.168.203.35@tcp:101:cat.0 Request processed in 116us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1762167017.886646:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 17593 00000100:00100000:0.0:1762167017.888747:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.888849:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452056064 00000100:00100000:3.0:1762167017.888858:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452056064 00000100:00100000:0.0:1762167017.888886:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.888915:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7419 00000100:00100000:3.0:1762167017.888928:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee342fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+7:57222:x1847765452056064:12345-192.168.203.35@tcp:35:cat.0 00000100:00100000:1.0:1762167017.888933:0:26246:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452056192 00000100:00100000:1.0:1762167017.888940:0:26246:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452056192 00002000:00100000:1.0:1762167017.888975:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81f:0x0] (0->4095) req@ffff9ee37f795180 x1847765452056192/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:48/0 lens 488/0 e 0 to 0 dl 1762167028 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167017.888987:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f795180 with x1847765452056192 ext(0->4095) 00002000:00010000:1.0:1762167017.888994:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f795180 00000100:00100000:1.0:1762167017.889022:0:26246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 3272 00000100:00100000:1.0:1762167017.889031:0:26246:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2359:x1847765452056192:12345-192.168.203.35@tcp:3:multiop.0 00000100:00100000:3.0:1762167017.889157:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee342fe8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+8:57222:x1847765452056064:12345-192.168.203.35@tcp:35:cat.0 Request processed in 230us (414us total) trans 8589953236 rc 0/0 00000100:00100000:3.0:1762167017.889167:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7419 00000100:00100000:1.0:1762167017.889218:0:26246:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:da9d93ea-d728-4b01-a76b-4b4ff9c19538+12:2359:x1847765452056192:12345-192.168.203.35@tcp:3:multiop.0 Request processed in 186us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1762167017.889227:0:26246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 3272 00002000:00100000:1.0:1762167017.889234:0:26246:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x81f:0x0] (0->4095) req@ffff9ee37f795180 x1847765452056192/t0(0) o3->da9d93ea-d728-4b01-a76b-4b4ff9c19538@192.168.203.35@tcp:48/0 lens 488/440 e 0 to 0 dl 1762167028 ref 1 fl Complete:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762167017.889242:0:26246:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ee37f795180 with x1847765452056192 ext(0->4095) 00002000:00010000:1.0:1762167017.889245:0:26246:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ee37f795180 00000100:00100000:0.0:1762167017.890569:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:1.0:1762167017.890723:0:30821:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452056448 00000100:00100000:1.0:1762167017.890739:0:30821:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452056448 00000100:00100000:1.0:1762167017.890850:0:30821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7420 00000100:00100000:1.0:1762167017.890861:0:30821:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+892:57223:x1847765452056448:12345-192.168.203.35@tcp:35:cat.0 00000100:00100000:1.0:1762167017.891133:0:30821:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee37f796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da9d93ea-d728-4b01-a76b-4b4ff9c19538+893:57223:x1847765452056448:12345-192.168.203.35@tcp:35:cat.0 Request processed in 273us (570us total) trans 8589953237 rc 0/0 00000100:00100000:1.0:1762167017.891142:0:30821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7420 00000100:00100000:2.0:1762167017.891701:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.35@tcp (source: 12345-192.168.203.35@tcp) 00000100:00100000:3.0:1762167017.891782:0:30820:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765452056704 00000100:00100000:3.0:1762167017.891792:0:30820:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765452056704 00000100:00100000:3.0:1762167017.891843:0:30820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.35@tcp, seq: 7421 00000100:00100000:3.0:1762167017.891858:0:30820:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9ee36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+8:57224:x1847765452056704:12345-192.168.203.35@tcp:35:multiop.0 00000100:00100000:3.0:1762167017.892091:0:30820:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9ee36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12bd460f-a83f-41fe-92df-dfba4795e03a+9:57224:x1847765452056704:12345-192.168.203.35@tcp:35:multiop.0 Request processed in 239us (394us total) trans 8589953238 rc 0/0 00000100:00100000:3.0:1762167017.892100:0:30820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.35@tcp, seq: 7421 00010000:00010000:3.0:1762167017.896852:0:5744:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1762167018.644013:0:34609:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: failed writing to 2013952:119968 00000001:02000400:3.0:1762167018.647124:0:34611:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: failed writing to 2846976:558624 00010000:00010000:0.0:1762167018.920040:0:5743:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 73769 lines, 73769 kept, 0 dropped, 0 bad.